[19:48:25.452] New invocation is queued and will start shortly
[19:48:26.551] Starting the invocation (attempt 1)
[19:48:26.580] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/2435aa0c05fb2bf6da7ff9bb334ab4de5fcb6545"
[19:48:26.580] Popped gitiles commit info from properties and tags
[19:48:26.580] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[19:48:26.580] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[19:48:26.580] Buildbucket request:
{
"requestId": "8878032228725402416",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWin64PGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2435aa0c05fb2bf6da7ff9bb334ab4de5fcb6545",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8878032228725402416"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTWin64PGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[19:48:27.210] Scheduled build:
{
"id": "8712602166825934673",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWin64PGO"
},
"number": 12084,
"createdBy": "project:chromium",
"createTime": "2025-06-08T19:48:26.640600934Z",
"updateTime": "2025-06-08T19:48:26.640600934Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2435aa0c05fb2bf6da7ff9bb334ab4de5fcb6545",
"ref": "refs/heads/main"
}
}
}
[19:48:27.210] Task URL: https://cr-buildbucket.appspot.com/build/8712602166825934673
[19:48:27.210] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:2:0) after 1m50s
[19:48:28.236] Received PubSub notification, asking Buildbucket for the build status
[19:48:28.255] Build status: SCHEDULED
[19:50:17.235] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:2:0)
[19:50:17.260] Build status: SCHEDULED
[19:50:17.260] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:4:0) after 2m17s
[19:52:34.279] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:4:0)
[19:52:34.304] Build status: SCHEDULED
[19:52:34.304] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:5:0) after 1m6s
[19:53:40.328] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:5:0)
[19:53:40.357] Build status: SCHEDULED
[19:53:40.357] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:6:0) after 9m32s
[20:01:16.077] Received PubSub notification, asking Buildbucket for the build status
[20:01:16.217] Build status: STARTED
[20:03:12.391] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:6:0)
[20:03:12.419] Build status: STARTED
[20:03:12.419] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:8:0) after 6m9s
[20:09:21.444] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:8:0)
[20:09:21.469] Build status: STARTED
[20:09:21.469] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:9:0) after 5m12s
[20:14:33.443] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:9:0)
[20:14:33.468] Build status: STARTED
[20:14:33.468] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:10:0) after 9m12s
[20:23:45.788] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:10:0)
[20:23:45.835] Build status: STARTED
[20:23:45.835] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:11:0) after 6m30s
[20:30:15.956] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:11:0)
[20:30:15.973] Build status: STARTED
[20:30:15.973] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:12:0) after 8m1s
[20:38:17.032] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:12:0)
[20:38:17.052] Build status: STARTED
[20:38:17.052] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:13:0) after 1m50s
[20:40:07.234] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:13:0)
[20:40:07.265] Build status: STARTED
[20:40:07.265] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:14:0) after 1m11s
[20:41:18.288] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:14:0)
[20:41:18.339] Build status: STARTED
[20:41:18.339] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:15:0) after 7m15s
[20:48:33.651] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:15:0)
[20:48:33.675] Build status: STARTED
[20:48:33.675] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:16:0) after 4m47s
[20:53:20.742] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:16:0)
[20:53:20.759] Build status: STARTED
[20:53:20.759] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:17:0) after 2m50s
[20:56:10.816] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:17:0)
[20:56:10.842] Build status: STARTED
[20:56:10.842] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:18:0) after 1m19s
[20:57:30.032] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:18:0)
[20:57:30.056] Build status: STARTED
[20:57:30.056] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:19:0) after 6m37s
[21:04:07.219] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:19:0)
[21:04:07.240] Build status: STARTED
[21:04:07.240] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:20:0) after 7m3s
[21:11:10.490] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:20:0)
[21:11:10.511] Build status: STARTED
[21:11:10.511] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:21:0) after 7m34s
[21:18:44.531] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:21:0)
[21:18:44.607] Build status: STARTED
[21:18:44.607] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:22:0) after 4m28s
[21:23:12.628] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:22:0)
[21:23:12.658] Build status: STARTED
[21:23:12.658] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:23:0) after 1m24s
[21:24:36.682] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:23:0)
[21:24:36.721] Build status: STARTED
[21:24:36.721] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:24:0) after 1m11s
[21:25:47.865] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:24:0)
[21:25:47.892] Build status: STARTED
[21:25:47.892] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:25:0) after 3m49s
[21:29:36.913] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:25:0)
[21:29:36.939] Build status: STARTED
[21:29:36.939] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:26:0) after 8m9s
[21:37:45.958] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:26:0)
[21:37:45.989] Build status: STARTED
[21:37:45.989] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:27:0) after 4m38s
[21:42:24.025] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:27:0)
[21:42:24.043] Build status: STARTED
[21:42:24.043] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:28:0) after 9m23s
[21:51:47.072] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:28:0)
[21:51:47.098] Build status: STARTED
[21:51:47.098] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:29:0) after 4m15s
[21:56:02.123] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:29:0)
[21:56:02.142] Build status: STARTED
[21:56:02.142] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:30:0) after 1m26s
[21:57:28.288] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:30:0)
[21:57:28.310] Build status: STARTED
[21:57:28.310] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:31:0) after 2m13s
[21:59:41.325] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:31:0)
[21:59:41.343] Build status: STARTED
[21:59:41.343] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:32:0) after 1m15s
[22:00:56.480] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:32:0)
[22:00:56.501] Build status: STARTED
[22:00:56.501] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:33:0) after 8m30s
[22:09:26.614] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:33:0)
[22:09:26.635] Build status: STARTED
[22:09:26.635] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:34:0) after 1m23s
[22:10:49.888] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:34:0)
[22:10:49.913] Build status: STARTED
[22:10:49.913] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:35:0) after 8m34s
[22:19:23.931] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:35:0)
[22:19:23.947] Build status: STARTED
[22:19:23.947] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:36:0) after 2m0s
[22:21:23.971] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:36:0)
[22:21:24.109] Build status: STARTED
[22:21:24.109] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:37:0) after 4m18s
[22:25:42.128] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:37:0)
[22:25:42.148] Build status: STARTED
[22:25:42.148] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:38:0) after 8m55s
[22:34:37.169] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:38:0)
[22:34:37.196] Build status: STARTED
[22:34:37.196] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:39:0) after 6m57s
[22:41:34.213] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:39:0)
[22:41:34.266] Build status: STARTED
[22:41:34.266] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:40:0) after 7m29s
[22:49:04.204] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:40:0)
[22:49:04.230] Build status: STARTED
[22:49:04.230] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:41:0) after 3m58s
[22:53:02.315] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:41:0)
[22:53:02.329] Build status: STARTED
[22:53:02.329] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:42:0) after 2m57s
[22:55:59.451] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:42:0)
[22:55:59.479] Build status: STARTED
[22:55:59.479] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:43:0) after 3m53s
[22:59:52.484] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:43:0)
[22:59:52.501] Build status: STARTED
[22:59:52.501] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:44:0) after 7m17s
[23:07:09.547] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:44:0)
[23:07:09.576] Build status: STARTED
[23:07:09.576] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:45:0) after 1m32s
[23:08:41.637] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:45:0)
[23:08:41.663] Build status: STARTED
[23:08:41.663] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:46:0) after 3m27s
[23:12:08.662] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:46:0)
[23:12:08.680] Build status: STARTED
[23:12:08.680] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:47:0) after 3m14s
[23:15:22.700] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:47:0)
[23:15:22.762] Build status: STARTED
[23:15:22.762] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:48:0) after 2m31s
[23:17:53.857] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:48:0)
[23:17:53.882] Build status: STARTED
[23:17:53.882] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:49:0) after 8m37s
[23:26:30.900] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:49:0)
[23:26:30.926] Build status: STARTED
[23:26:30.926] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:50:0) after 2m38s
[23:29:09.065] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:50:0)
[23:29:09.088] Build status: STARTED
[23:29:09.088] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:51:0) after 5m34s
[23:34:43.424] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:51:0)
[23:34:43.441] Build status: STARTED
[23:34:43.441] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:52:0) after 2m44s
[23:37:27.791] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:52:0)
[23:37:27.818] Build status: STARTED
[23:37:27.818] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:53:0) after 8m11s
[23:45:39.097] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:53:0)
[23:45:39.116] Build status: STARTED
[23:45:39.116] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:54:0) after 7m30s
[23:53:09.252] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:54:0)
[23:53:09.294] Build status: STARTED
[23:53:09.294] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:55:0) after 6m20s
[23:59:29.319] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:55:0)
[23:59:29.340] Build status: STARTED
[23:59:29.340] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:56:0) after 9m15s
[00:08:44.363] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:56:0)
[00:08:44.381] Build status: STARTED
[00:08:44.381] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:57:0) after 7m33s
[00:16:17.471] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:57:0)
[00:16:17.489] Build status: STARTED
[00:16:17.490] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:58:0) after 8m36s
[00:24:53.506] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:58:0)
[00:24:53.522] Build status: STARTED
[00:24:53.522] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:59:0) after 1m24s
[00:26:17.539] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:59:0)
[00:26:17.557] Build status: STARTED
[00:26:17.557] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:60:0) after 5m33s
[00:31:50.578] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:60:0)
[00:31:50.597] Build status: STARTED
[00:31:50.597] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:61:0) after 9m14s
[00:41:04.851] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:61:0)
[00:41:04.902] Build status: STARTED
[00:41:04.902] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:62:0) after 4m4s
[00:45:08.987] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:62:0)
[00:45:09.061] Build status: STARTED
[00:45:09.061] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:63:0) after 1m36s
[00:46:45.095] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:63:0)
[00:46:45.115] Build status: STARTED
[00:46:45.115] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:64:0) after 1m6s
[00:47:51.176] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:64:0)
[00:47:51.192] Build status: STARTED
[00:47:51.192] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:65:0) after 9m44s
[00:57:35.442] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:65:0)
[00:57:35.456] Build status: STARTED
[00:57:35.456] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:66:0) after 1m15s
[00:58:50.694] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:66:0)
[00:58:50.709] Build status: STARTED
[00:58:50.709] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:67:0) after 7m25s
[01:06:15.836] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:67:0)
[01:06:15.851] Build status: STARTED
[01:06:15.851] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8878032228725402416:68:0) after 2m45s
[01:06:33.706] Received PubSub notification, asking Buildbucket for the build status
[01:06:33.728] Build:
{
"id": "8712602166825934673",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWin64PGO"
},
"number": 12084,
"createdBy": "project:chromium",
"createTime": "2025-06-08T19:48:26.640600934Z",
"startTime": "2025-06-08T20:01:07.356092758Z",
"endTime": "2025-06-09T01:06:33.342248959Z",
"updateTime": "2025-06-09T01:06:33.342248959Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2435aa0c05fb2bf6da7ff9bb334ab4de5fcb6545",
"ref": "refs/heads/main"
}
}
}
[01:06:33.729] Invocation finished in 5h18m8.283594615s with status FAILED