[19:49:44.519] New invocation is queued and will start shortly
[19:49:45.677] Starting the invocation (attempt 1)
[19:49:45.710] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/dc6d62f4e06ecb90bd11f995c0306c54e0581688"
[19:49:45.710] Popped gitiles commit info from properties and tags
[19:49:45.710] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[19:49:45.710] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[19:49:45.710] Buildbucket request:
{
"requestId": "8867432300750308688",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWin64PGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "dc6d62f4e06ecb90bd11f995c0306c54e0581688",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8867432300750308688"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTWin64PGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[19:49:46.190] Scheduled build:
{
"id": "8702002238788111041",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWin64PGO"
},
"number": 12497,
"createdBy": "project:chromium",
"createTime": "2025-10-03T19:49:45.766067529Z",
"updateTime": "2025-10-03T19:49:45.766067529Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "dc6d62f4e06ecb90bd11f995c0306c54e0581688",
"ref": "refs/heads/main"
}
},
"canary": true
}
[19:49:46.190] Task URL: https://cr-buildbucket.appspot.com/build/8702002238788111041
[19:49:46.190] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:2:0) after 1m22s
[19:49:46.332] Received PubSub notification, asking Buildbucket for the build status
[19:49:46.361] Build status: SCHEDULED
[19:51:08.257] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:2:0)
[19:51:08.284] Build status: SCHEDULED
[19:51:08.284] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:4:0) after 9m22s
[20:00:30.305] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:4:0)
[20:00:30.334] Build status: SCHEDULED
[20:00:30.334] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:5:0) after 1m44s
[20:02:14.375] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:5:0)
[20:02:14.389] Build status: SCHEDULED
[20:02:14.389] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:6:0) after 1m17s
[20:03:31.407] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:6:0)
[20:03:31.423] Build status: SCHEDULED
[20:03:31.423] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:7:0) after 9m25s
[20:12:56.444] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:7:0)
[20:12:56.459] Build status: SCHEDULED
[20:12:56.459] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:8:0) after 9m46s
[20:22:42.485] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:8:0)
[20:22:42.507] Build status: SCHEDULED
[20:22:42.507] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:9:0) after 4m59s
[20:27:41.593] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:9:0)
[20:27:41.631] Build status: SCHEDULED
[20:27:41.632] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:10:0) after 8m55s
[20:35:57.194] Received PubSub notification, asking Buildbucket for the build status
[20:35:57.239] Build status: STARTED
[20:36:36.659] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:10:0)
[20:36:36.681] Build status: STARTED
[20:36:36.681] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:12:0) after 7m38s
[20:44:14.750] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:12:0)
[20:44:14.766] Build status: STARTED
[20:44:14.766] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:13:0) after 4m32s
[20:48:46.869] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:13:0)
[20:48:46.896] Build status: STARTED
[20:48:46.896] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:14:0) after 9m7s
[20:57:53.980] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:14:0)
[20:57:54.003] Build status: STARTED
[20:57:54.003] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:15:0) after 4m37s
[21:02:31.073] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:15:0)
[21:02:31.087] Build status: STARTED
[21:02:31.087] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:16:0) after 4m58s
[21:07:29.127] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:16:0)
[21:07:29.148] Build status: STARTED
[21:07:29.148] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:17:0) after 4m52s
[21:12:21.270] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:17:0)
[21:12:21.286] Build status: STARTED
[21:12:21.286] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:18:0) after 2m14s
[21:14:35.321] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:18:0)
[21:14:35.411] Build status: STARTED
[21:14:35.411] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:19:0) after 8m12s
[21:22:47.447] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:19:0)
[21:22:47.464] Build status: STARTED
[21:22:47.464] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:20:0) after 8m0s
[21:30:47.516] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:20:0)
[21:30:47.538] Build status: STARTED
[21:30:47.538] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:21:0) after 2m12s
[21:32:59.659] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:21:0)
[21:32:59.672] Build status: STARTED
[21:32:59.672] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:22:0) after 1m24s
[21:34:23.788] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:22:0)
[21:34:23.800] Build status: STARTED
[21:34:23.800] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:23:0) after 8m30s
[21:42:53.815] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:23:0)
[21:42:53.837] Build status: STARTED
[21:42:53.837] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:24:0) after 4m29s
[21:47:22.897] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:24:0)
[21:47:22.918] Build status: STARTED
[21:47:22.918] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:25:0) after 2m11s
[21:49:33.928] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:25:0)
[21:49:33.944] Build status: STARTED
[21:49:33.944] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:26:0) after 7m46s
[21:57:20.020] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:26:0)
[21:57:20.040] Build status: STARTED
[21:57:20.040] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:27:0) after 8m51s
[22:06:11.117] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:27:0)
[22:06:11.135] Build status: STARTED
[22:06:11.135] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:28:0) after 9m46s
[22:15:57.230] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:28:0)
[22:15:57.252] Build status: STARTED
[22:15:57.252] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:29:0) after 2m9s
[22:18:06.352] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:29:0)
[22:18:06.368] Build status: STARTED
[22:18:06.368] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:30:0) after 2m49s
[22:20:55.413] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:30:0)
[22:20:55.428] Build status: STARTED
[22:20:55.429] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:31:0) after 5m13s
[22:26:08.494] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:31:0)
[22:26:08.509] Build status: STARTED
[22:26:08.509] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:32:0) after 5m30s
[22:31:38.530] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:32:0)
[22:31:38.584] Build status: STARTED
[22:31:38.585] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:33:0) after 1m49s
[22:33:27.604] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:33:0)
[22:33:27.652] Build status: STARTED
[22:33:27.652] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:34:0) after 4m7s
[22:37:34.760] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:34:0)
[22:37:34.786] Build status: STARTED
[22:37:34.786] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:35:0) after 2m35s
[22:40:09.896] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:35:0)
[22:40:09.913] Build status: STARTED
[22:40:09.914] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:36:0) after 6m14s
[22:46:23.992] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:36:0)
[22:46:24.011] Build status: STARTED
[22:46:24.011] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:37:0) after 6m20s
[22:52:44.029] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:37:0)
[22:52:44.052] Build status: STARTED
[22:52:44.052] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:38:0) after 2m42s
[22:55:26.132] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:38:0)
[22:55:26.218] Build status: STARTED
[22:55:26.218] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:39:0) after 2m53s
[22:58:19.388] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:39:0)
[22:58:19.401] Build status: STARTED
[22:58:19.401] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:40:0) after 6m54s
[23:05:13.481] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:40:0)
[23:05:13.495] Build status: STARTED
[23:05:13.495] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:41:0) after 2m0s
[23:07:13.510] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:41:0)
[23:07:13.585] Build status: STARTED
[23:07:13.585] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:42:0) after 2m57s
[23:10:10.653] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:42:0)
[23:10:10.670] Build status: STARTED
[23:10:10.670] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:43:0) after 1m38s
[23:11:48.701] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:43:0)
[23:11:48.715] Build status: STARTED
[23:11:48.715] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:44:0) after 1m14s
[23:13:02.825] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:44:0)
[23:13:02.846] Build status: STARTED
[23:13:02.846] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:45:0) after 7m32s
[23:20:34.866] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:45:0)
[23:20:34.882] Build status: STARTED
[23:20:34.882] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:46:0) after 6m48s
[23:27:22.946] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:46:0)
[23:27:22.961] Build status: STARTED
[23:27:22.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:47:0) after 4m36s
[23:31:58.979] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:47:0)
[23:31:59.101] Build status: STARTED
[23:31:59.101] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:48:0) after 9m45s
[23:41:44.132] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:48:0)
[23:41:44.154] Build status: STARTED
[23:41:44.154] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:49:0) after 2m0s
[23:43:44.260] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:49:0)
[23:43:44.337] Build status: STARTED
[23:43:44.337] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:50:0) after 5m52s
[23:49:36.427] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:50:0)
[23:49:36.444] Build status: STARTED
[23:49:36.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:51:0) after 9m23s
[23:58:59.482] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:51:0)
[23:58:59.593] Build status: STARTED
[23:58:59.593] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:52:0) after 8m51s
[00:07:50.762] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:52:0)
[00:07:50.779] Build status: STARTED
[00:07:50.779] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:53:0) after 8m21s
[00:16:11.796] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:53:0)
[00:16:11.812] Build status: STARTED
[00:16:11.812] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8867432300750308688:54:0) after 8m47s
[00:21:38.567] Received PubSub notification, asking Buildbucket for the build status
[00:21:38.616] Build:
{
"id": "8702002238788111041",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWin64PGO"
},
"number": 12497,
"createdBy": "project:chromium",
"createTime": "2025-10-03T19:49:45.766067529Z",
"startTime": "2025-10-03T20:35:56.454803611Z",
"endTime": "2025-10-04T00:21:37.863562973Z",
"updateTime": "2025-10-04T00:21:37.863562973Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "dc6d62f4e06ecb90bd11f995c0306c54e0581688",
"ref": "refs/heads/main"
}
},
"canary": true
}
[00:21:38.616] Invocation finished in 4h31m54.104765807s with status FAILED