[13:48:24.685] New invocation is queued and will start shortly
[13:48:25.749] Starting the invocation (attempt 1)
[13:48:25.773] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/6364de54e553539e3139d9ddfd18b61115f0d329"
[13:48:25.773] Popped gitiles commit info from properties and tags
[13:48:25.773] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[13:48:25.773] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[13:48:25.773] Buildbucket request:
{
"requestId": "8847342507159772080",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWin64PGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "6364de54e553539e3139d9ddfd18b61115f0d329",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8847342507159772080"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTWin64PGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[13:48:26.450] Scheduled build:
{
"id": "8681912445306118385",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWin64PGO"
},
"number": 14265,
"createdBy": "project:chromium",
"createTime": "2026-05-13T13:48:25.831201948Z",
"updateTime": "2026-05-13T13:48:25.831201948Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "6364de54e553539e3139d9ddfd18b61115f0d329",
"ref": "refs/heads/main"
}
}
}
[13:48:26.450] Task URL: https://cr-buildbucket.appspot.com/build/8681912445306118385
[13:48:26.450] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:2:0) after 8m0s
[13:48:27.330] Received PubSub notification, asking Buildbucket for the build status
[13:48:27.347] Build status: SCHEDULED
[13:50:16.801] Received PubSub notification, asking Buildbucket for the build status
[13:50:16.820] Build status: STARTED
[13:56:26.615] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:2:0)
[13:56:26.641] Build status: STARTED
[13:56:26.641] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:5:0) after 3m15s
[13:59:41.659] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:5:0)
[13:59:41.857] Build status: STARTED
[13:59:41.857] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:6:0) after 4m13s
[14:03:54.881] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:6:0)
[14:03:54.904] Build status: STARTED
[14:03:54.904] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:7:0) after 1m47s
[14:05:41.927] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:7:0)
[14:05:41.950] Build status: STARTED
[14:05:41.950] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:8:0) after 4m16s
[14:09:58.019] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:8:0)
[14:09:58.047] Build status: STARTED
[14:09:58.047] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:9:0) after 4m17s
[14:14:15.242] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:9:0)
[14:14:15.306] Build status: STARTED
[14:14:15.306] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:10:0) after 1m22s
[14:15:37.320] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:10:0)
[14:15:37.336] Build status: STARTED
[14:15:37.336] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:11:0) after 1m0s
[14:16:37.354] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:11:0)
[14:16:37.369] Build status: STARTED
[14:16:37.369] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:12:0) after 7m25s
[14:24:02.416] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:12:0)
[14:24:02.434] Build status: STARTED
[14:24:02.434] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:13:0) after 2m59s
[14:27:01.514] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:13:0)
[14:27:01.536] Build status: STARTED
[14:27:01.536] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:14:0) after 3m30s
[14:30:31.704] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:14:0)
[14:30:31.728] Build status: STARTED
[14:30:31.728] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:15:0) after 1m41s
[14:32:12.744] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:15:0)
[14:32:12.763] Build status: STARTED
[14:32:12.763] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:16:0) after 6m36s
[14:38:48.812] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:16:0)
[14:38:48.841] Build status: STARTED
[14:38:48.841] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:17:0) after 2m25s
[14:41:13.975] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:17:0)
[14:41:14.037] Build status: STARTED
[14:41:14.037] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:18:0) after 8m58s
[14:50:12.072] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:18:0)
[14:50:12.120] Build status: STARTED
[14:50:12.120] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:19:0) after 8m39s
[14:58:51.273] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:19:0)
[14:58:51.291] Build status: STARTED
[14:58:51.291] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:20:0) after 9m15s
[15:08:06.358] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:20:0)
[15:08:06.375] Build status: STARTED
[15:08:06.375] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:21:0) after 6m17s
[15:14:23.388] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:21:0)
[15:14:23.405] Build status: STARTED
[15:14:23.405] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:22:0) after 2m29s
[15:16:52.422] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:22:0)
[15:16:52.443] Build status: STARTED
[15:16:52.443] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:23:0) after 3m1s
[15:19:53.528] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:23:0)
[15:19:53.602] Build status: STARTED
[15:19:53.602] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:24:0) after 8m29s
[15:28:22.829] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:24:0)
[15:28:22.945] Build status: STARTED
[15:28:22.945] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:25:0) after 6m3s
[15:34:25.963] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:25:0)
[15:34:26.002] Build status: STARTED
[15:34:26.002] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:26:0) after 4m10s
[15:38:36.057] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:26:0)
[15:38:36.154] Build status: STARTED
[15:38:36.154] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:27:0) after 6m33s
[15:45:09.181] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:27:0)
[15:45:09.312] Build status: STARTED
[15:45:09.312] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:28:0) after 6m30s
[15:51:39.500] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:28:0)
[15:51:39.520] Build status: STARTED
[15:51:39.520] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:29:0) after 3m15s
[15:54:54.568] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:29:0)
[15:54:54.594] Build status: STARTED
[15:54:54.594] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:30:0) after 9m53s
[16:04:47.613] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:30:0)
[16:04:47.677] Build status: STARTED
[16:04:47.678] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:31:0) after 6m44s
[16:11:31.709] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:31:0)
[16:11:31.734] Build status: STARTED
[16:11:31.734] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:32:0) after 4m0s
[16:15:31.921] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:32:0)
[16:15:31.938] Build status: STARTED
[16:15:31.938] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:33:0) after 5m49s
[16:21:20.956] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:33:0)
[16:21:21.024] Build status: STARTED
[16:21:21.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:34:0) after 1m32s
[16:22:53.047] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:34:0)
[16:22:53.064] Build status: STARTED
[16:22:53.064] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:35:0) after 5m14s
[16:28:07.118] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:35:0)
[16:28:07.133] Build status: STARTED
[16:28:07.133] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:36:0) after 2m10s
[16:30:17.177] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:36:0)
[16:30:17.193] Build status: STARTED
[16:30:17.193] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:37:0) after 5m18s
[16:35:35.159] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:37:0)
[16:35:35.176] Build status: STARTED
[16:35:35.176] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:38:0) after 8m57s
[16:44:32.244] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:38:0)
[16:44:32.263] Build status: STARTED
[16:44:32.263] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:39:0) after 1m12s
[16:45:44.333] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:39:0)
[16:45:44.358] Build status: STARTED
[16:45:44.358] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:40:0) after 8m42s
[16:54:26.428] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:40:0)
[16:54:26.449] Build status: STARTED
[16:54:26.449] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:41:0) after 8m4s
[17:02:30.518] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:41:0)
[17:02:30.547] Build status: STARTED
[17:02:30.547] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:42:0) after 1m38s
[17:04:08.535] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:42:0)
[17:04:08.566] Build status: STARTED
[17:04:08.566] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:43:0) after 9m54s
[17:14:02.561] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:43:0)
[17:14:02.580] Build status: STARTED
[17:14:02.580] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:44:0) after 8m24s
[17:22:26.651] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:44:0)
[17:22:26.683] Build status: STARTED
[17:22:26.683] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:45:0) after 5m31s
[17:27:57.750] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:45:0)
[17:27:57.767] Build status: STARTED
[17:27:57.767] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:46:0) after 8m46s
[17:36:43.921] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:46:0)
[17:36:43.939] Build status: STARTED
[17:36:43.939] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:47:0) after 1m6s
[17:37:49.957] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:47:0)
[17:37:49.977] Build status: STARTED
[17:37:49.977] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:48:0) after 7m6s
[17:44:55.996] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:48:0)
[17:44:56.015] Build status: STARTED
[17:44:56.015] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:49:0) after 6m54s
[17:51:50.035] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:49:0)
[17:51:50.055] Build status: STARTED
[17:51:50.055] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:50:0) after 3m46s
[17:55:36.088] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:50:0)
[17:55:36.105] Build status: STARTED
[17:55:36.105] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:51:0) after 6m2s
[18:01:38.123] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:51:0)
[18:01:38.530] Build status: STARTED
[18:01:38.530] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:52:0) after 6m42s
[18:08:20.588] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:52:0)
[18:08:20.607] Build status: STARTED
[18:08:20.607] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:53:0) after 5m24s
[18:13:44.745] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:53:0)
[18:13:44.763] Build status: STARTED
[18:13:44.763] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:54:0) after 2m40s
[18:16:24.882] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:54:0)
[18:16:24.905] Build status: STARTED
[18:16:24.905] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:55:0) after 5m6s
[18:21:30.922] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:55:0)
[18:21:30.953] Build status: STARTED
[18:21:30.953] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847342507159772080:56:0) after 7m44s
[18:24:34.304] Received PubSub notification, asking Buildbucket for the build status
[18:24:34.321] Build:
{
"id": "8681912445306118385",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWin64PGO"
},
"number": 14265,
"createdBy": "project:chromium",
"createTime": "2026-05-13T13:48:25.831201948Z",
"startTime": "2026-05-13T13:50:16.610693992Z",
"endTime": "2026-05-13T18:24:33.252700393Z",
"updateTime": "2026-05-13T18:24:33.252700393Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "6364de54e553539e3139d9ddfd18b61115f0d329",
"ref": "refs/heads/main"
}
}
}
[18:24:34.321] Invocation finished in 4h36m9.641205516s with status FAILED