[07:10:18.886] New invocation is queued and will start shortly
[07:10:20.068] Starting the invocation (attempt 1)
[07:10:20.098] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/eb0d4d8512084381c85e2f88790bdbc669dde807"
[07:10:20.099] Popped gitiles commit info from properties and tags
[07:10:20.099] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[07:10:20.099] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[07:10:20.099] Buildbucket request:
{
"requestId": "8840210392891274080",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWinArm64PGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "eb0d4d8512084381c85e2f88790bdbc669dde807",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8840210392891274080"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTWinArm64PGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[07:10:20.746] Scheduled build:
{
"id": "8674780330879315777",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWinArm64PGO"
},
"number": 9220,
"createdBy": "project:chromium",
"createTime": "2026-07-31T07:10:20.182850070Z",
"updateTime": "2026-07-31T07:10:20.182850070Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "eb0d4d8512084381c85e2f88790bdbc669dde807",
"ref": "refs/heads/main"
}
}
}
[07:10:20.746] Task URL: https://cr-buildbucket.appspot.com/build/8674780330879315777
[07:10:20.746] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:2:0) after 7m8s
[07:10:21.637] Received PubSub notification, asking Buildbucket for the build status
[07:10:21.657] Build status: SCHEDULED
[07:12:16.059] Received PubSub notification, asking Buildbucket for the build status
[07:12:16.132] Build status: STARTED
[07:17:28.805] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:2:0)
[07:17:28.821] Build status: STARTED
[07:17:28.821] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:5:0) after 7m19s
[07:24:47.887] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:5:0)
[07:24:47.921] Build status: STARTED
[07:24:47.921] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:6:0) after 5m58s
[07:30:45.993] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:6:0)
[07:30:46.012] Build status: STARTED
[07:30:46.012] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:7:0) after 2m2s
[07:32:48.162] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:7:0)
[07:32:48.179] Build status: STARTED
[07:32:48.179] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:8:0) after 8m32s
[07:41:20.195] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:8:0)
[07:41:20.212] Build status: STARTED
[07:41:20.212] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:9:0) after 3m12s
[07:44:32.230] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:9:0)
[07:44:32.251] Build status: STARTED
[07:44:32.251] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:10:0) after 3m40s
[07:48:12.385] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:10:0)
[07:48:12.404] Build status: STARTED
[07:48:12.404] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:11:0) after 5m6s
[07:53:18.449] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:11:0)
[07:53:18.477] Build status: STARTED
[07:53:18.477] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:12:0) after 2m35s
[07:55:53.498] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:12:0)
[07:55:53.515] Build status: STARTED
[07:55:53.515] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:13:0) after 2m51s
[07:58:44.559] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:13:0)
[07:58:44.580] Build status: STARTED
[07:58:44.580] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:14:0) after 2m3s
[08:00:47.598] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:14:0)
[08:00:47.669] Build status: STARTED
[08:00:47.669] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:15:0) after 3m54s
[08:04:41.783] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:15:0)
[08:04:41.799] Build status: STARTED
[08:04:41.799] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:16:0) after 9m35s
[08:14:16.816] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:16:0)
[08:14:16.836] Build status: STARTED
[08:14:16.836] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:17:0) after 5m7s
[08:19:23.853] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:17:0)
[08:19:23.879] Build status: STARTED
[08:19:23.879] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:18:0) after 5m54s
[08:25:17.886] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:18:0)
[08:25:17.904] Build status: STARTED
[08:25:17.904] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:19:0) after 5m2s
[08:30:19.944] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:19:0)
[08:30:20.049] Build status: STARTED
[08:30:20.049] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:20:0) after 5m37s
[08:35:57.084] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:20:0)
[08:35:57.127] Build status: STARTED
[08:35:57.127] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:21:0) after 7m44s
[08:43:41.146] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:21:0)
[08:43:41.167] Build status: STARTED
[08:43:41.167] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:22:0) after 8m53s
[08:52:34.227] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:22:0)
[08:52:34.243] Build status: STARTED
[08:52:34.243] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:23:0) after 7m8s
[08:59:42.358] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:23:0)
[08:59:42.379] Build status: STARTED
[08:59:42.379] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:24:0) after 9m39s
[09:09:21.404] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:24:0)
[09:09:21.435] Build status: STARTED
[09:09:21.435] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:25:0) after 2m14s
[09:11:35.408] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:25:0)
[09:11:35.482] Build status: STARTED
[09:11:35.482] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:26:0) after 8m6s
[09:19:41.496] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:26:0)
[09:19:41.515] Build status: STARTED
[09:19:41.515] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:27:0) after 1m24s
[09:21:05.656] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:27:0)
[09:21:05.727] Build status: STARTED
[09:21:05.727] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:28:0) after 6m58s
[09:28:03.767] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:28:0)
[09:28:03.794] Build status: STARTED
[09:28:03.794] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:29:0) after 8m32s
[09:36:35.840] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:29:0)
[09:36:35.860] Build status: STARTED
[09:36:35.860] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:30:0) after 4m45s
[09:41:20.951] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:30:0)
[09:41:20.971] Build status: STARTED
[09:41:20.972] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:31:0) after 3m43s
[09:45:03.989] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:31:0)
[09:45:04.006] Build status: STARTED
[09:45:04.006] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:32:0) after 2m35s
[09:47:39.022] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:32:0)
[09:47:39.040] Build status: STARTED
[09:47:39.040] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:33:0) after 8m40s
[09:56:19.122] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:33:0)
[09:56:19.184] Build status: STARTED
[09:56:19.184] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:34:0) after 3m32s
[09:59:51.252] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:34:0)
[09:59:51.278] Build status: STARTED
[09:59:51.278] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:35:0) after 4m50s
[10:04:41.298] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:35:0)
[10:04:41.319] Build status: STARTED
[10:04:41.319] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:36:0) after 1m29s
[10:06:10.335] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:36:0)
[10:06:10.356] Build status: STARTED
[10:06:10.356] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:37:0) after 5m33s
[10:11:43.352] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:37:0)
[10:11:43.378] Build status: STARTED
[10:11:43.378] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:38:0) after 7m6s
[10:18:49.573] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:38:0)
[10:18:49.588] Build status: STARTED
[10:18:49.588] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:39:0) after 1m12s
[10:20:01.606] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:39:0)
[10:20:01.627] Build status: STARTED
[10:20:01.627] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:40:0) after 5m36s
[10:25:37.623] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:40:0)
[10:25:37.654] Build status: STARTED
[10:25:37.654] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:41:0) after 9m53s
[10:35:30.738] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:41:0)
[10:35:30.755] Build status: STARTED
[10:35:30.755] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:42:0) after 1m14s
[10:36:44.771] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:42:0)
[10:36:44.786] Build status: STARTED
[10:36:44.786] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:43:0) after 9m16s
[10:46:00.860] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:43:0)
[10:46:00.891] Build status: STARTED
[10:46:00.891] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:44:0) after 9m53s
[10:55:53.878] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:44:0)
[10:55:53.900] Build status: STARTED
[10:55:53.900] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:45:0) after 2m4s
[10:57:57.947] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:45:0)
[10:57:57.964] Build status: STARTED
[10:57:57.964] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:46:0) after 2m10s
[11:00:08.057] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:46:0)
[11:00:08.076] Build status: STARTED
[11:00:08.076] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:47:0) after 5m50s
[11:05:58.364] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:47:0)
[11:05:58.382] Build status: STARTED
[11:05:58.382] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:48:0) after 1m29s
[11:07:27.416] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:48:0)
[11:07:27.433] Build status: STARTED
[11:07:27.433] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:49:0) after 2m46s
[11:10:13.727] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:49:0)
[11:10:13.826] Build status: STARTED
[11:10:13.826] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:50:0) after 3m10s
[11:13:23.862] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:50:0)
[11:13:23.883] Build status: STARTED
[11:13:23.883] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:51:0) after 1m50s
[11:15:13.966] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:51:0)
[11:15:13.999] Build status: STARTED
[11:15:13.999] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:52:0) after 7m9s
[11:22:23.059] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:52:0)
[11:22:23.086] Build status: STARTED
[11:22:23.086] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:53:0) after 5m24s
[11:27:47.213] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:53:0)
[11:27:47.246] Build status: STARTED
[11:27:47.246] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:54:0) after 5m20s
[11:33:07.225] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:54:0)
[11:33:07.250] Build status: STARTED
[11:33:07.250] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:55:0) after 3m18s
[11:36:25.267] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:55:0)
[11:36:25.288] Build status: STARTED
[11:36:25.288] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:56:0) after 2m47s
[11:39:12.307] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:56:0)
[11:39:12.340] Build status: STARTED
[11:39:12.340] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:57:0) after 4m32s
[11:43:44.424] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:57:0)
[11:43:44.445] Build status: STARTED
[11:43:44.445] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:58:0) after 2m9s
[11:45:53.466] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:58:0)
[11:45:53.492] Build status: STARTED
[11:45:53.492] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8840210392891274080:59:0) after 8m24s
[11:46:37.097] Received PubSub notification, asking Buildbucket for the build status
[11:46:37.116] Build:
{
"id": "8674780330879315777",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWinArm64PGO"
},
"number": 9220,
"createdBy": "project:chromium",
"createTime": "2026-07-31T07:10:20.182850070Z",
"startTime": "2026-07-31T07:12:15.836879539Z",
"endTime": "2026-07-31T11:46:23.045723564Z",
"updateTime": "2026-07-31T11:46:23.045723564Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "eb0d4d8512084381c85e2f88790bdbc669dde807",
"ref": "refs/heads/main"
}
}
}
[11:46:37.116] Invocation finished in 4h36m18.236945627s with status FAILED