[11:04:59.893] New invocation is queued and will start shortly
[11:05:01.124] Starting the invocation (attempt 1)
[11:05:01.150] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/4188d3e3f14d40c6f428c678e665e05f8e35177d"
[11:05:01.150] Popped gitiles commit info from properties and tags
[11:05:01.150] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[11:05:01.150] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[11:05:01.150] Buildbucket request:
{
"requestId": "8855778306108333456",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWinArm64PGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4188d3e3f14d40c6f428c678e665e05f8e35177d",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8855778306108333456"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTWinArm64PGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[11:05:01.609] Scheduled build:
{
"id": "8690348244076572385",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWinArm64PGO"
},
"number": 7451,
"createdBy": "project:chromium",
"createTime": "2026-02-09T11:05:01.206421881Z",
"updateTime": "2026-02-09T11:05:01.206421881Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4188d3e3f14d40c6f428c678e665e05f8e35177d",
"ref": "refs/heads/main"
}
}
}
[11:05:01.609] Task URL: https://cr-buildbucket.appspot.com/build/8690348244076572385
[11:05:01.609] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:2:0) after 6m14s
[11:05:02.562] Received PubSub notification, asking Buildbucket for the build status
[11:05:02.632] Build status: SCHEDULED
[11:09:10.454] Received PubSub notification, asking Buildbucket for the build status
[11:09:10.473] Build status: STARTED
[11:11:15.657] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:2:0)
[11:11:15.686] Build status: STARTED
[11:11:15.686] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:5:0) after 2m23s
[11:13:38.704] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:5:0)
[11:13:38.719] Build status: STARTED
[11:13:38.719] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:6:0) after 6m56s
[11:20:34.735] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:6:0)
[11:20:34.753] Build status: STARTED
[11:20:34.753] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:7:0) after 2m21s
[11:22:55.764] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:7:0)
[11:22:55.781] Build status: STARTED
[11:22:55.781] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:8:0) after 7m50s
[11:30:45.814] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:8:0)
[11:30:45.834] Build status: STARTED
[11:30:45.834] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:9:0) after 2m32s
[11:33:17.892] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:9:0)
[11:33:17.909] Build status: STARTED
[11:33:17.909] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:10:0) after 4m52s
[11:38:09.923] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:10:0)
[11:38:09.954] Build status: STARTED
[11:38:09.954] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:11:0) after 6m42s
[11:44:51.984] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:11:0)
[11:44:52.029] Build status: STARTED
[11:44:52.029] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:12:0) after 5m57s
[11:50:49.053] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:12:0)
[11:50:49.079] Build status: STARTED
[11:50:49.079] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:13:0) after 8m6s
[11:58:55.155] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:13:0)
[11:58:55.169] Build status: STARTED
[11:58:55.170] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:14:0) after 1m35s
[12:00:30.182] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:14:0)
[12:00:30.231] Build status: STARTED
[12:00:30.231] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:15:0) after 9m32s
[12:10:02.305] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:15:0)
[12:10:02.321] Build status: STARTED
[12:10:02.321] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:16:0) after 2m58s
[12:13:00.387] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:16:0)
[12:13:00.406] Build status: STARTED
[12:13:00.406] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:17:0) after 9m8s
[12:22:08.482] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:17:0)
[12:22:08.502] Build status: STARTED
[12:22:08.502] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:18:0) after 2m22s
[12:24:30.540] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:18:0)
[12:24:30.621] Build status: STARTED
[12:24:30.621] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:19:0) after 4m13s
[12:28:43.639] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:19:0)
[12:28:43.654] Build status: STARTED
[12:28:43.654] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:20:0) after 1m48s
[12:30:31.633] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:20:0)
[12:30:31.684] Build status: STARTED
[12:30:31.684] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:21:0) after 4m47s
[12:35:18.750] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:21:0)
[12:35:18.792] Build status: STARTED
[12:35:18.792] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:22:0) after 2m5s
[12:37:23.951] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:22:0)
[12:37:23.992] Build status: STARTED
[12:37:23.992] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:23:0) after 6m54s
[12:44:18.006] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:23:0)
[12:44:18.078] Build status: STARTED
[12:44:18.078] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:24:0) after 9m15s
[12:53:33.093] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:24:0)
[12:53:33.112] Build status: STARTED
[12:53:33.112] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:25:0) after 7m9s
[13:00:42.128] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:25:0)
[13:00:42.146] Build status: STARTED
[13:00:42.146] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:26:0) after 1m40s
[13:02:22.258] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:26:0)
[13:02:22.280] Build status: STARTED
[13:02:22.280] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:27:0) after 2m2s
[13:04:24.324] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:27:0)
[13:04:24.338] Build status: STARTED
[13:04:24.338] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:28:0) after 7m57s
[13:12:21.406] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:28:0)
[13:12:21.418] Build status: STARTED
[13:12:21.418] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:29:0) after 4m17s
[13:16:38.432] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:29:0)
[13:16:38.567] Build status: STARTED
[13:16:38.567] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:30:0) after 5m50s
[13:22:28.585] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:30:0)
[13:22:28.599] Build status: STARTED
[13:22:28.599] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:31:0) after 2m16s
[13:24:44.621] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:31:0)
[13:24:44.644] Build status: STARTED
[13:24:44.644] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:32:0) after 7m43s
[13:32:27.664] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:32:0)
[13:32:27.680] Build status: STARTED
[13:32:27.680] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:33:0) after 3m45s
[13:36:12.686] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:33:0)
[13:36:12.706] Build status: STARTED
[13:36:12.706] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:34:0) after 8m30s
[13:44:42.729] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:34:0)
[13:44:42.748] Build status: STARTED
[13:44:42.748] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:35:0) after 1m29s
[13:46:11.827] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:35:0)
[13:46:11.844] Build status: STARTED
[13:46:11.844] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:36:0) after 4m52s
[13:51:03.932] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:36:0)
[13:51:03.999] Build status: STARTED
[13:51:03.999] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:37:0) after 3m13s
[13:54:16.991] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:37:0)
[13:54:17.079] Build status: STARTED
[13:54:17.079] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:38:0) after 4m31s
[13:58:48.150] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:38:0)
[13:58:48.168] Build status: STARTED
[13:58:48.168] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:39:0) after 1m43s
[14:00:31.255] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:39:0)
[14:00:31.346] Build status: STARTED
[14:00:31.346] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:40:0) after 6m27s
[14:06:58.369] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:40:0)
[14:06:58.404] Build status: STARTED
[14:06:58.404] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:41:0) after 5m16s
[14:12:14.471] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:41:0)
[14:12:14.503] Build status: STARTED
[14:12:14.503] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:42:0) after 3m3s
[14:15:17.571] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:42:0)
[14:15:17.589] Build status: STARTED
[14:15:17.589] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:43:0) after 5m34s
[14:20:51.613] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:43:0)
[14:20:51.631] Build status: STARTED
[14:20:51.631] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:44:0) after 5m2s
[14:25:53.652] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:44:0)
[14:25:53.668] Build status: STARTED
[14:25:53.668] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:45:0) after 3m33s
[14:29:26.683] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:45:0)
[14:29:26.699] Build status: STARTED
[14:29:26.699] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8855778306108333456:46:0) after 7m44s
[14:29:44.743] Received PubSub notification, asking Buildbucket for the build status
[14:29:44.763] Build:
{
"id": "8690348244076572385",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWinArm64PGO"
},
"number": 7451,
"createdBy": "project:chromium",
"createTime": "2026-02-09T11:05:01.206421881Z",
"startTime": "2026-02-09T11:09:10.266067522Z",
"endTime": "2026-02-09T14:29:44.390070716Z",
"updateTime": "2026-02-09T14:29:44.390070716Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4188d3e3f14d40c6f428c678e665e05f8e35177d",
"ref": "refs/heads/main"
}
}
}
[14:29:44.763] Invocation finished in 3h24m44.878569081s with status FAILED