[16:05:31.658] New invocation is queued and will start shortly
[16:05:34.698] Starting the invocation (attempt 1)
[16:05:34.724] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/8337e3aa22b179541a808d4bc0489ec37fe3ea08"
[16:05:34.724] Popped gitiles commit info from properties and tags
[16:05:34.724] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[16:05:34.724] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[16:05:34.725] Buildbucket request:
{
"requestId": "8851591937982229328",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTFuchsia x64"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8337e3aa22b179541a808d4bc0489ec37fe3ea08",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8851591937982229328"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTFuchsia x64"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[16:05:35.376] Scheduled build:
{
"id": "8686161874047560913",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTFuchsia x64"
},
"number": 29118,
"createdBy": "project:chromium",
"createTime": "2026-03-27T16:05:34.781404444Z",
"updateTime": "2026-03-27T16:05:34.781404444Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8337e3aa22b179541a808d4bc0489ec37fe3ea08",
"ref": "refs/heads/main"
}
},
"canary": true
}
[16:05:35.376] Task URL: https://cr-buildbucket.appspot.com/build/8686161874047560913
[16:05:35.376] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:2:0) after 5m41s
[16:05:36.292] Received PubSub notification, asking Buildbucket for the build status
[16:05:36.342] Build status: SCHEDULED
[16:05:39.170] Received PubSub notification, asking Buildbucket for the build status
[16:05:39.201] Build status: STARTED
[16:11:16.497] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:2:0)
[16:11:16.512] Build status: STARTED
[16:11:16.512] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:5:0) after 6m25s
[16:17:41.636] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:5:0)
[16:17:41.722] Build status: STARTED
[16:17:41.722] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:6:0) after 9m28s
[16:27:09.944] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:6:0)
[16:27:09.972] Build status: STARTED
[16:27:09.972] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:7:0) after 6m19s
[16:33:29.004] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:7:0)
[16:33:29.036] Build status: STARTED
[16:33:29.036] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:8:0) after 7m29s
[16:40:58.202] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:8:0)
[16:40:58.223] Build status: STARTED
[16:40:58.223] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:9:0) after 5m37s
[16:46:35.280] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:9:0)
[16:46:35.303] Build status: STARTED
[16:46:35.303] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:10:0) after 9m16s
[16:55:51.385] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:10:0)
[16:55:51.408] Build status: STARTED
[16:55:51.408] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:11:0) after 1m4s
[16:56:55.638] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:11:0)
[16:56:55.670] Build status: STARTED
[16:56:55.670] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:12:0) after 9m12s
[17:06:07.712] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:12:0)
[17:06:07.730] Build status: STARTED
[17:06:07.730] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:13:0) after 5m34s
[17:11:41.796] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:13:0)
[17:11:41.821] Build status: STARTED
[17:11:41.821] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:14:0) after 1m48s
[17:13:29.822] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:14:0)
[17:13:29.844] Build status: STARTED
[17:13:29.844] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:15:0) after 6m8s
[17:19:37.875] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:15:0)
[17:19:37.897] Build status: STARTED
[17:19:37.897] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:16:0) after 9m9s
[17:28:46.913] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:16:0)
[17:28:46.929] Build status: STARTED
[17:28:46.929] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:17:0) after 2m58s
[17:31:44.998] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:17:0)
[17:31:45.020] Build status: STARTED
[17:31:45.020] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:18:0) after 6m53s
[17:38:38.039] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:18:0)
[17:38:38.058] Build status: STARTED
[17:38:38.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:19:0) after 1m0s
[17:39:38.162] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:19:0)
[17:39:38.181] Build status: STARTED
[17:39:38.181] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:20:0) after 7m4s
[17:46:42.308] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:20:0)
[17:46:42.332] Build status: STARTED
[17:46:42.332] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:21:0) after 9m49s
[17:56:31.386] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:21:0)
[17:56:31.406] Build status: STARTED
[17:56:31.406] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:22:0) after 7m14s
[18:03:45.428] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:22:0)
[18:03:45.450] Build status: STARTED
[18:03:45.450] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:23:0) after 3m52s
[18:07:37.495] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:23:0)
[18:07:37.510] Build status: STARTED
[18:07:37.510] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:24:0) after 3m39s
[18:11:16.537] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:24:0)
[18:11:16.565] Build status: STARTED
[18:11:16.565] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:25:0) after 2m48s
[18:14:04.585] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:25:0)
[18:14:04.601] Build status: STARTED
[18:14:04.602] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:26:0) after 3m30s
[18:17:34.637] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:26:0)
[18:17:34.656] Build status: STARTED
[18:17:34.656] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:27:0) after 3m1s
[18:20:35.682] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:27:0)
[18:20:35.700] Build status: STARTED
[18:20:35.700] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:28:0) after 6m14s
[18:26:49.870] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:28:0)
[18:26:49.906] Build status: STARTED
[18:26:49.906] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:29:0) after 6m11s
[18:33:01.085] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:29:0)
[18:33:01.108] Build status: STARTED
[18:33:01.108] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:30:0) after 4m21s
[18:37:22.229] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:30:0)
[18:37:22.249] Build status: STARTED
[18:37:22.250] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:31:0) after 3m7s
[18:40:29.319] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:31:0)
[18:40:29.335] Build status: STARTED
[18:40:29.335] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:32:0) after 9m42s
[18:50:11.441] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:32:0)
[18:50:11.494] Build status: STARTED
[18:50:11.494] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:33:0) after 6m50s
[18:57:01.694] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:33:0)
[18:57:01.716] Build status: STARTED
[18:57:01.716] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:34:0) after 1m7s
[18:58:08.767] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:34:0)
[18:58:08.783] Build status: STARTED
[18:58:08.783] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:35:0) after 6m46s
[19:04:54.924] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:35:0)
[19:04:55.114] Build status: STARTED
[19:04:55.114] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:36:0) after 6m57s
[19:11:52.175] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:36:0)
[19:11:52.210] Build status: STARTED
[19:11:52.210] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:37:0) after 2m53s
[19:14:45.234] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:37:0)
[19:14:45.357] Build status: STARTED
[19:14:45.357] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:38:0) after 9m33s
[19:24:18.379] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:38:0)
[19:24:18.399] Build status: STARTED
[19:24:18.399] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:39:0) after 3m53s
[19:28:11.464] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:39:0)
[19:28:11.485] Build status: STARTED
[19:28:11.485] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:40:0) after 8m22s
[19:36:33.575] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:40:0)
[19:36:33.593] Build status: STARTED
[19:36:33.594] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:41:0) after 1m25s
[19:37:58.629] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:41:0)
[19:37:58.646] Build status: STARTED
[19:37:58.646] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:42:0) after 1m43s
[19:39:41.688] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:42:0)
[19:39:41.713] Build status: STARTED
[19:39:41.713] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:43:0) after 7m42s
[19:47:23.730] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:43:0)
[19:47:23.756] Build status: STARTED
[19:47:23.756] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:44:0) after 3m47s
[19:51:10.738] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:44:0)
[19:51:10.756] Build status: STARTED
[19:51:10.756] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:45:0) after 1m13s
[19:52:23.773] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:45:0)
[19:52:23.796] Build status: STARTED
[19:52:23.796] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:46:0) after 6m9s
[19:58:32.816] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:46:0)
[19:58:32.863] Build status: STARTED
[19:58:32.863] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8851591937982229328:47:0) after 1m34s
[19:58:55.186] Received PubSub notification, asking Buildbucket for the build status
[19:58:55.207] Build:
{
"id": "8686161874047560913",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTFuchsia x64"
},
"number": 29118,
"createdBy": "project:chromium",
"createTime": "2026-03-27T16:05:34.781404444Z",
"startTime": "2026-03-27T16:05:38.932362665Z",
"endTime": "2026-03-27T19:58:54.729205043Z",
"updateTime": "2026-03-27T19:58:54.729205043Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8337e3aa22b179541a808d4bc0489ec37fe3ea08",
"ref": "refs/heads/main"
}
},
"canary": true
}
[19:58:55.207] Invocation finished in 3h53m23.561644154s with status FAILED