[15:38:16.703] New invocation is queued and will start shortly
[15:38:18.260] Starting the invocation (attempt 1)
[15:38:18.287] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/1f491130956612a6e237f5b11c682529a9de840d"
[15:38:18.287] Popped gitiles commit info from properties and tags
[15:38:18.287] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[15:38:18.287] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[15:38:18.287] Buildbucket request:
{
"requestId": "8852227831115831152",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTFuchsia x64"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1f491130956612a6e237f5b11c682529a9de840d",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8852227831115831152"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTFuchsia x64"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[15:38:18.909] Scheduled build:
{
"id": "8686797768740155121",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTFuchsia x64"
},
"number": 29000,
"createdBy": "project:chromium",
"createTime": "2026-03-20T15:38:18.345940059Z",
"updateTime": "2026-03-20T15:38:18.345940059Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1f491130956612a6e237f5b11c682529a9de840d",
"ref": "refs/heads/main"
}
},
"canary": true
}
[15:38:18.909] Task URL: https://cr-buildbucket.appspot.com/build/8686797768740155121
[15:38:18.909] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:2:0) after 9m23s
[15:38:19.830] Received PubSub notification, asking Buildbucket for the build status
[15:38:19.846] Build status: SCHEDULED
[15:39:16.129] Received PubSub notification, asking Buildbucket for the build status
[15:39:16.152] Build status: STARTED
[15:47:41.977] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:2:0)
[15:47:41.994] Build status: STARTED
[15:47:41.994] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:5:0) after 3m53s
[15:51:35.050] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:5:0)
[15:51:35.068] Build status: STARTED
[15:51:35.068] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:6:0) after 5m8s
[15:56:43.090] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:6:0)
[15:56:43.108] Build status: STARTED
[15:56:43.108] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:7:0) after 1m49s
[15:58:32.134] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:7:0)
[15:58:32.148] Build status: STARTED
[15:58:32.148] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:8:0) after 1m1s
[15:59:33.235] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:8:0)
[15:59:33.253] Build status: STARTED
[15:59:33.253] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:9:0) after 2m52s
[16:02:25.382] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:9:0)
[16:02:25.442] Build status: STARTED
[16:02:25.442] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:10:0) after 8m29s
[16:10:54.458] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:10:0)
[16:10:54.474] Build status: STARTED
[16:10:54.474] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:11:0) after 5m49s
[16:16:43.518] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:11:0)
[16:16:43.968] Build status: STARTED
[16:16:43.968] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:12:0) after 4m56s
[16:21:39.986] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:12:0)
[16:21:40.006] Build status: STARTED
[16:21:40.006] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:13:0) after 1m43s
[16:23:23.051] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:13:0)
[16:23:23.068] Build status: STARTED
[16:23:23.068] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:14:0) after 3m33s
[16:26:56.065] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:14:0)
[16:26:56.095] Build status: STARTED
[16:26:56.096] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:15:0) after 9m48s
[16:36:44.220] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:15:0)
[16:36:44.295] Build status: STARTED
[16:36:44.296] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:16:0) after 2m32s
[16:39:16.375] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:16:0)
[16:39:16.390] Build status: STARTED
[16:39:16.390] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:17:0) after 9m23s
[16:48:39.406] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:17:0)
[16:48:41.595] Build status: STARTED
[16:48:41.595] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:18:0) after 2m26s
[16:52:36.042] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:18:0)
[16:52:36.058] Build status: STARTED
[16:52:36.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:19:0) after 4m48s
[16:57:24.077] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:19:0)
[16:57:24.092] Build status: STARTED
[16:57:24.092] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:20:0) after 5m10s
[17:02:34.109] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:20:0)
[17:02:34.133] Build status: STARTED
[17:02:34.133] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:21:0) after 9m10s
[17:11:44.210] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:21:0)
[17:11:44.227] Build status: STARTED
[17:11:44.227] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:22:0) after 2m53s
[17:14:37.217] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:22:0)
[17:14:37.234] Build status: STARTED
[17:14:37.234] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:23:0) after 4m46s
[17:19:23.267] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:23:0)
[17:19:23.295] Build status: STARTED
[17:19:23.295] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:24:0) after 3m32s
[17:22:55.583] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:24:0)
[17:22:55.604] Build status: STARTED
[17:22:55.604] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:25:0) after 2m56s
[17:25:51.775] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:25:0)
[17:25:51.790] Build status: STARTED
[17:25:51.790] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:26:0) after 8m29s
[17:34:20.803] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:26:0)
[17:34:20.822] Build status: STARTED
[17:34:20.823] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:27:0) after 4m45s
[17:39:05.803] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:27:0)
[17:39:05.870] Build status: STARTED
[17:39:05.870] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:28:0) after 7m47s
[17:46:52.904] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:28:0)
[17:46:53.534] Build status: STARTED
[17:46:53.535] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:29:0) after 4m55s
[17:51:48.600] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:29:0)
[17:51:48.728] Build status: STARTED
[17:51:48.728] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:30:0) after 4m53s
[17:56:41.847] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:30:0)
[17:56:41.890] Build status: STARTED
[17:56:41.890] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:31:0) after 4m36s
[18:01:18.033] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:31:0)
[18:01:18.047] Build status: STARTED
[18:01:18.047] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:32:0) after 5m1s
[18:06:19.119] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:32:0)
[18:06:19.151] Build status: STARTED
[18:06:19.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:33:0) after 3m54s
[18:10:13.444] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:33:0)
[18:10:13.465] Build status: STARTED
[18:10:13.465] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:34:0) after 6m12s
[18:16:25.630] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:34:0)
[18:16:25.658] Build status: STARTED
[18:16:25.658] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:35:0) after 7m24s
[18:23:49.690] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:35:0)
[18:23:49.706] Build status: STARTED
[18:23:49.706] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:36:0) after 7m25s
[18:31:14.712] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:36:0)
[18:31:14.733] Build status: STARTED
[18:31:14.733] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:37:0) after 1m30s
[18:32:44.735] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:37:0)
[18:32:44.751] Build status: STARTED
[18:32:44.751] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:38:0) after 3m5s
[18:35:49.926] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:38:0)
[18:35:49.987] Build status: STARTED
[18:35:49.987] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:39:0) after 1m1s
[18:36:51.056] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:39:0)
[18:36:51.105] Build status: STARTED
[18:36:51.106] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:40:0) after 6m40s
[18:43:31.183] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:40:0)
[18:43:31.201] Build status: STARTED
[18:43:31.202] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:41:0) after 6m21s
[18:49:52.398] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:41:0)
[18:49:52.415] Build status: STARTED
[18:49:52.415] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:42:0) after 8m19s
[18:58:11.388] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:42:0)
[18:58:11.405] Build status: STARTED
[18:58:11.405] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:43:0) after 3m33s
[19:01:44.472] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:43:0)
[19:01:44.491] Build status: STARTED
[19:01:44.492] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:44:0) after 6m48s
[19:08:32.478] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:44:0)
[19:08:32.498] Build status: STARTED
[19:08:32.498] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852227831115831152:45:0) after 9m22s
[19:14:23.293] Received PubSub notification, asking Buildbucket for the build status
[19:14:23.470] Build:
{
"id": "8686797768740155121",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTFuchsia x64"
},
"number": 29000,
"createdBy": "project:chromium",
"createTime": "2026-03-20T15:38:18.345940059Z",
"startTime": "2026-03-20T15:39:15.865820767Z",
"endTime": "2026-03-20T19:14:22.673908806Z",
"updateTime": "2026-03-20T19:14:22.673908806Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1f491130956612a6e237f5b11c682529a9de840d",
"ref": "refs/heads/main"
}
},
"canary": true
}
[19:14:23.471] Invocation finished in 3h36m6.774669408s with status FAILED