[17:23:21.153] New invocation is queued and will start shortly
[17:23:22.635] Starting the invocation (attempt 1)
[17:23:22.665] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/8fe6275cd6b1d7f88fea918eef15af8b7b7fa099"
[17:23:22.665] Popped gitiles commit info from properties and tags
[17:23:22.665] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[17:23:22.666] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[17:23:22.666] Buildbucket request:
{
"requestId": "8852311817390879024",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTFuchsia x64"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8fe6275cd6b1d7f88fea918eef15af8b7b7fa099",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8852311817390879024"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTFuchsia x64"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[17:23:23.216] Scheduled build:
{
"id": "8686881755076551009",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTFuchsia x64"
},
"number": 28992,
"createdBy": "project:chromium",
"createTime": "2026-03-19T17:23:22.733064542Z",
"updateTime": "2026-03-19T17:23:22.733064542Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8fe6275cd6b1d7f88fea918eef15af8b7b7fa099",
"ref": "refs/heads/main"
}
}
}
[17:23:23.216] Task URL: https://cr-buildbucket.appspot.com/build/8686881755076551009
[17:23:23.216] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:2:0) after 6m45s
[17:23:24.140] Received PubSub notification, asking Buildbucket for the build status
[17:23:24.223] Build status: SCHEDULED
[17:23:29.145] Received PubSub notification, asking Buildbucket for the build status
[17:23:29.162] Build status: STARTED
[17:30:08.235] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:2:0)
[17:30:08.276] Build status: STARTED
[17:30:08.276] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:5:0) after 4m18s
[17:34:26.309] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:5:0)
[17:34:26.334] Build status: STARTED
[17:34:26.334] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:6:0) after 5m11s
[17:39:37.365] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:6:0)
[17:39:37.393] Build status: STARTED
[17:39:37.393] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:7:0) after 1m49s
[17:41:26.429] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:7:0)
[17:41:26.466] Build status: STARTED
[17:41:26.466] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:8:0) after 8m48s
[17:50:14.631] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:8:0)
[17:50:14.718] Build status: STARTED
[17:50:14.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:9:0) after 5m21s
[17:55:35.743] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:9:0)
[17:55:35.764] Build status: STARTED
[17:55:35.764] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:10:0) after 4m56s
[18:00:31.813] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:10:0)
[18:00:31.832] Build status: STARTED
[18:00:31.832] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:11:0) after 3m53s
[18:04:24.851] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:11:0)
[18:04:24.865] Build status: STARTED
[18:04:24.865] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:12:0) after 6m42s
[18:11:06.954] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:12:0)
[18:11:06.972] Build status: STARTED
[18:11:06.972] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:13:0) after 3m29s
[18:14:36.037] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:13:0)
[18:14:36.055] Build status: STARTED
[18:14:36.055] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:14:0) after 9m2s
[18:23:38.101] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:14:0)
[18:23:38.120] Build status: STARTED
[18:23:38.120] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:15:0) after 4m5s
[18:27:43.136] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:15:0)
[18:27:43.159] Build status: STARTED
[18:27:43.159] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:16:0) after 8m8s
[18:35:51.204] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:16:0)
[18:35:51.220] Build status: STARTED
[18:35:51.220] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:17:0) after 5m30s
[18:41:21.215] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:17:0)
[18:41:21.233] Build status: STARTED
[18:41:21.233] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:18:0) after 3m12s
[18:44:33.362] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:18:0)
[18:44:33.382] Build status: STARTED
[18:44:33.382] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:19:0) after 1m7s
[18:45:40.431] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:19:0)
[18:45:40.461] Build status: STARTED
[18:45:40.461] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:20:0) after 1m35s
[18:47:15.501] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:20:0)
[18:47:15.769] Build status: STARTED
[18:47:15.769] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:21:0) after 2m43s
[18:49:58.791] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:21:0)
[18:49:58.810] Build status: STARTED
[18:49:58.810] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:22:0) after 6m58s
[18:56:56.901] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:22:0)
[18:56:56.973] Build status: STARTED
[18:56:56.973] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:23:0) after 5m27s
[19:02:24.011] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:23:0)
[19:02:24.028] Build status: STARTED
[19:02:24.028] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:24:0) after 8m35s
[19:10:59.078] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:24:0)
[19:10:59.097] Build status: STARTED
[19:10:59.097] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:25:0) after 7m55s
[19:18:54.115] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:25:0)
[19:18:54.130] Build status: STARTED
[19:18:54.130] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:26:0) after 3m43s
[19:22:37.195] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:26:0)
[19:22:37.246] Build status: STARTED
[19:22:37.246] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:27:0) after 1m2s
[19:23:39.303] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:27:0)
[19:23:39.322] Build status: STARTED
[19:23:39.322] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:28:0) after 5m10s
[19:28:49.372] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:28:0)
[19:28:49.389] Build status: STARTED
[19:28:49.389] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:29:0) after 8m32s
[19:37:21.392] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:29:0)
[19:37:21.410] Build status: STARTED
[19:37:21.410] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:30:0) after 3m22s
[19:40:43.460] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:30:0)
[19:40:43.487] Build status: STARTED
[19:40:43.487] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:31:0) after 1m19s
[19:42:02.503] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:31:0)
[19:42:02.523] Build status: STARTED
[19:42:02.523] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:32:0) after 7m29s
[19:49:31.529] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:32:0)
[19:49:31.546] Build status: STARTED
[19:49:31.546] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:33:0) after 3m42s
[19:53:13.568] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:33:0)
[19:53:13.649] Build status: STARTED
[19:53:13.649] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:34:0) after 4m50s
[19:58:03.684] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:34:0)
[19:58:03.715] Build status: STARTED
[19:58:03.715] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:35:0) after 1m17s
[19:59:20.781] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:35:0)
[19:59:20.804] Build status: STARTED
[19:59:20.804] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:36:0) after 9m11s
[20:08:31.821] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:36:0)
[20:08:31.933] Build status: STARTED
[20:08:31.933] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:37:0) after 9m39s
[20:18:10.997] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:37:0)
[20:18:11.012] Build status: STARTED
[20:18:11.012] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:38:0) after 6m24s
[20:24:35.009] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:38:0)
[20:24:35.025] Build status: STARTED
[20:24:35.025] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:39:0) after 5m10s
[20:29:45.042] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:39:0)
[20:29:45.075] Build status: STARTED
[20:29:45.075] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:40:0) after 1m13s
[20:30:58.180] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:40:0)
[20:30:58.224] Build status: STARTED
[20:30:58.224] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:41:0) after 4m48s
[20:35:46.254] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:41:0)
[20:35:46.317] Build status: STARTED
[20:35:46.317] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:42:0) after 4m37s
[20:40:23.341] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:42:0)
[20:40:23.364] Build status: STARTED
[20:40:23.364] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:43:0) after 6m2s
[20:46:25.381] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:43:0)
[20:46:25.398] Build status: STARTED
[20:46:25.398] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:44:0) after 1m42s
[20:48:07.447] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:44:0)
[20:48:07.461] Build status: STARTED
[20:48:07.461] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:45:0) after 6m57s
[20:55:04.479] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:45:0)
[20:55:04.529] Build status: STARTED
[20:55:04.529] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:46:0) after 5m22s
[21:00:26.569] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:46:0)
[21:00:26.584] Build status: STARTED
[21:00:26.584] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:47:0) after 5m22s
[21:05:48.634] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:47:0)
[21:05:48.652] Build status: STARTED
[21:05:48.652] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:48:0) after 6m49s
[21:12:37.708] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:48:0)
[21:12:37.730] Build status: STARTED
[21:12:37.730] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8852311817390879024:49:0) after 9m43s
[21:17:06.068] Received PubSub notification, asking Buildbucket for the build status
[21:17:06.086] Build:
{
"id": "8686881755076551009",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTFuchsia x64"
},
"number": 28992,
"createdBy": "project:chromium",
"createTime": "2026-03-19T17:23:22.733064542Z",
"startTime": "2026-03-19T17:23:28.893560028Z",
"endTime": "2026-03-19T21:17:05.229223593Z",
"updateTime": "2026-03-19T21:17:05.229223593Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8fe6275cd6b1d7f88fea918eef15af8b7b7fa099",
"ref": "refs/heads/main"
}
}
}
[21:17:06.086] Invocation finished in 3h53m44.944322062s with status FAILED