[04:00:07.449] New invocation is queued and will start shortly
[04:00:09.422] Starting the invocation (attempt 1)
[04:00:09.446] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/c50a6f317fee3835c6412cddd3b9c8eaa3bafb7e"
[04:00:09.447] Popped gitiles commit info from properties and tags
[04:00:09.447] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[04:00:09.447] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[04:00:09.447] Buildbucket request:
{
"requestId": "8853449515742868080",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "fuchsia-code-coverage"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c50a6f317fee3835c6412cddd3b9c8eaa3bafb7e",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8853449515742868080"
},
{
"key": "scheduler_job_id",
"value": "chromium/fuchsia-code-coverage"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[04:00:09.926] Scheduled build:
{
"id": "8688019452946796993",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "fuchsia-code-coverage"
},
"number": 3638,
"createdBy": "project:chromium",
"createTime": "2026-03-07T04:00:09.494536312Z",
"updateTime": "2026-03-07T04:00:09.494536312Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c50a6f317fee3835c6412cddd3b9c8eaa3bafb7e",
"ref": "refs/heads/main"
}
},
"canary": true
}
[04:00:09.926] Task URL: https://cr-buildbucket.appspot.com/build/8688019452946796993
[04:00:09.926] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:2:0) after 5m6s
[04:00:16.913] Received PubSub notification, asking Buildbucket for the build status
[04:00:16.934] Build status: SCHEDULED
[04:05:15.957] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:2:0)
[04:05:15.974] Build status: SCHEDULED
[04:05:15.974] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:4:0) after 4m8s
[04:09:23.977] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:4:0)
[04:09:23.992] Build status: SCHEDULED
[04:09:23.992] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:5:0) after 9m1s
[04:18:25.090] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:5:0)
[04:18:25.109] Build status: SCHEDULED
[04:18:25.109] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:6:0) after 9m9s
[04:27:34.075] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:6:0)
[04:27:34.094] Build status: SCHEDULED
[04:27:34.094] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:7:0) after 2m28s
[04:30:02.109] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:7:0)
[04:30:02.135] Build status: SCHEDULED
[04:30:02.135] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:8:0) after 9m6s
[04:39:08.150] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:8:0)
[04:39:08.184] Build status: SCHEDULED
[04:39:08.184] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:9:0) after 9m47s
[04:48:55.765] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:9:0)
[04:48:55.798] Build status: SCHEDULED
[04:48:55.798] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:10:0) after 5m49s
[04:54:44.813] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:10:0)
[04:54:44.827] Build status: SCHEDULED
[04:54:44.827] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:11:0) after 9m4s
[05:03:48.888] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:11:0)
[05:03:48.903] Build status: SCHEDULED
[05:03:48.903] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:12:0) after 7m13s
[05:04:30.843] Received PubSub notification, asking Buildbucket for the build status
[05:04:30.860] Build status: STARTED
[05:11:01.920] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:12:0)
[05:11:01.940] Build status: STARTED
[05:11:01.941] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:14:0) after 2m8s
[05:13:09.957] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:14:0)
[05:13:09.973] Build status: STARTED
[05:13:09.973] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:15:0) after 2m19s
[05:15:29.092] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:15:0)
[05:15:29.108] Build status: STARTED
[05:15:29.108] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:16:0) after 4m10s
[05:19:39.125] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:16:0)
[05:19:39.149] Build status: STARTED
[05:19:39.149] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:17:0) after 6m32s
[05:26:11.224] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:17:0)
[05:26:11.241] Build status: STARTED
[05:26:11.241] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:18:0) after 7m50s
[05:34:01.287] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:18:0)
[05:34:01.308] Build status: STARTED
[05:34:01.309] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:19:0) after 3m47s
[05:37:48.391] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:19:0)
[05:37:48.411] Build status: STARTED
[05:37:48.411] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:20:0) after 6m57s
[05:44:45.483] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:20:0)
[05:44:45.503] Build status: STARTED
[05:44:45.503] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:21:0) after 4m28s
[05:49:13.569] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:21:0)
[05:49:13.582] Build status: STARTED
[05:49:13.582] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:22:0) after 4m24s
[05:53:37.699] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:22:0)
[05:53:37.718] Build status: STARTED
[05:53:37.718] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:23:0) after 2m36s
[05:56:13.946] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:23:0)
[05:56:13.997] Build status: STARTED
[05:56:13.997] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:24:0) after 1m50s
[05:58:04.380] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:24:0)
[05:58:04.400] Build status: STARTED
[05:58:04.400] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:25:0) after 3m20s
[06:01:24.419] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:25:0)
[06:01:24.438] Build status: STARTED
[06:01:24.438] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:26:0) after 3m26s
[06:04:50.504] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:26:0)
[06:04:50.525] Build status: STARTED
[06:04:50.525] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:27:0) after 4m22s
[06:09:12.606] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:27:0)
[06:09:12.630] Build status: STARTED
[06:09:12.630] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:28:0) after 2m50s
[06:12:02.697] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:28:0)
[06:12:02.724] Build status: STARTED
[06:12:02.724] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:29:0) after 1m29s
[06:13:31.734] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:29:0)
[06:13:31.756] Build status: STARTED
[06:13:31.756] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:30:0) after 5m56s
[06:19:27.835] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:30:0)
[06:19:27.857] Build status: STARTED
[06:19:27.857] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:31:0) after 1m37s
[06:21:04.879] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:31:0)
[06:21:04.943] Build status: STARTED
[06:21:04.943] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:32:0) after 4m20s
[06:25:24.925] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:32:0)
[06:25:24.940] Build status: STARTED
[06:25:24.940] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:33:0) after 9m34s
[06:34:59.000] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:33:0)
[06:34:59.019] Build status: STARTED
[06:34:59.019] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:34:0) after 3m8s
[06:38:07.049] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:34:0)
[06:38:07.065] Build status: STARTED
[06:38:07.065] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:35:0) after 8m43s
[06:46:50.287] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:35:0)
[06:46:50.328] Build status: STARTED
[06:46:50.328] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:36:0) after 2m29s
[06:49:19.344] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:36:0)
[06:49:19.358] Build status: STARTED
[06:49:19.358] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:37:0) after 1m5s
[06:50:24.353] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:37:0)
[06:50:24.374] Build status: STARTED
[06:50:24.374] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:38:0) after 6m29s
[06:56:53.389] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:38:0)
[06:56:53.442] Build status: STARTED
[06:56:53.442] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:39:0) after 7m10s
[07:04:03.466] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:39:0)
[07:04:03.497] Build status: STARTED
[07:04:03.497] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:40:0) after 5m28s
[07:09:31.513] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:40:0)
[07:09:31.559] Build status: STARTED
[07:09:31.559] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:41:0) after 1m17s
[07:10:48.574] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:41:0)
[07:10:48.592] Build status: STARTED
[07:10:48.592] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:42:0) after 4m21s
[07:15:09.635] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:42:0)
[07:15:09.651] Build status: STARTED
[07:15:09.651] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:43:0) after 1m37s
[07:16:46.669] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:43:0)
[07:16:46.688] Build status: STARTED
[07:16:46.688] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:44:0) after 3m3s
[07:19:49.694] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:44:0)
[07:19:49.710] Build status: STARTED
[07:19:49.710] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:45:0) after 8m19s
[07:28:08.826] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:45:0)
[07:28:08.927] Build status: STARTED
[07:28:08.927] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:46:0) after 7m1s
[07:35:09.944] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:46:0)
[07:35:09.959] Build status: STARTED
[07:35:09.959] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:47:0) after 8m13s
[07:43:23.084] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:47:0)
[07:43:23.144] Build status: STARTED
[07:43:23.144] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:48:0) after 4m58s
[07:48:21.209] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:48:0)
[07:48:21.223] Build status: STARTED
[07:48:21.223] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:49:0) after 5m8s
[07:53:29.256] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:49:0)
[07:53:29.274] Build status: STARTED
[07:53:29.274] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:50:0) after 2m34s
[07:56:03.291] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:50:0)
[07:56:03.315] Build status: STARTED
[07:56:03.315] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:51:0) after 4m23s
[08:00:26.380] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:51:0)
[08:00:26.416] Build status: STARTED
[08:00:26.416] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:52:0) after 6m21s
[08:06:47.439] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:52:0)
[08:06:47.468] Build status: STARTED
[08:06:47.468] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:53:0) after 3m24s
[08:10:11.484] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:53:0)
[08:10:11.500] Build status: STARTED
[08:10:11.500] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:54:0) after 1m25s
[08:11:36.518] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:54:0)
[08:11:36.631] Build status: STARTED
[08:11:36.631] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:55:0) after 1m37s
[08:13:13.644] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:55:0)
[08:13:13.689] Build status: STARTED
[08:13:13.689] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:56:0) after 8m47s
[08:22:00.704] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:56:0)
[08:22:00.768] Build status: STARTED
[08:22:00.768] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:57:0) after 7m54s
[08:29:54.843] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:57:0)
[08:29:54.858] Build status: STARTED
[08:29:54.858] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:58:0) after 9m38s
[08:39:32.874] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:58:0)
[08:39:32.955] Build status: STARTED
[08:39:32.955] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:59:0) after 7m35s
[08:47:08.129] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:59:0)
[08:47:08.159] Build status: STARTED
[08:47:08.159] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:60:0) after 5m13s
[08:52:21.281] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:60:0)
[08:52:21.305] Build status: STARTED
[08:52:21.305] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:61:0) after 2m32s
[08:54:53.517] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:61:0)
[08:54:53.571] Build status: STARTED
[08:54:53.571] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:62:0) after 9m19s
[09:04:12.586] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:62:0)
[09:04:12.603] Build status: STARTED
[09:04:12.603] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:63:0) after 3m25s
[09:07:37.622] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:63:0)
[09:07:37.635] Build status: STARTED
[09:07:37.636] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8853449515742868080:64:0) after 9m39s
[09:12:50.679] Received PubSub notification, asking Buildbucket for the build status
[09:12:50.696] Build:
{
"id": "8688019452946796993",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "fuchsia-code-coverage"
},
"number": 3638,
"createdBy": "project:chromium",
"createTime": "2026-03-07T04:00:09.494536312Z",
"startTime": "2026-03-07T05:04:29.941989769Z",
"endTime": "2026-03-07T09:12:50.213732397Z",
"updateTime": "2026-03-07T09:12:50.213732397Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c50a6f317fee3835c6412cddd3b9c8eaa3bafb7e",
"ref": "refs/heads/main"
}
},
"canary": true
}
[09:12:50.696] Invocation finished in 5h12m43.251627064s with status FAILED