[04:00:08.412] New invocation is queued and will start shortly
[04:00:09.481] Starting the invocation (attempt 1)
[04:00:09.527] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/f60d03e7bd738dea957e5bcc3aaeb78e2f6718e8"
[04:00:09.527] Popped gitiles commit info from properties and tags
[04:00:09.527] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[04:00:09.527] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[04:00:09.527] Buildbucket request:
{
"requestId": "8862237420477250016",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "fuchsia-code-coverage"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f60d03e7bd738dea957e5bcc3aaeb78e2f6718e8",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8862237420477250016"
},
{
"key": "scheduler_job_id",
"value": "chromium/fuchsia-code-coverage"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[04:00:10.991] Scheduled build:
{
"id": "8696807358537700529",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "fuchsia-code-coverage"
},
"number": 3541,
"createdBy": "project:chromium",
"createTime": "2025-11-30T04:00:09.637812444Z",
"updateTime": "2025-11-30T04:00:09.637812444Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f60d03e7bd738dea957e5bcc3aaeb78e2f6718e8",
"ref": "refs/heads/main"
}
},
"canary": true
}
[04:00:10.991] Task URL: https://cr-buildbucket.appspot.com/build/8696807358537700529
[04:00:10.991] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:2:0) after 7m30s
[04:00:13.481] Received PubSub notification, asking Buildbucket for the build status
[04:00:13.496] Build status: SCHEDULED
[04:00:33.631] Received PubSub notification, asking Buildbucket for the build status
[04:00:33.647] Build status: STARTED
[04:07:41.005] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:2:0)
[04:07:41.114] Build status: STARTED
[04:07:41.114] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:5:0) after 2m47s
[04:10:28.225] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:5:0)
[04:10:28.262] Build status: STARTED
[04:10:28.262] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:6:0) after 9m34s
[04:20:02.368] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:6:0)
[04:20:02.398] Build status: STARTED
[04:20:02.398] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:7:0) after 9m47s
[04:29:49.448] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:7:0)
[04:29:49.502] Build status: STARTED
[04:29:49.502] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:8:0) after 2m22s
[04:32:11.518] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:8:0)
[04:32:11.537] Build status: STARTED
[04:32:11.537] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:9:0) after 4m21s
[04:36:32.702] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:9:0)
[04:36:32.716] Build status: STARTED
[04:36:32.716] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:10:0) after 8m27s
[04:44:59.729] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:10:0)
[04:44:59.786] Build status: STARTED
[04:44:59.786] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:11:0) after 3m57s
[04:48:56.900] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:11:0)
[04:48:56.917] Build status: STARTED
[04:48:56.917] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:12:0) after 8m34s
[04:57:31.140] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:12:0)
[04:57:31.181] Build status: STARTED
[04:57:31.181] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:13:0) after 2m6s
[04:59:37.273] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:13:0)
[04:59:37.289] Build status: STARTED
[04:59:37.290] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:14:0) after 5m28s
[05:05:05.302] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:14:0)
[05:05:05.316] Build status: STARTED
[05:05:05.316] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:15:0) after 8m4s
[05:13:09.431] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:15:0)
[05:13:09.446] Build status: STARTED
[05:13:09.446] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:16:0) after 1m2s
[05:14:11.555] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:16:0)
[05:14:11.636] Build status: STARTED
[05:14:11.636] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:17:0) after 7m24s
[05:21:35.842] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:17:0)
[05:21:35.856] Build status: STARTED
[05:21:35.856] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:18:0) after 9m34s
[05:31:09.910] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:18:0)
[05:31:09.927] Build status: STARTED
[05:31:09.927] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:19:0) after 5m1s
[05:36:10.950] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:19:0)
[05:36:10.966] Build status: STARTED
[05:36:10.966] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:20:0) after 3m16s
[05:39:26.937] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:20:0)
[05:39:27.015] Build status: STARTED
[05:39:27.015] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:21:0) after 8m12s
[05:47:39.053] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:21:0)
[05:47:39.069] Build status: STARTED
[05:47:39.069] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:22:0) after 8m6s
[05:55:45.307] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:22:0)
[05:55:45.321] Build status: STARTED
[05:55:45.321] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:23:0) after 3m41s
[05:59:26.662] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:23:0)
[05:59:26.679] Build status: STARTED
[05:59:26.679] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:24:0) after 2m27s
[06:01:54.214] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:24:0)
[06:01:54.231] Build status: STARTED
[06:01:54.231] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:25:0) after 2m57s
[06:04:51.250] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:25:0)
[06:04:51.330] Build status: STARTED
[06:04:51.330] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:26:0) after 9m52s
[06:14:43.462] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:26:0)
[06:14:43.478] Build status: STARTED
[06:14:43.478] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:27:0) after 7m21s
[06:22:04.498] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:27:0)
[06:22:04.577] Build status: STARTED
[06:22:04.577] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:28:0) after 8m59s
[06:31:03.792] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:28:0)
[06:31:03.863] Build status: STARTED
[06:31:03.864] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:29:0) after 4m36s
[06:35:39.881] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:29:0)
[06:35:39.896] Build status: STARTED
[06:35:39.896] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:30:0) after 8m45s
[06:44:25.289] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:30:0)
[06:44:25.326] Build status: STARTED
[06:44:25.326] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:31:0) after 4m36s
[06:49:01.392] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:31:0)
[06:49:01.407] Build status: STARTED
[06:49:01.407] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:32:0) after 4m32s
[06:53:33.510] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:32:0)
[06:53:33.535] Build status: STARTED
[06:53:33.535] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:33:0) after 5m28s
[06:59:01.651] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:33:0)
[06:59:01.665] Build status: STARTED
[06:59:01.665] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:34:0) after 3m22s
[07:02:23.842] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:34:0)
[07:02:23.856] Build status: STARTED
[07:02:23.856] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:35:0) after 7m25s
[07:09:49.005] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:35:0)
[07:09:49.146] Build status: STARTED
[07:09:49.147] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:36:0) after 6m0s
[07:15:49.173] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:36:0)
[07:15:49.208] Build status: STARTED
[07:15:49.208] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:37:0) after 7m12s
[07:23:01.316] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:37:0)
[07:23:01.331] Build status: STARTED
[07:23:01.331] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:38:0) after 2m21s
[07:25:22.467] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:38:0)
[07:25:22.484] Build status: STARTED
[07:25:22.484] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:39:0) after 5m36s
[07:30:58.506] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:39:0)
[07:30:58.565] Build status: STARTED
[07:30:58.565] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:40:0) after 4m32s
[07:35:30.585] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:40:0)
[07:35:30.665] Build status: STARTED
[07:35:30.665] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:41:0) after 5m58s
[07:41:28.683] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:41:0)
[07:41:28.696] Build status: STARTED
[07:41:28.696] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:42:0) after 6m47s
[07:48:15.951] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:42:0)
[07:48:15.969] Build status: STARTED
[07:48:15.969] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:43:0) after 8m39s
[07:56:55.077] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:43:0)
[07:56:55.090] Build status: STARTED
[07:56:55.090] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:44:0) after 4m41s
[08:01:36.163] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:44:0)
[08:01:36.179] Build status: STARTED
[08:01:36.179] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:45:0) after 8m41s
[08:10:17.194] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:45:0)
[08:10:17.205] Build status: STARTED
[08:10:17.205] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:46:0) after 5m9s
[08:15:26.598] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:46:0)
[08:15:26.682] Build status: STARTED
[08:15:26.683] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:47:0) after 7m8s
[08:22:34.744] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:47:0)
[08:22:34.762] Build status: STARTED
[08:22:34.762] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:48:0) after 9m56s
[08:32:30.852] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:48:0)
[08:32:30.877] Build status: STARTED
[08:32:30.877] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:49:0) after 9m57s
[08:42:27.903] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:49:0)
[08:42:28.123] Build status: STARTED
[08:42:28.123] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:50:0) after 2m38s
[08:45:06.182] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:50:0)
[08:45:06.208] Build status: STARTED
[08:45:06.208] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:51:0) after 3m44s
[08:48:50.235] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:51:0)
[08:48:50.249] Build status: STARTED
[08:48:50.249] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:52:0) after 1m4s
[08:49:54.331] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:52:0)
[08:49:54.348] Build status: STARTED
[08:49:54.348] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:53:0) after 1m32s
[08:51:26.359] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:53:0)
[08:51:26.375] Build status: STARTED
[08:51:26.375] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:54:0) after 7m11s
[08:58:37.388] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:54:0)
[08:58:37.403] Build status: STARTED
[08:58:37.403] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:55:0) after 1m54s
[09:00:31.402] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:55:0)
[09:00:31.417] Build status: STARTED
[09:00:31.417] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:56:0) after 4m17s
[09:04:48.504] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:56:0)
[09:04:48.520] Build status: STARTED
[09:04:48.520] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:57:0) after 2m57s
[09:07:45.635] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:57:0)
[09:07:45.709] Build status: STARTED
[09:07:45.709] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:58:0) after 1m57s
[09:09:42.860] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:58:0)
[09:09:42.912] Build status: STARTED
[09:09:42.912] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:59:0) after 1m32s
[09:11:14.932] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:59:0)
[09:11:14.948] Build status: STARTED
[09:11:14.948] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8862237420477250016:60:0) after 4m20s
[09:11:48.761] Received PubSub notification, asking Buildbucket for the build status
[09:11:48.774] Build:
{
"id": "8696807358537700529",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "fuchsia-code-coverage"
},
"number": 3541,
"createdBy": "project:chromium",
"createTime": "2025-11-30T04:00:09.637812444Z",
"startTime": "2025-11-30T04:00:24.698603716Z",
"endTime": "2025-11-30T09:11:47.336225321Z",
"updateTime": "2025-11-30T09:11:47.336225321Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f60d03e7bd738dea957e5bcc3aaeb78e2f6718e8",
"ref": "refs/heads/main"
}
},
"canary": true
}
[09:11:48.774] Invocation finished in 5h11m40.370562671s with status FAILED