[04:00:06.099] New invocation is queued and will start shortly
[04:00:07.203] Starting the invocation (attempt 1)
[04:00:07.233] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/e2231f4bc5efea646f0c75891645f84cd35a6b47"
[04:00:07.233] Popped gitiles commit info from properties and tags
[04:00:07.233] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[04:00:07.233] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[04:00:07.233] Buildbucket request:
{
"requestId": "8864683541000649456",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "fuchsia-code-coverage"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e2231f4bc5efea646f0c75891645f84cd35a6b47",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8864683541000649456"
},
{
"key": "scheduler_job_id",
"value": "chromium/fuchsia-code-coverage"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[04:00:08.090] Scheduled build:
{
"id": "8699253479092911985",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "fuchsia-code-coverage"
},
"number": 3514,
"createdBy": "project:chromium",
"createTime": "2025-11-03T04:00:07.289983793Z",
"updateTime": "2025-11-03T04:00:07.289983793Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e2231f4bc5efea646f0c75891645f84cd35a6b47",
"ref": "refs/heads/main"
}
}
}
[04:00:08.090] Task URL: https://cr-buildbucket.appspot.com/build/8699253479092911985
[04:00:08.090] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:2:0) after 3m4s
[04:00:08.627] Received PubSub notification, asking Buildbucket for the build status
[04:00:08.644] Build status: SCHEDULED
[04:00:14.680] Received PubSub notification, asking Buildbucket for the build status
[04:00:14.696] Build status: STARTED
[04:03:12.107] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:2:0)
[04:03:12.125] Build status: STARTED
[04:03:12.125] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:5:0) after 9m55s
[04:13:07.634] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:5:0)
[04:13:07.651] Build status: STARTED
[04:13:07.651] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:6:0) after 8m43s
[04:21:50.666] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:6:0)
[04:21:50.737] Build status: STARTED
[04:21:50.737] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:7:0) after 4m51s
[04:26:41.932] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:7:0)
[04:26:41.946] Build status: STARTED
[04:26:41.946] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:8:0) after 7m1s
[04:33:42.961] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:8:0)
[04:33:42.976] Build status: STARTED
[04:33:42.976] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:9:0) after 8m10s
[04:41:52.991] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:9:0)
[04:41:53.006] Build status: STARTED
[04:41:53.006] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:10:0) after 9m46s
[04:51:38.974] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:10:0)
[04:51:38.987] Build status: STARTED
[04:51:38.987] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:11:0) after 3m59s
[04:55:38.004] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:11:0)
[04:55:38.041] Build status: STARTED
[04:55:38.041] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:12:0) after 8m5s
[05:03:43.283] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:12:0)
[05:03:43.303] Build status: STARTED
[05:03:43.303] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:13:0) after 6m57s
[05:10:40.320] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:13:0)
[05:10:40.337] Build status: STARTED
[05:10:40.337] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:14:0) after 2m40s
[05:13:20.323] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:14:0)
[05:13:20.342] Build status: STARTED
[05:13:20.342] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:15:0) after 8m3s
[05:21:23.414] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:15:0)
[05:21:23.431] Build status: STARTED
[05:21:23.431] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:16:0) after 2m19s
[05:23:42.733] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:16:0)
[05:23:42.754] Build status: STARTED
[05:23:42.754] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:17:0) after 8m47s
[05:32:29.772] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:17:0)
[05:32:29.805] Build status: STARTED
[05:32:29.805] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:18:0) after 6m27s
[05:38:56.879] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:18:0)
[05:38:56.893] Build status: STARTED
[05:38:56.893] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:19:0) after 7m23s
[05:46:19.927] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:19:0)
[05:46:19.957] Build status: STARTED
[05:46:19.957] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:20:0) after 6m49s
[05:53:09.046] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:20:0)
[05:53:09.061] Build status: STARTED
[05:53:09.061] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:21:0) after 2m14s
[05:55:23.077] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:21:0)
[05:55:23.094] Build status: STARTED
[05:55:23.094] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:22:0) after 3m13s
[05:58:36.090] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:22:0)
[05:58:36.104] Build status: STARTED
[05:58:36.104] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:23:0) after 5m20s
[06:03:56.179] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:23:0)
[06:03:56.205] Build status: STARTED
[06:03:56.205] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:24:0) after 2m33s
[06:06:29.326] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:24:0)
[06:06:29.342] Build status: STARTED
[06:06:29.342] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:25:0) after 8m11s
[06:14:40.359] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:25:0)
[06:14:40.447] Build status: STARTED
[06:14:40.447] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:26:0) after 7m59s
[06:22:39.466] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:26:0)
[06:22:39.490] Build status: STARTED
[06:22:39.490] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:27:0) after 4m26s
[06:27:05.536] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:27:0)
[06:27:05.618] Build status: STARTED
[06:27:05.618] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:28:0) after 3m12s
[06:30:17.631] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:28:0)
[06:30:17.650] Build status: STARTED
[06:30:17.650] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:29:0) after 5m51s
[06:36:08.985] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:29:0)
[06:36:09.076] Build status: STARTED
[06:36:09.076] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:30:0) after 8m51s
[06:45:00.091] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:30:0)
[06:45:00.201] Build status: STARTED
[06:45:00.201] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:31:0) after 4m27s
[06:49:27.215] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:31:0)
[06:49:27.229] Build status: STARTED
[06:49:27.229] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:32:0) after 3m52s
[06:53:19.317] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:32:0)
[06:53:19.332] Build status: STARTED
[06:53:19.332] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:33:0) after 8m52s
[07:02:11.446] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:33:0)
[07:02:11.460] Build status: STARTED
[07:02:11.460] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:34:0) after 2m15s
[07:04:26.583] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:34:0)
[07:04:26.618] Build status: STARTED
[07:04:26.618] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:35:0) after 9m17s
[07:13:43.629] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:35:0)
[07:13:43.656] Build status: STARTED
[07:13:43.656] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:36:0) after 7m55s
[07:21:38.671] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:36:0)
[07:21:38.691] Build status: STARTED
[07:21:38.691] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:37:0) after 2m41s
[07:24:19.728] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:37:0)
[07:24:19.742] Build status: STARTED
[07:24:19.742] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:38:0) after 5m51s
[07:30:10.729] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:38:0)
[07:30:10.751] Build status: STARTED
[07:30:10.825] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:39:0) after 1m43s
[07:31:54.442] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:39:0)
[07:31:54.458] Build status: STARTED
[07:31:54.459] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:40:0) after 7m28s
[07:39:22.637] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:40:0)
[07:39:22.660] Build status: STARTED
[07:39:22.660] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:41:0) after 8m48s
[07:48:10.684] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:41:0)
[07:48:10.699] Build status: STARTED
[07:48:10.699] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:42:0) after 6m59s
[07:55:09.918] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:42:0)
[07:55:09.935] Build status: STARTED
[07:55:09.935] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:43:0) after 2m1s
[07:57:10.947] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:43:0)
[07:57:10.963] Build status: STARTED
[07:57:10.963] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:44:0) after 2m43s
[07:59:53.979] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:44:0)
[07:59:54.003] Build status: STARTED
[07:59:54.004] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:45:0) after 5m4s
[08:04:58.019] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:45:0)
[08:04:58.038] Build status: STARTED
[08:04:58.038] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:46:0) after 9m45s
[08:14:43.237] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:46:0)
[08:14:43.254] Build status: STARTED
[08:14:43.255] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:47:0) after 7m15s
[08:21:58.485] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:47:0)
[08:21:58.505] Build status: STARTED
[08:21:58.505] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:48:0) after 2m48s
[08:24:46.534] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:48:0)
[08:24:46.549] Build status: STARTED
[08:24:46.549] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:49:0) after 6m59s
[08:31:45.565] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:49:0)
[08:31:45.584] Build status: STARTED
[08:31:45.584] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:50:0) after 6m23s
[08:38:08.723] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:50:0)
[08:38:08.741] Build status: STARTED
[08:38:08.741] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:51:0) after 3m6s
[08:41:14.855] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:51:0)
[08:41:14.908] Build status: STARTED
[08:41:14.908] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:52:0) after 7m8s
[08:48:22.942] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:52:0)
[08:48:22.959] Build status: STARTED
[08:48:22.959] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:53:0) after 1m9s
[08:49:31.979] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:53:0)
[08:49:31.994] Build status: STARTED
[08:49:31.994] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:54:0) after 2m48s
[08:52:20.149] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:54:0)
[08:52:20.200] Build status: STARTED
[08:52:20.200] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:55:0) after 7m7s
[08:59:27.577] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:55:0)
[08:59:27.592] Build status: STARTED
[08:59:27.592] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8864683541000649456:56:0) after 9m58s
[09:02:54.734] Received PubSub notification, asking Buildbucket for the build status
[09:02:54.759] Build:
{
"id": "8699253479092911985",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "fuchsia-code-coverage"
},
"number": 3514,
"createdBy": "project:chromium",
"createTime": "2025-11-03T04:00:07.289983793Z",
"startTime": "2025-11-03T04:00:11.710852525Z",
"endTime": "2025-11-03T09:02:33.889112218Z",
"updateTime": "2025-11-03T09:02:33.889112218Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e2231f4bc5efea646f0c75891645f84cd35a6b47",
"ref": "refs/heads/main"
}
}
}
[09:02:54.759] Invocation finished in 5h2m48.672911623s with status FAILED