[04:00:07.030] New invocation is queued and will start shortly
[04:00:08.598] Starting the invocation (attempt 1)
[04:00:08.628] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/91bc65f60a8f083c2370a64f4c0398c6fa39253c"
[04:00:08.628] Popped gitiles commit info from properties and tags
[04:00:08.628] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[04:00:08.628] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[04:00:08.628] Buildbucket request:
{
"requestId": "8865861300585398384",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "fuchsia-code-coverage"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "91bc65f60a8f083c2370a64f4c0398c6fa39253c",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8865861300585398384"
},
{
"key": "scheduler_job_id",
"value": "chromium/fuchsia-code-coverage"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[04:00:09.383] Scheduled build:
{
"id": "8700431238192470897",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "fuchsia-code-coverage"
},
"number": 3501,
"createdBy": "project:chromium",
"createTime": "2025-10-21T04:00:08.685048746Z",
"updateTime": "2025-10-21T04:00:08.685048746Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "91bc65f60a8f083c2370a64f4c0398c6fa39253c",
"ref": "refs/heads/main"
}
}
}
[04:00:09.383] Task URL: https://cr-buildbucket.appspot.com/build/8700431238192470897
[04:00:09.384] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:2:0) after 4m12s
[04:00:11.672] Received PubSub notification, asking Buildbucket for the build status
[04:00:11.688] Build status: SCHEDULED
[04:00:19.536] Received PubSub notification, asking Buildbucket for the build status
[04:00:19.552] Build status: STARTED
[04:04:21.397] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:2:0)
[04:04:21.418] Build status: STARTED
[04:04:21.418] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:5:0) after 5m44s
[04:10:05.455] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:5:0)
[04:10:05.475] Build status: STARTED
[04:10:05.475] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:6:0) after 1m40s
[04:11:45.491] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:6:0)
[04:11:45.508] Build status: STARTED
[04:11:45.509] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:7:0) after 2m22s
[04:14:07.534] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:7:0)
[04:14:07.557] Build status: STARTED
[04:14:07.557] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:8:0) after 3m15s
[04:17:22.572] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:8:0)
[04:17:22.589] Build status: STARTED
[04:17:22.590] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:9:0) after 2m14s
[04:19:36.606] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:9:0)
[04:19:36.634] Build status: STARTED
[04:19:36.634] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:10:0) after 1m24s
[04:21:00.650] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:10:0)
[04:21:00.664] Build status: STARTED
[04:21:00.664] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:11:0) after 8m20s
[04:29:20.816] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:11:0)
[04:29:20.836] Build status: STARTED
[04:29:20.836] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:12:0) after 9m16s
[04:38:36.860] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:12:0)
[04:38:36.920] Build status: STARTED
[04:38:36.920] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:13:0) after 9m37s
[04:48:13.934] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:13:0)
[04:48:13.951] Build status: STARTED
[04:48:13.951] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:14:0) after 5m26s
[04:53:39.970] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:14:0)
[04:53:39.990] Build status: STARTED
[04:53:39.990] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:15:0) after 1m35s
[04:55:15.006] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:15:0)
[04:55:15.026] Build status: STARTED
[04:55:15.026] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:16:0) after 5m14s
[05:00:29.091] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:16:0)
[05:00:29.119] Build status: STARTED
[05:00:29.119] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:17:0) after 3m4s
[05:03:33.134] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:17:0)
[05:03:33.208] Build status: STARTED
[05:03:33.208] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:18:0) after 1m20s
[05:04:53.200] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:18:0)
[05:04:53.221] Build status: STARTED
[05:04:53.221] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:19:0) after 3m52s
[05:08:45.191] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:19:0)
[05:08:45.235] Build status: STARTED
[05:08:45.235] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:20:0) after 5m23s
[05:14:08.250] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:20:0)
[05:14:08.323] Build status: STARTED
[05:14:08.323] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:21:0) after 2m47s
[05:16:55.342] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:21:0)
[05:16:55.355] Build status: STARTED
[05:16:55.355] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:22:0) after 8m44s
[05:25:39.372] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:22:0)
[05:25:39.388] Build status: STARTED
[05:25:39.388] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:23:0) after 4m23s
[05:30:02.404] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:23:0)
[05:30:02.438] Build status: STARTED
[05:30:02.438] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:24:0) after 9m41s
[05:39:43.588] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:24:0)
[05:39:43.604] Build status: STARTED
[05:39:43.604] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:25:0) after 9m47s
[05:49:30.623] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:25:0)
[05:49:30.639] Build status: STARTED
[05:49:30.639] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:26:0) after 3m35s
[05:53:05.657] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:26:0)
[05:53:05.673] Build status: STARTED
[05:53:05.673] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:27:0) after 7m41s
[06:00:46.700] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:27:0)
[06:00:46.714] Build status: STARTED
[06:00:46.714] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:28:0) after 4m59s
[06:05:45.746] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:28:0)
[06:05:45.922] Build status: STARTED
[06:05:45.922] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:29:0) after 3m39s
[06:09:24.946] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:29:0)
[06:09:24.970] Build status: STARTED
[06:09:24.970] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:30:0) after 5m57s
[06:15:21.985] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:30:0)
[06:15:22.002] Build status: STARTED
[06:15:22.002] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:31:0) after 5m41s
[06:21:03.048] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:31:0)
[06:21:03.098] Build status: STARTED
[06:21:03.098] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:32:0) after 5m37s
[06:26:40.111] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:32:0)
[06:26:40.195] Build status: STARTED
[06:26:40.195] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:33:0) after 8m51s
[06:35:31.165] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:33:0)
[06:35:31.188] Build status: STARTED
[06:35:31.188] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:34:0) after 3m40s
[06:39:11.161] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:34:0)
[06:39:11.180] Build status: STARTED
[06:39:11.180] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:35:0) after 3m6s
[06:42:17.205] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:35:0)
[06:42:17.230] Build status: STARTED
[06:42:17.231] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:36:0) after 7m8s
[06:49:25.590] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:36:0)
[06:49:25.606] Build status: STARTED
[06:49:25.606] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:37:0) after 4m20s
[06:53:45.617] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:37:0)
[06:53:45.644] Build status: STARTED
[06:53:45.644] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:38:0) after 6m46s
[07:00:31.640] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:38:0)
[07:00:31.701] Build status: STARTED
[07:00:31.702] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:39:0) after 2m5s
[07:02:36.806] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:39:0)
[07:02:36.823] Build status: STARTED
[07:02:36.823] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:40:0) after 8m45s
[07:11:21.856] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:40:0)
[07:11:22.006] Build status: STARTED
[07:11:22.006] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:41:0) after 8m24s
[07:19:46.019] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:41:0)
[07:19:46.036] Build status: STARTED
[07:19:46.036] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:42:0) after 5m15s
[07:25:01.053] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:42:0)
[07:25:01.134] Build status: STARTED
[07:25:01.134] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:43:0) after 5m27s
[07:30:28.834] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:43:0)
[07:30:28.860] Build status: STARTED
[07:30:28.860] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:44:0) after 1m49s
[07:32:18.242] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:44:0)
[07:32:18.309] Build status: STARTED
[07:32:18.309] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:45:0) after 8m22s
[07:40:40.620] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:45:0)
[07:40:40.681] Build status: STARTED
[07:40:40.681] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:46:0) after 7m27s
[07:48:07.699] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:46:0)
[07:48:07.715] Build status: STARTED
[07:48:07.715] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:47:0) after 4m19s
[07:52:27.381] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:47:0)
[07:52:27.396] Build status: STARTED
[07:52:27.396] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:48:0) after 8m12s
[08:00:39.942] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:48:0)
[08:00:39.956] Build status: STARTED
[08:00:39.956] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:49:0) after 6m49s
[08:07:29.171] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:49:0)
[08:07:29.300] Build status: STARTED
[08:07:29.300] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:50:0) after 6m50s
[08:14:19.268] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:50:0)
[08:14:19.287] Build status: STARTED
[08:14:19.287] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:51:0) after 6m17s
[08:20:36.306] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:51:0)
[08:20:36.321] Build status: STARTED
[08:20:36.321] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:52:0) after 1m27s
[08:22:03.339] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:52:0)
[08:22:03.358] Build status: STARTED
[08:22:03.358] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:53:0) after 9m24s
[08:31:27.558] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:53:0)
[08:31:27.575] Build status: STARTED
[08:31:27.575] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:54:0) after 5m48s
[08:37:15.594] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:54:0)
[08:37:15.646] Build status: STARTED
[08:37:15.646] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:55:0) after 5m11s
[08:42:26.693] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:55:0)
[08:42:26.734] Build status: STARTED
[08:42:26.734] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:56:0) after 7m35s
[08:50:01.750] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:56:0)
[08:50:01.843] Build status: STARTED
[08:50:01.843] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:57:0) after 3m8s
[08:53:09.857] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:57:0)
[08:53:09.877] Build status: STARTED
[08:53:09.877] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:58:0) after 2m47s
[08:55:56.902] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:58:0)
[08:55:56.922] Build status: STARTED
[08:55:56.922] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:59:0) after 5m6s
[09:01:02.917] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:59:0)
[09:01:02.937] Build status: STARTED
[09:01:02.937] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:60:0) after 3m49s
[09:04:51.966] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:60:0)
[09:04:51.980] Build status: STARTED
[09:04:51.980] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:61:0) after 5m57s
[09:10:49.036] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:61:0)
[09:10:49.088] Build status: STARTED
[09:10:49.089] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:62:0) after 5m46s
[09:16:35.057] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:62:0)
[09:16:35.090] Build status: STARTED
[09:16:35.090] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8865861300585398384:63:0) after 7m47s
[09:18:56.270] Received PubSub notification, asking Buildbucket for the build status
[09:18:56.288] Build:
{
"id": "8700431238192470897",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "fuchsia-code-coverage"
},
"number": 3501,
"createdBy": "project:chromium",
"createTime": "2025-10-21T04:00:08.685048746Z",
"startTime": "2025-10-21T04:00:16.519054851Z",
"endTime": "2025-10-21T09:18:55.956385729Z",
"updateTime": "2025-10-21T09:18:55.956385729Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "91bc65f60a8f083c2370a64f4c0398c6fa39253c",
"ref": "refs/heads/main"
}
}
}
[09:18:56.288] Invocation finished in 5h18m49.269560725s with status FAILED