[04:00:14.010] New invocation is queued and will start shortly
[04:00:15.688] Starting the invocation (attempt 1)
[04:00:15.715] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/f792e638e042a31818195792b08de9c159a9b937"
[04:00:15.715] Popped gitiles commit info from properties and tags
[04:00:15.715] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[04:00:15.715] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[04:00:15.715] Buildbucket request:
{
"requestId": "8879541435191177776",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "fuchsia-code-coverage"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f792e638e042a31818195792b08de9c159a9b937",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8879541435191177776"
},
{
"key": "scheduler_job_id",
"value": "chromium/fuchsia-code-coverage"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[04:00:16.539] Scheduled build:
{
"id": "8714111372660537425",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "fuchsia-code-coverage"
},
"number": 3350,
"createdBy": "project:chromium",
"createTime": "2025-05-23T04:00:15.798340043Z",
"updateTime": "2025-05-23T04:00:15.798340043Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f792e638e042a31818195792b08de9c159a9b937",
"ref": "refs/heads/main"
}
},
"canary": true
}
[04:00:16.539] Task URL: https://cr-buildbucket.appspot.com/build/8714111372660537425
[04:00:16.539] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:2:0) after 2m50s
[04:00:17.553] Received PubSub notification, asking Buildbucket for the build status
[04:00:17.577] Build status: SCHEDULED
[04:00:20.393] Received PubSub notification, asking Buildbucket for the build status
[04:00:20.415] Build status: STARTED
[04:03:06.554] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:2:0)
[04:03:06.764] Build status: STARTED
[04:03:06.764] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:5:0) after 8m31s
[04:11:37.807] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:5:0)
[04:11:37.835] Build status: STARTED
[04:11:37.835] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:6:0) after 2m16s
[04:13:53.861] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:6:0)
[04:13:53.909] Build status: STARTED
[04:13:53.909] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:7:0) after 1m59s
[04:15:52.976] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:7:0)
[04:15:53.213] Build status: STARTED
[04:15:53.213] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:8:0) after 7m28s
[04:23:21.315] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:8:0)
[04:23:21.347] Build status: STARTED
[04:23:21.347] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:9:0) after 5m38s
[04:28:59.379] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:9:0)
[04:28:59.414] Build status: STARTED
[04:28:59.414] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:10:0) after 2m47s
[04:31:46.441] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:10:0)
[04:31:46.467] Build status: STARTED
[04:31:46.467] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:11:0) after 3m50s
[04:35:36.484] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:11:0)
[04:35:36.499] Build status: STARTED
[04:35:36.499] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:12:0) after 9m21s
[04:44:57.534] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:12:0)
[04:44:57.564] Build status: STARTED
[04:44:57.564] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:13:0) after 3m51s
[04:48:48.581] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:13:0)
[04:48:48.622] Build status: STARTED
[04:48:48.622] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:14:0) after 4m50s
[04:53:38.656] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:14:0)
[04:53:38.678] Build status: STARTED
[04:53:38.678] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:15:0) after 2m52s
[04:56:30.787] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:15:0)
[04:56:30.813] Build status: STARTED
[04:56:30.813] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:16:0) after 8m55s
[05:05:25.965] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:16:0)
[05:05:25.994] Build status: STARTED
[05:05:25.994] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:17:0) after 7m38s
[05:13:04.050] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:17:0)
[05:13:04.066] Build status: STARTED
[05:13:04.067] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:18:0) after 4m31s
[05:17:35.083] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:18:0)
[05:17:35.105] Build status: STARTED
[05:17:35.105] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:19:0) after 3m0s
[05:20:35.131] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:19:0)
[05:20:35.152] Build status: STARTED
[05:20:35.152] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:20:0) after 4m49s
[05:25:24.178] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:20:0)
[05:25:24.198] Build status: STARTED
[05:25:24.198] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:21:0) after 6m6s
[05:31:30.223] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:21:0)
[05:31:30.242] Build status: STARTED
[05:31:30.242] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:22:0) after 2m56s
[05:34:26.232] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:22:0)
[05:34:26.251] Build status: STARTED
[05:34:26.251] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:23:0) after 1m39s
[05:36:05.263] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:23:0)
[05:36:05.288] Build status: STARTED
[05:36:05.288] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:24:0) after 7m21s
[05:43:26.414] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:24:0)
[05:43:26.442] Build status: STARTED
[05:43:26.442] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:25:0) after 8m59s
[05:52:25.642] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:25:0)
[05:52:25.660] Build status: STARTED
[05:52:25.661] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:26:0) after 7m55s
[06:00:20.678] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:26:0)
[06:00:20.699] Build status: STARTED
[06:00:20.699] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:27:0) after 6m57s
[06:07:17.728] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:27:0)
[06:07:17.758] Build status: STARTED
[06:07:17.758] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:28:0) after 8m3s
[06:15:20.788] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:28:0)
[06:15:20.806] Build status: STARTED
[06:15:20.806] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:29:0) after 4m14s
[06:19:34.880] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:29:0)
[06:19:34.904] Build status: STARTED
[06:19:34.904] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:30:0) after 3m27s
[06:23:02.016] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:30:0)
[06:23:02.051] Build status: STARTED
[06:23:02.051] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:31:0) after 8m27s
[06:31:29.040] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:31:0)
[06:31:29.057] Build status: STARTED
[06:31:29.057] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:32:0) after 6m55s
[06:38:24.090] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:32:0)
[06:38:24.123] Build status: STARTED
[06:38:24.123] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:33:0) after 8m14s
[06:46:38.151] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:33:0)
[06:46:38.174] Build status: STARTED
[06:46:38.174] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:34:0) after 4m45s
[06:51:23.200] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:34:0)
[06:51:23.217] Build status: STARTED
[06:51:23.217] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:35:0) after 4m58s
[06:56:21.424] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:35:0)
[06:56:21.450] Build status: STARTED
[06:56:21.450] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:36:0) after 8m22s
[07:04:43.486] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:36:0)
[07:04:43.506] Build status: STARTED
[07:04:43.506] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:37:0) after 5m44s
[07:10:27.513] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:37:0)
[07:10:27.590] Build status: STARTED
[07:10:27.590] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:38:0) after 9m58s
[07:20:25.613] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:38:0)
[07:20:25.639] Build status: STARTED
[07:20:25.639] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:39:0) after 8m11s
[07:28:36.737] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:39:0)
[07:28:36.762] Build status: STARTED
[07:28:36.762] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:40:0) after 3m36s
[07:32:12.779] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:40:0)
[07:32:12.803] Build status: STARTED
[07:32:12.803] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:41:0) after 9m14s
[07:41:26.825] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:41:0)
[07:41:26.903] Build status: STARTED
[07:41:26.903] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:42:0) after 6m0s
[07:47:26.903] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:42:0)
[07:47:26.965] Build status: STARTED
[07:47:26.965] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:43:0) after 1m20s
[07:48:47.008] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:43:0)
[07:48:47.028] Build status: STARTED
[07:48:47.028] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:44:0) after 6m34s
[07:55:21.095] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:44:0)
[07:55:21.113] Build status: STARTED
[07:55:21.113] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:45:0) after 3m1s
[07:58:22.148] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:45:0)
[07:58:22.165] Build status: STARTED
[07:58:22.165] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:46:0) after 1m21s
[07:59:43.250] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:46:0)
[07:59:43.277] Build status: STARTED
[07:59:43.277] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:47:0) after 9m18s
[08:09:01.342] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:47:0)
[08:09:01.364] Build status: STARTED
[08:09:01.364] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:48:0) after 3m44s
[08:12:45.423] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:48:0)
[08:12:45.445] Build status: STARTED
[08:12:45.445] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:49:0) after 7m10s
[08:19:55.687] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:49:0)
[08:19:55.711] Build status: STARTED
[08:19:55.711] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:50:0) after 1m5s
[08:21:00.731] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:50:0)
[08:21:00.750] Build status: STARTED
[08:21:00.750] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:51:0) after 7m54s
[08:28:54.847] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:51:0)
[08:28:54.871] Build status: STARTED
[08:28:54.871] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:52:0) after 1m56s
[08:30:50.896] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:52:0)
[08:30:50.915] Build status: STARTED
[08:30:50.915] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:53:0) after 3m12s
[08:34:02.934] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:53:0)
[08:34:02.971] Build status: STARTED
[08:34:02.971] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:54:0) after 7m49s
[08:41:52.035] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:54:0)
[08:41:52.100] Build status: STARTED
[08:41:52.100] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:55:0) after 1m19s
[08:43:11.130] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:55:0)
[08:43:11.377] Build status: STARTED
[08:43:11.377] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:56:0) after 8m3s
[08:51:14.427] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:56:0)
[08:51:14.443] Build status: STARTED
[08:51:14.443] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:57:0) after 3m41s
[08:54:55.467] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:57:0)
[08:54:55.496] Build status: STARTED
[08:54:55.496] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:58:0) after 8m34s
[09:03:29.517] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:58:0)
[09:03:29.534] Build status: STARTED
[09:03:29.534] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:59:0) after 3m15s
[09:06:44.564] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:59:0)
[09:06:44.587] Build status: STARTED
[09:06:44.587] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:60:0) after 2m6s
[09:08:50.688] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:60:0)
[09:08:50.713] Build status: STARTED
[09:08:50.713] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:61:0) after 5m9s
[09:13:59.736] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:61:0)
[09:13:59.754] Build status: STARTED
[09:13:59.754] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:62:0) after 6m15s
[09:20:14.731] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:62:0)
[09:20:14.757] Build status: STARTED
[09:20:14.757] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:63:0) after 7m55s
[09:28:09.783] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:63:0)
[09:28:09.947] Build status: STARTED
[09:28:09.947] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:64:0) after 7m10s
[09:35:20.018] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:64:0)
[09:35:20.034] Build status: STARTED
[09:35:20.034] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:65:0) after 2m55s
[09:38:15.060] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:65:0)
[09:38:15.077] Build status: STARTED
[09:38:15.077] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8879541435191177776:66:0) after 3m20s
[09:40:35.722] Received PubSub notification, asking Buildbucket for the build status
[09:40:35.846] Build:
{
"id": "8714111372660537425",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "fuchsia-code-coverage"
},
"number": 3350,
"createdBy": "project:chromium",
"createTime": "2025-05-23T04:00:15.798340043Z",
"startTime": "2025-05-23T04:00:20.042702067Z",
"endTime": "2025-05-23T09:40:34.308988949Z",
"updateTime": "2025-05-23T09:40:34.308988949Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f792e638e042a31818195792b08de9c159a9b937",
"ref": "refs/heads/main"
}
},
"canary": true
}
[09:40:35.846] Invocation finished in 5h40m21.844942626s with status FAILED