[04:00:14.862] New invocation is queued and will start shortly
[04:00:16.129] Starting the invocation (attempt 1)
[04:00:16.163] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/56fb862b99d2a11e36deed0ae240394f240a26fb"
[04:00:16.163] Popped gitiles commit info from properties and tags
[04:00:16.163] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[04:00:16.163] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[04:00:16.163] Buildbucket request:
{
"requestId": "8867401440801134736",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "fuchsia-code-coverage"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "56fb862b99d2a11e36deed0ae240394f240a26fb",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8867401440801134736"
},
{
"key": "scheduler_job_id",
"value": "chromium/fuchsia-code-coverage"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[04:00:16.838] Scheduled build:
{
"id": "8701971378713810001",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "fuchsia-code-coverage"
},
"number": 3484,
"createdBy": "project:chromium",
"createTime": "2025-10-04T04:00:16.226528121Z",
"updateTime": "2025-10-04T04:00:16.226528121Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "56fb862b99d2a11e36deed0ae240394f240a26fb",
"ref": "refs/heads/main"
}
}
}
[04:00:16.838] Task URL: https://cr-buildbucket.appspot.com/build/8701971378713810001
[04:00:16.839] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:2:0) after 7m9s
[04:00:18.470] Received PubSub notification, asking Buildbucket for the build status
[04:00:18.553] Build status: SCHEDULED
[04:00:22.357] Received PubSub notification, asking Buildbucket for the build status
[04:00:22.377] Build status: STARTED
[04:07:25.819] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:2:0)
[04:07:25.873] Build status: STARTED
[04:07:25.873] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:5:0) after 1m21s
[04:08:46.892] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:5:0)
[04:08:46.908] Build status: STARTED
[04:08:46.908] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:6:0) after 1m55s
[04:10:41.921] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:6:0)
[04:10:41.951] Build status: STARTED
[04:10:41.951] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:7:0) after 2m3s
[04:12:44.929] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:7:0)
[04:12:44.950] Build status: STARTED
[04:12:44.950] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:8:0) after 8m35s
[04:21:19.973] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:8:0)
[04:21:20.033] Build status: STARTED
[04:21:20.033] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:9:0) after 9m5s
[04:30:25.121] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:9:0)
[04:30:25.156] Build status: STARTED
[04:30:25.156] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:10:0) after 6m12s
[04:36:37.173] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:10:0)
[04:36:37.200] Build status: STARTED
[04:36:37.200] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:11:0) after 2m4s
[04:38:41.268] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:11:0)
[04:38:41.285] Build status: STARTED
[04:38:41.285] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:12:0) after 2m48s
[04:41:29.300] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:12:0)
[04:41:29.320] Build status: STARTED
[04:41:29.320] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:13:0) after 4m43s
[04:46:12.421] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:13:0)
[04:46:12.478] Build status: STARTED
[04:46:12.478] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:14:0) after 6m58s
[04:53:10.555] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:14:0)
[04:53:10.617] Build status: STARTED
[04:53:10.617] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:15:0) after 9m0s
[05:02:10.784] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:15:0)
[05:02:10.817] Build status: STARTED
[05:02:10.817] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:16:0) after 8m36s
[05:10:46.835] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:16:0)
[05:10:46.870] Build status: STARTED
[05:10:46.870] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:17:0) after 9m19s
[05:20:06.409] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:17:0)
[05:20:06.429] Build status: STARTED
[05:20:06.429] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:18:0) after 8m57s
[05:29:03.832] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:18:0)
[05:29:03.849] Build status: STARTED
[05:29:03.849] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:19:0) after 1m37s
[05:30:40.913] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:19:0)
[05:30:40.946] Build status: STARTED
[05:30:40.946] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:20:0) after 9m17s
[05:39:58.031] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:20:0)
[05:39:58.065] Build status: STARTED
[05:39:58.065] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:21:0) after 4m42s
[05:44:40.083] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:21:0)
[05:44:40.118] Build status: STARTED
[05:44:40.118] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:22:0) after 1m33s
[05:46:13.288] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:22:0)
[05:46:13.307] Build status: STARTED
[05:46:13.307] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:23:0) after 7m58s
[05:54:11.669] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:23:0)
[05:54:11.774] Build status: STARTED
[05:54:11.774] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:24:0) after 3m41s
[05:57:52.791] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:24:0)
[05:57:52.806] Build status: STARTED
[05:57:52.806] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:25:0) after 6m23s
[06:04:15.829] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:25:0)
[06:04:15.846] Build status: STARTED
[06:04:15.846] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:26:0) after 1m43s
[06:05:59.317] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:26:0)
[06:05:59.345] Build status: STARTED
[06:05:59.346] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:27:0) after 9m14s
[06:15:13.766] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:27:0)
[06:15:13.809] Build status: STARTED
[06:15:13.809] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:28:0) after 3m30s
[06:18:43.966] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:28:0)
[06:18:43.981] Build status: STARTED
[06:18:43.981] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:29:0) after 4m34s
[06:23:17.964] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:29:0)
[06:23:17.982] Build status: STARTED
[06:23:17.982] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:30:0) after 5m37s
[06:28:55.251] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:30:0)
[06:28:55.269] Build status: STARTED
[06:28:55.269] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:31:0) after 4m50s
[06:33:45.356] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:31:0)
[06:33:45.389] Build status: STARTED
[06:33:45.389] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:32:0) after 2m40s
[06:36:25.404] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:32:0)
[06:36:25.481] Build status: STARTED
[06:36:25.481] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:33:0) after 1m4s
[06:37:29.611] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:33:0)
[06:37:29.626] Build status: STARTED
[06:37:29.626] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:34:0) after 2m33s
[06:40:02.642] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:34:0)
[06:40:02.740] Build status: STARTED
[06:40:02.740] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:35:0) after 5m23s
[06:45:25.828] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:35:0)
[06:45:25.844] Build status: STARTED
[06:45:25.844] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:36:0) after 3m31s
[06:48:57.188] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:36:0)
[06:48:57.294] Build status: STARTED
[06:48:57.294] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:37:0) after 7m59s
[06:56:56.469] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:37:0)
[06:56:56.489] Build status: STARTED
[06:56:56.489] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:38:0) after 3m49s
[07:00:45.628] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:38:0)
[07:00:45.646] Build status: STARTED
[07:00:45.646] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:39:0) after 5m28s
[07:06:13.662] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:39:0)
[07:06:13.687] Build status: STARTED
[07:06:13.687] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:40:0) after 9m56s
[07:16:09.712] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:40:0)
[07:16:09.724] Build status: STARTED
[07:16:09.724] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:41:0) after 7m32s
[07:23:41.746] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:41:0)
[07:23:42.010] Build status: STARTED
[07:23:42.010] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:42:0) after 4m49s
[07:28:31.174] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:42:0)
[07:28:31.187] Build status: STARTED
[07:28:31.187] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:43:0) after 3m34s
[07:32:05.254] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:43:0)
[07:32:05.268] Build status: STARTED
[07:32:05.268] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:44:0) after 8m42s
[07:40:47.346] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:44:0)
[07:40:47.360] Build status: STARTED
[07:40:47.360] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:45:0) after 2m26s
[07:43:13.492] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:45:0)
[07:43:13.509] Build status: STARTED
[07:43:13.509] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:46:0) after 1m18s
[07:44:31.525] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:46:0)
[07:44:31.547] Build status: STARTED
[07:44:31.547] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:47:0) after 1m43s
[07:46:15.035] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:47:0)
[07:46:15.118] Build status: STARTED
[07:46:15.118] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:48:0) after 4m21s
[07:50:36.140] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:48:0)
[07:50:36.160] Build status: STARTED
[07:50:36.160] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:49:0) after 3m29s
[07:54:05.247] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:49:0)
[07:54:05.266] Build status: STARTED
[07:54:05.266] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:50:0) after 3m0s
[07:57:05.436] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:50:0)
[07:57:05.455] Build status: STARTED
[07:57:05.455] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:51:0) after 3m55s
[08:01:00.509] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:51:0)
[08:01:00.592] Build status: STARTED
[08:01:00.592] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:52:0) after 7m1s
[08:08:01.631] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:52:0)
[08:08:01.647] Build status: STARTED
[08:08:01.647] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:53:0) after 5m31s
[08:13:32.873] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:53:0)
[08:13:32.891] Build status: STARTED
[08:13:32.891] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:54:0) after 1m3s
[08:14:35.959] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:54:0)
[08:14:36.006] Build status: STARTED
[08:14:36.006] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:55:0) after 6m46s
[08:21:22.028] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:55:0)
[08:21:22.089] Build status: STARTED
[08:21:22.089] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:56:0) after 9m47s
[08:31:09.213] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:56:0)
[08:31:09.229] Build status: STARTED
[08:31:09.229] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:57:0) after 8m14s
[08:39:23.250] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:57:0)
[08:39:23.318] Build status: STARTED
[08:39:23.318] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:58:0) after 5m36s
[08:44:59.483] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:58:0)
[08:44:59.499] Build status: STARTED
[08:44:59.499] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:59:0) after 2m50s
[08:47:49.606] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:59:0)
[08:47:49.622] Build status: STARTED
[08:47:49.622] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:60:0) after 2m9s
[08:49:58.744] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:60:0)
[08:49:58.760] Build status: STARTED
[08:49:58.760] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:61:0) after 1m46s
[08:51:44.800] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:61:0)
[08:51:44.813] Build status: STARTED
[08:51:44.813] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:62:0) after 4m32s
[08:56:17.005] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:62:0)
[08:56:17.020] Build status: STARTED
[08:56:17.020] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:63:0) after 6m29s
[09:02:46.204] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:63:0)
[09:02:46.221] Build status: STARTED
[09:02:46.222] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:64:0) after 2m9s
[09:04:55.238] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:64:0)
[09:04:55.256] Build status: STARTED
[09:04:55.256] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:65:0) after 6m29s
[09:11:24.233] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:65:0)
[09:11:24.249] Build status: STARTED
[09:11:24.249] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-code-coverage:8867401440801134736:66:0) after 6m34s
[09:13:32.013] Received PubSub notification, asking Buildbucket for the build status
[09:13:32.067] Build:
{
"id": "8701971378713810001",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "fuchsia-code-coverage"
},
"number": 3484,
"createdBy": "project:chromium",
"createTime": "2025-10-04T04:00:16.226528121Z",
"startTime": "2025-10-04T04:00:20.883462664Z",
"endTime": "2025-10-04T09:13:31.486034890Z",
"updateTime": "2025-10-04T09:13:31.486034890Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "56fb862b99d2a11e36deed0ae240394f240a26fb",
"ref": "refs/heads/main"
}
}
}
[09:13:32.067] Invocation finished in 5h13m17.215348436s with status FAILED