[09:53:09.779] New invocation is queued and will start shortly
[09:53:10.913] Starting the invocation (attempt 1)
[09:53:10.942] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/6419da479659a7268f4c219782bb0e3367890e1f"
[09:53:10.942] Popped gitiles commit info from properties and tags
[09:53:10.942] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[09:53:10.942] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[09:53:10.942] Buildbucket request:
{
"requestId": "8867741625160994256",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTFuchsia x64"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "6419da479659a7268f4c219782bb0e3367890e1f",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8867741625160994256"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTFuchsia x64"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[09:53:11.440] Scheduled build:
{
"id": "8702311563226720305",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTFuchsia x64"
},
"number": 26647,
"createdBy": "project:chromium",
"createTime": "2025-09-30T09:53:10.993277284Z",
"updateTime": "2025-09-30T09:53:10.993277284Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "6419da479659a7268f4c219782bb0e3367890e1f",
"ref": "refs/heads/main"
}
}
}
[09:53:11.440] Task URL: https://cr-buildbucket.appspot.com/build/8702311563226720305
[09:53:11.440] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:2:0) after 2m40s
[09:53:12.445] Received PubSub notification, asking Buildbucket for the build status
[09:53:12.462] Build status: SCHEDULED
[09:54:12.443] Received PubSub notification, asking Buildbucket for the build status
[09:54:12.474] Build status: STARTED
[09:55:51.460] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:2:0)
[09:55:51.482] Build status: STARTED
[09:55:51.482] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:5:0) after 9m59s
[10:05:50.506] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:5:0)
[10:05:50.523] Build status: STARTED
[10:05:50.523] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:6:0) after 6m45s
[10:12:35.779] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:6:0)
[10:12:35.798] Build status: STARTED
[10:12:35.798] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:7:0) after 4m30s
[10:17:05.843] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:7:0)
[10:17:05.880] Build status: STARTED
[10:17:05.880] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:8:0) after 3m23s
[10:20:28.973] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:8:0)
[10:20:28.994] Build status: STARTED
[10:20:28.994] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:9:0) after 9m46s
[10:30:15.118] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:9:0)
[10:30:15.143] Build status: STARTED
[10:30:15.143] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:10:0) after 8m53s
[10:39:08.159] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:10:0)
[10:39:08.222] Build status: STARTED
[10:39:08.222] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:11:0) after 4m28s
[10:43:36.240] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:11:0)
[10:43:36.255] Build status: STARTED
[10:43:36.255] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:12:0) after 1m54s
[10:45:30.324] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:12:0)
[10:45:30.352] Build status: STARTED
[10:45:30.352] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:13:0) after 3m11s
[10:48:41.342] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:13:0)
[10:48:41.355] Build status: STARTED
[10:48:41.355] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:14:0) after 1m33s
[10:50:14.373] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:14:0)
[10:50:14.393] Build status: STARTED
[10:50:14.393] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:15:0) after 6m8s
[10:56:22.410] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:15:0)
[10:56:22.427] Build status: STARTED
[10:56:22.427] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:16:0) after 2m22s
[10:58:44.444] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:16:0)
[10:58:44.584] Build status: STARTED
[10:58:44.584] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:17:0) after 6m44s
[11:05:28.755] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:17:0)
[11:05:28.775] Build status: STARTED
[11:05:28.775] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:18:0) after 3m22s
[11:08:51.091] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:18:0)
[11:08:51.111] Build status: STARTED
[11:08:51.111] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:19:0) after 9m2s
[11:17:53.289] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:19:0)
[11:17:53.320] Build status: STARTED
[11:17:53.320] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:20:0) after 3m38s
[11:21:31.481] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:20:0)
[11:21:31.504] Build status: STARTED
[11:21:31.504] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:21:0) after 1m35s
[11:23:06.651] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:21:0)
[11:23:06.666] Build status: STARTED
[11:23:06.666] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:22:0) after 2m35s
[11:25:42.035] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:22:0)
[11:25:42.054] Build status: STARTED
[11:25:42.054] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:23:0) after 9m16s
[11:34:58.110] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:23:0)
[11:34:58.128] Build status: STARTED
[11:34:58.128] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:24:0) after 6m26s
[11:41:24.485] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:24:0)
[11:41:24.501] Build status: STARTED
[11:41:24.503] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:25:0) after 3m31s
[11:44:55.557] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:25:0)
[11:44:55.580] Build status: STARTED
[11:44:55.580] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:26:0) after 7m23s
[11:52:18.600] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:26:0)
[11:52:18.617] Build status: STARTED
[11:52:18.617] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:27:0) after 7m45s
[12:00:03.746] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:27:0)
[12:00:03.760] Build status: STARTED
[12:00:03.760] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:28:0) after 5m2s
[12:05:05.784] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:28:0)
[12:05:05.798] Build status: STARTED
[12:05:05.798] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:29:0) after 5m15s
[12:10:20.821] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:29:0)
[12:10:20.865] Build status: STARTED
[12:10:20.865] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:30:0) after 7m18s
[12:17:39.172] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:30:0)
[12:17:39.196] Build status: STARTED
[12:17:39.196] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:31:0) after 9m47s
[12:27:26.337] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:31:0)
[12:27:26.358] Build status: STARTED
[12:27:26.358] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:32:0) after 7m2s
[12:34:28.378] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:32:0)
[12:34:28.396] Build status: STARTED
[12:34:28.396] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:33:0) after 3m30s
[12:37:58.468] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:33:0)
[12:37:58.520] Build status: STARTED
[12:37:58.520] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:34:0) after 4m48s
[12:42:46.537] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:34:0)
[12:42:46.552] Build status: STARTED
[12:42:46.552] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:35:0) after 6m44s
[12:49:30.642] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:35:0)
[12:49:30.660] Build status: STARTED
[12:49:30.660] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:36:0) after 4m49s
[12:54:19.691] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:36:0)
[12:54:19.722] Build status: STARTED
[12:54:19.722] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:37:0) after 9m3s
[13:03:22.788] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:37:0)
[13:03:22.825] Build status: STARTED
[13:03:22.825] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:38:0) after 5m56s
[13:09:18.844] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:38:0)
[13:09:18.858] Build status: STARTED
[13:09:18.858] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:39:0) after 8m14s
[13:17:32.879] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:39:0)
[13:17:32.900] Build status: STARTED
[13:17:32.900] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:40:0) after 8m40s
[13:26:12.975] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:40:0)
[13:26:13.268] Build status: STARTED
[13:26:13.268] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:41:0) after 1m43s
[13:27:56.285] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:41:0)
[13:27:56.299] Build status: STARTED
[13:27:56.299] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:42:0) after 2m20s
[13:30:16.319] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:42:0)
[13:30:16.363] Build status: STARTED
[13:30:16.363] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:43:0) after 9m52s
[13:40:08.502] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:43:0)
[13:40:08.523] Build status: STARTED
[13:40:08.523] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:44:0) after 4m5s
[13:44:13.571] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:44:0)
[13:44:13.590] Build status: STARTED
[13:44:13.590] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:45:0) after 8m11s
[13:52:24.657] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:45:0)
[13:52:24.687] Build status: STARTED
[13:52:24.687] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:46:0) after 2m50s
[13:55:14.710] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:46:0)
[13:55:14.730] Build status: STARTED
[13:55:14.730] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:47:0) after 6m43s
[14:01:57.749] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:47:0)
[14:01:57.807] Build status: STARTED
[14:01:57.807] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:48:0) after 9m7s
[14:11:04.928] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:48:0)
[14:11:08.282] Build status: STARTED
[14:11:08.282] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:49:0) after 5m34s
[14:16:42.311] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:49:0)
[14:16:42.340] Build status: STARTED
[14:16:42.340] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:50:0) after 8m19s
[14:25:01.362] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:50:0)
[14:25:01.378] Build status: STARTED
[14:25:01.378] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:51:0) after 4m47s
[14:29:48.470] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:51:0)
[14:29:48.490] Build status: STARTED
[14:29:48.490] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:52:0) after 5m46s
[14:35:34.507] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:52:0)
[14:35:34.560] Build status: STARTED
[14:35:34.560] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:53:0) after 3m26s
[14:39:00.639] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:53:0)
[14:39:00.660] Build status: STARTED
[14:39:00.660] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:54:0) after 8m18s
[14:47:18.735] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:54:0)
[14:47:18.751] Build status: STARTED
[14:47:18.751] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:55:0) after 8m16s
[14:55:34.770] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:55:0)
[14:55:34.820] Build status: STARTED
[14:55:34.820] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:56:0) after 2m6s
[14:57:40.834] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:56:0)
[14:57:40.906] Build status: STARTED
[14:57:40.906] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:57:0) after 1m50s
[14:59:30.928] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:57:0)
[14:59:30.949] Build status: STARTED
[14:59:30.949] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:58:0) after 7m27s
[15:06:57.972] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:58:0)
[15:06:57.988] Build status: STARTED
[15:06:57.988] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:59:0) after 9m30s
[15:16:27.956] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:59:0)
[15:16:27.972] Build status: STARTED
[15:16:27.972] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:60:0) after 9m4s
[15:25:31.974] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:60:0)
[15:25:31.993] Build status: STARTED
[15:25:31.993] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:61:0) after 1m42s
[15:27:14.014] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:61:0)
[15:27:14.035] Build status: STARTED
[15:27:14.035] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:62:0) after 3m1s
[15:30:15.077] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:62:0)
[15:30:15.096] Build status: STARTED
[15:30:15.096] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867741625160994256:63:0) after 6m0s
[15:35:43.887] Received PubSub notification, asking Buildbucket for the build status
[15:35:43.906] Build:
{
"id": "8702311563226720305",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTFuchsia x64"
},
"number": 26647,
"createdBy": "project:chromium",
"createTime": "2025-09-30T09:53:10.993277284Z",
"startTime": "2025-09-30T09:54:12.248859092Z",
"endTime": "2025-09-30T15:35:43.614879268Z",
"updateTime": "2025-09-30T15:35:43.614879268Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "6419da479659a7268f4c219782bb0e3367890e1f",
"ref": "refs/heads/main"
}
}
}
[15:35:43.906] Invocation finished in 5h42m34.14029233s with status FAILED