[15:35:47.012] New invocation is queued and will start shortly
[15:35:48.153] Starting the invocation (attempt 1)
[15:35:48.189] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/230527ad27146c3a4ef957467a982430c998c048"
[15:35:48.189] Popped gitiles commit info from properties and tags
[15:35:48.189] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[15:35:48.189] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[15:35:48.190] Buildbucket request:
{
"requestId": "8867720069339030752",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTFuchsia x64"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "230527ad27146c3a4ef957467a982430c998c048",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8867720069339030752"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTFuchsia x64"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[15:35:48.742] Scheduled build:
{
"id": "8702290007368072753",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTFuchsia x64"
},
"number": 26648,
"createdBy": "project:chromium",
"createTime": "2025-09-30T15:35:48.262661377Z",
"updateTime": "2025-09-30T15:35:48.262661377Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "230527ad27146c3a4ef957467a982430c998c048",
"ref": "refs/heads/main"
}
}
}
[15:35:48.742] Task URL: https://cr-buildbucket.appspot.com/build/8702290007368072753
[15:35:48.742] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:2:0) after 5m8s
[15:35:49.737] Received PubSub notification, asking Buildbucket for the build status
[15:35:49.766] Build status: SCHEDULED
[15:36:49.571] Received PubSub notification, asking Buildbucket for the build status
[15:36:49.603] Build status: STARTED
[15:40:56.758] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:2:0)
[15:40:56.781] Build status: STARTED
[15:40:56.781] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:5:0) after 1m18s
[15:42:14.897] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:5:0)
[15:42:14.921] Build status: STARTED
[15:42:14.921] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:6:0) after 8m20s
[15:50:34.988] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:6:0)
[15:50:35.006] Build status: STARTED
[15:50:35.006] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:7:0) after 5m31s
[15:56:06.044] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:7:0)
[15:56:06.057] Build status: STARTED
[15:56:06.057] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:8:0) after 5m58s
[16:02:04.080] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:8:0)
[16:02:04.096] Build status: STARTED
[16:02:04.096] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:9:0) after 3m40s
[16:05:44.171] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:9:0)
[16:05:44.196] Build status: STARTED
[16:05:44.196] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:10:0) after 3m20s
[16:09:04.326] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:10:0)
[16:09:04.383] Build status: STARTED
[16:09:04.383] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:11:0) after 5m9s
[16:14:13.411] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:11:0)
[16:14:13.434] Build status: STARTED
[16:14:13.434] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:12:0) after 4m12s
[16:18:25.493] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:12:0)
[16:18:25.508] Build status: STARTED
[16:18:25.508] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:13:0) after 9m45s
[16:28:10.541] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:13:0)
[16:28:10.563] Build status: STARTED
[16:28:10.564] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:14:0) after 2m30s
[16:30:40.592] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:14:0)
[16:30:40.615] Build status: STARTED
[16:30:40.615] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:15:0) after 2m31s
[16:33:11.632] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:15:0)
[16:33:11.662] Build status: STARTED
[16:33:11.662] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:16:0) after 9m49s
[16:43:00.691] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:16:0)
[16:43:00.709] Build status: STARTED
[16:43:00.709] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:17:0) after 6m33s
[16:49:33.727] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:17:0)
[16:49:33.753] Build status: STARTED
[16:49:33.753] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:18:0) after 8m29s
[16:58:02.776] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:18:0)
[16:58:02.791] Build status: STARTED
[16:58:02.791] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:19:0) after 4m11s
[17:02:13.887] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:19:0)
[17:02:13.912] Build status: STARTED
[17:02:13.912] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:20:0) after 8m37s
[17:10:50.946] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:20:0)
[17:10:50.963] Build status: STARTED
[17:10:50.964] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:21:0) after 4m4s
[17:14:54.952] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:21:0)
[17:14:55.051] Build status: STARTED
[17:14:55.051] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:22:0) after 9m21s
[17:24:16.077] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:22:0)
[17:24:16.206] Build status: STARTED
[17:24:16.206] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:23:0) after 8m27s
[17:32:43.293] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:23:0)
[17:32:43.341] Build status: STARTED
[17:32:43.341] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:24:0) after 1m28s
[17:34:11.373] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:24:0)
[17:34:11.394] Build status: STARTED
[17:34:11.394] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:25:0) after 3m54s
[17:38:05.483] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:25:0)
[17:38:05.504] Build status: STARTED
[17:38:05.504] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:26:0) after 9m47s
[17:47:52.544] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:26:0)
[17:47:52.558] Build status: STARTED
[17:47:52.558] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:27:0) after 4m36s
[17:52:28.627] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:27:0)
[17:52:28.646] Build status: STARTED
[17:52:28.646] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:28:0) after 2m1s
[17:54:29.697] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:28:0)
[17:54:29.713] Build status: STARTED
[17:54:29.713] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:29:0) after 3m34s
[17:58:03.734] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:29:0)
[17:58:03.755] Build status: STARTED
[17:58:03.755] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:30:0) after 7m21s
[18:05:24.777] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:30:0)
[18:05:24.841] Build status: STARTED
[18:05:24.841] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:31:0) after 8m44s
[18:14:09.055] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:31:0)
[18:14:09.072] Build status: STARTED
[18:14:09.072] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:32:0) after 6m6s
[18:20:15.099] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:32:0)
[18:20:15.114] Build status: STARTED
[18:20:15.114] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:33:0) after 2m18s
[18:22:33.132] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:33:0)
[18:22:33.220] Build status: STARTED
[18:22:33.220] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:34:0) after 9m42s
[18:32:15.240] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:34:0)
[18:32:15.256] Build status: STARTED
[18:32:15.256] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:35:0) after 9m29s
[18:41:44.367] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:35:0)
[18:41:44.391] Build status: STARTED
[18:41:44.391] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:36:0) after 7m29s
[18:49:13.514] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:36:0)
[18:49:13.547] Build status: STARTED
[18:49:13.547] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:37:0) after 6m5s
[18:55:18.553] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:37:0)
[18:55:18.570] Build status: STARTED
[18:55:18.570] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:38:0) after 5m21s
[19:00:39.600] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:38:0)
[19:00:39.629] Build status: STARTED
[19:00:39.629] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:39:0) after 9m51s
[19:10:30.725] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:39:0)
[19:10:30.743] Build status: STARTED
[19:10:30.743] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:40:0) after 4m18s
[19:14:48.762] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:40:0)
[19:14:48.781] Build status: STARTED
[19:14:48.781] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:41:0) after 5m51s
[19:20:39.801] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:41:0)
[19:20:39.822] Build status: STARTED
[19:20:39.822] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:42:0) after 1m13s
[19:21:52.901] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:42:0)
[19:21:52.923] Build status: STARTED
[19:21:52.923] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:43:0) after 8m41s
[19:30:34.049] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:43:0)
[19:30:34.069] Build status: STARTED
[19:30:34.069] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:44:0) after 1m39s
[19:32:13.110] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:44:0)
[19:32:13.266] Build status: STARTED
[19:32:13.266] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:45:0) after 1m36s
[19:33:49.303] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:45:0)
[19:33:49.317] Build status: STARTED
[19:33:49.317] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:46:0) after 8m24s
[19:42:13.334] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:46:0)
[19:42:13.349] Build status: STARTED
[19:42:13.349] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:47:0) after 1m19s
[19:43:32.380] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:47:0)
[19:43:32.455] Build status: STARTED
[19:43:32.455] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:48:0) after 3m11s
[19:46:43.471] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:48:0)
[19:46:43.491] Build status: STARTED
[19:46:43.491] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:49:0) after 6m10s
[19:52:53.471] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:49:0)
[19:52:53.553] Build status: STARTED
[19:52:53.553] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:50:0) after 5m58s
[19:58:51.579] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:50:0)
[19:58:51.610] Build status: STARTED
[19:58:51.610] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:51:0) after 1m56s
[20:00:47.672] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:51:0)
[20:00:47.690] Build status: STARTED
[20:00:47.690] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:52:0) after 6m52s
[20:07:39.855] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:52:0)
[20:07:39.873] Build status: STARTED
[20:07:39.873] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:53:0) after 5m43s
[20:13:22.853] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:53:0)
[20:13:22.870] Build status: STARTED
[20:13:22.870] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:54:0) after 5m15s
[20:18:37.878] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:54:0)
[20:18:37.898] Build status: STARTED
[20:18:37.898] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:55:0) after 9m53s
[20:28:30.966] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:55:0)
[20:28:30.982] Build status: STARTED
[20:28:30.982] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:56:0) after 3m19s
[20:31:50.009] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:56:0)
[20:31:50.029] Build status: STARTED
[20:31:50.029] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:57:0) after 6m37s
[20:38:27.025] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:57:0)
[20:38:27.039] Build status: STARTED
[20:38:27.039] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:58:0) after 3m21s
[20:41:48.306] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:58:0)
[20:41:48.322] Build status: STARTED
[20:41:48.323] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:59:0) after 9m23s
[20:51:11.390] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:59:0)
[20:51:11.407] Build status: STARTED
[20:51:11.407] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:60:0) after 5m39s
[20:56:50.429] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:60:0)
[20:56:50.444] Build status: STARTED
[20:56:50.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:61:0) after 5m24s
[21:02:14.598] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:61:0)
[21:02:14.723] Build status: STARTED
[21:02:14.723] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:62:0) after 9m27s
[21:11:41.736] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:62:0)
[21:11:41.791] Build status: STARTED
[21:11:41.791] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:63:0) after 1m39s
[21:13:20.853] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:63:0)
[21:13:20.914] Build status: STARTED
[21:13:20.914] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:64:0) after 6m22s
[21:19:42.949] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:64:0)
[21:19:42.967] Build status: STARTED
[21:19:42.967] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:65:0) after 4m0s
[21:23:42.996] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:65:0)
[21:23:43.017] Build status: STARTED
[21:23:43.017] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8867720069339030752:66:0) after 3m9s
[21:24:43.790] Received PubSub notification, asking Buildbucket for the build status
[21:24:43.839] Build:
{
"id": "8702290007368072753",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTFuchsia x64"
},
"number": 26648,
"createdBy": "project:chromium",
"createTime": "2025-09-30T15:35:48.262661377Z",
"startTime": "2025-09-30T15:36:49.355210755Z",
"endTime": "2025-09-30T21:24:43.497300665Z",
"updateTime": "2025-09-30T21:24:43.497300665Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "230527ad27146c3a4ef957467a982430c998c048",
"ref": "refs/heads/main"
}
}
}
[21:24:43.839] Invocation finished in 5h48m56.839830167s with status FAILED