[13:54:24.405] New invocation is queued and will start shortly
[13:54:26.226] Starting the invocation (attempt 1)
[13:54:26.281] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/491592da5bdc1b06e9380aa3ad39466e2f918978"
[13:54:26.281] Popped gitiles commit info from properties and tags
[13:54:26.281] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[13:54:26.282] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[13:54:26.282] Buildbucket request:
{
"requestId": "8879685246979831968",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "491592da5bdc1b06e9380aa3ad39466e2f918978",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8879685246979831968"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOS"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[13:54:26.789] Scheduled build:
{
"id": "8714255184295364561",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"number": 32603,
"createdBy": "project:chromium",
"createTime": "2025-05-21T13:54:26.335007886Z",
"updateTime": "2025-05-21T13:54:26.335007886Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "491592da5bdc1b06e9380aa3ad39466e2f918978",
"ref": "refs/heads/main"
}
}
}
[13:54:26.789] Task URL: https://cr-buildbucket.appspot.com/build/8714255184295364561
[13:54:26.789] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:2:0) after 4m40s
[13:54:27.758] Received PubSub notification, asking Buildbucket for the build status
[13:54:27.784] Build status: SCHEDULED
[13:54:30.462] Received PubSub notification, asking Buildbucket for the build status
[13:54:30.489] Build status: STARTED
[13:59:06.808] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:2:0)
[13:59:06.837] Build status: STARTED
[13:59:06.837] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:5:0) after 2m41s
[14:01:47.869] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:5:0)
[14:01:47.889] Build status: STARTED
[14:01:47.889] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:6:0) after 3m9s
[14:04:56.932] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:6:0)
[14:04:56.958] Build status: STARTED
[14:04:56.958] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:7:0) after 2m48s
[14:07:44.978] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:7:0)
[14:07:45.008] Build status: STARTED
[14:07:45.008] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:8:0) after 1m9s
[14:08:54.061] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:8:0)
[14:08:54.323] Build status: STARTED
[14:08:54.323] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:9:0) after 3m4s
[14:11:58.324] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:9:0)
[14:11:58.353] Build status: STARTED
[14:11:58.353] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:10:0) after 7m11s
[14:19:09.387] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:10:0)
[14:19:09.407] Build status: STARTED
[14:19:09.407] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:11:0) after 9m27s
[14:28:36.437] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:11:0)
[14:28:36.459] Build status: STARTED
[14:28:36.459] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:12:0) after 9m39s
[14:38:15.475] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:12:0)
[14:38:15.500] Build status: STARTED
[14:38:15.500] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:13:0) after 9m53s
[14:48:08.582] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:13:0)
[14:48:08.605] Build status: STARTED
[14:48:08.605] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:14:0) after 9m54s
[14:58:02.645] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:14:0)
[14:58:02.680] Build status: STARTED
[14:58:02.680] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:15:0) after 4m22s
[15:02:24.824] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:15:0)
[15:02:24.925] Build status: STARTED
[15:02:24.925] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:16:0) after 8m9s
[15:10:33.963] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:16:0)
[15:10:33.988] Build status: STARTED
[15:10:33.988] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:17:0) after 9m21s
[15:19:55.006] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:17:0)
[15:19:55.046] Build status: STARTED
[15:19:55.046] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:18:0) after 6m33s
[15:26:28.106] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:18:0)
[15:26:28.133] Build status: STARTED
[15:26:28.133] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:19:0) after 5m23s
[15:31:51.207] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:19:0)
[15:31:51.255] Build status: STARTED
[15:31:51.255] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:20:0) after 3m1s
[15:34:52.237] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:20:0)
[15:34:52.254] Build status: STARTED
[15:34:52.254] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:21:0) after 3m11s
[15:38:03.422] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:21:0)
[15:38:03.480] Build status: STARTED
[15:38:03.480] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:22:0) after 1m28s
[15:39:31.501] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:22:0)
[15:39:31.547] Build status: STARTED
[15:39:31.547] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:23:0) after 9m29s
[15:49:00.563] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:23:0)
[15:49:00.587] Build status: STARTED
[15:49:00.587] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:24:0) after 4m23s
[15:53:23.641] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:24:0)
[15:53:23.666] Build status: STARTED
[15:53:23.666] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:25:0) after 1m55s
[15:55:18.832] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:25:0)
[15:55:18.849] Build status: STARTED
[15:55:18.849] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:26:0) after 3m48s
[15:59:06.913] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:26:0)
[15:59:06.931] Build status: STARTED
[15:59:06.931] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:27:0) after 5m16s
[16:04:22.954] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:27:0)
[16:04:22.970] Build status: STARTED
[16:04:22.970] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:28:0) after 5m12s
[16:09:35.185] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:28:0)
[16:09:35.208] Build status: STARTED
[16:09:35.208] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:29:0) after 1m18s
[16:10:53.302] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:29:0)
[16:10:53.343] Build status: STARTED
[16:10:53.343] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:30:0) after 3m30s
[16:14:23.508] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:30:0)
[16:14:23.588] Build status: STARTED
[16:14:23.588] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:31:0) after 6m54s
[16:21:17.617] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:31:0)
[16:21:17.634] Build status: STARTED
[16:21:17.634] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:32:0) after 3m4s
[16:24:21.705] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:32:0)
[16:24:21.724] Build status: STARTED
[16:24:21.724] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:33:0) after 6m31s
[16:30:52.881] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:33:0)
[16:30:52.929] Build status: STARTED
[16:30:52.929] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:34:0) after 4m40s
[16:35:32.959] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:34:0)
[16:35:32.974] Build status: STARTED
[16:35:32.974] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:35:0) after 5m19s
[16:40:52.045] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:35:0)
[16:40:52.064] Build status: STARTED
[16:40:52.064] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:36:0) after 2m29s
[16:43:21.260] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:36:0)
[16:43:21.280] Build status: STARTED
[16:43:21.280] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:37:0) after 6m19s
[16:49:40.372] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:37:0)
[16:49:40.562] Build status: STARTED
[16:49:40.562] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:38:0) after 1m24s
[16:51:04.611] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:38:0)
[16:51:04.640] Build status: STARTED
[16:51:04.640] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:39:0) after 9m36s
[17:00:42.370] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:39:0)
[17:00:42.389] Build status: STARTED
[17:00:42.389] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:40:0) after 6m42s
[17:07:24.434] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:40:0)
[17:07:24.457] Build status: STARTED
[17:07:24.457] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:41:0) after 3m25s
[17:10:49.485] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:41:0)
[17:10:49.521] Build status: STARTED
[17:10:49.521] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:42:0) after 1m9s
[17:11:58.544] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:42:0)
[17:11:58.573] Build status: STARTED
[17:11:58.573] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:43:0) after 7m23s
[17:19:21.542] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:43:0)
[17:19:21.575] Build status: STARTED
[17:19:21.575] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:44:0) after 4m31s
[17:23:52.602] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:44:0)
[17:23:52.625] Build status: STARTED
[17:23:52.625] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:45:0) after 2m13s
[17:26:05.632] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:45:0)
[17:26:05.694] Build status: STARTED
[17:26:05.694] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:46:0) after 3m47s
[17:29:52.721] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:46:0)
[17:29:52.743] Build status: STARTED
[17:29:52.743] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:47:0) after 1m19s
[17:31:11.838] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:47:0)
[17:31:11.856] Build status: STARTED
[17:31:11.856] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:48:0) after 8m0s
[17:39:11.997] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:48:0)
[17:39:12.017] Build status: STARTED
[17:39:12.017] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:49:0) after 5m18s
[17:44:30.093] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:49:0)
[17:44:30.110] Build status: STARTED
[17:44:30.110] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:50:0) after 6m16s
[17:50:46.166] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:50:0)
[17:50:46.226] Build status: STARTED
[17:50:46.226] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:51:0) after 7m15s
[17:58:01.353] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:51:0)
[17:58:01.374] Build status: STARTED
[17:58:01.374] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:52:0) after 9m55s
[18:07:56.403] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:52:0)
[18:07:56.423] Build status: STARTED
[18:07:56.423] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:53:0) after 8m3s
[18:15:59.542] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:53:0)
[18:15:59.558] Build status: STARTED
[18:15:59.558] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:54:0) after 7m26s
[18:23:25.620] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:54:0)
[18:23:25.638] Build status: STARTED
[18:23:25.638] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:55:0) after 3m43s
[18:27:08.751] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:55:0)
[18:27:08.773] Build status: STARTED
[18:27:08.773] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:56:0) after 1m59s
[18:29:07.811] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:56:0)
[18:29:07.831] Build status: STARTED
[18:29:07.831] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:57:0) after 2m3s
[18:31:10.855] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:57:0)
[18:31:10.873] Build status: STARTED
[18:31:10.873] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:58:0) after 9m53s
[18:41:03.894] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:58:0)
[18:41:03.915] Build status: STARTED
[18:41:03.915] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:59:0) after 4m12s
[18:45:16.075] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:59:0)
[18:45:16.098] Build status: STARTED
[18:45:16.098] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:60:0) after 1m9s
[18:46:25.116] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:60:0)
[18:46:25.142] Build status: STARTED
[18:46:25.142] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:61:0) after 8m27s
[18:54:52.288] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:61:0)
[18:54:52.314] Build status: STARTED
[18:54:52.314] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:62:0) after 5m24s
[19:00:16.405] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:62:0)
[19:00:16.553] Build status: STARTED
[19:00:16.553] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:63:0) after 4m31s
[19:04:47.534] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:63:0)
[19:04:47.560] Build status: STARTED
[19:04:47.560] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8879685246979831968:64:0) after 6m34s
[19:05:39.135] Received PubSub notification, asking Buildbucket for the build status
[19:05:39.210] Build:
{
"id": "8714255184295364561",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"number": 32603,
"createdBy": "project:chromium",
"createTime": "2025-05-21T13:54:26.335007886Z",
"startTime": "2025-05-21T13:54:30.078434989Z",
"endTime": "2025-05-21T19:05:38.864813097Z",
"updateTime": "2025-05-21T19:05:38.864813097Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "491592da5bdc1b06e9380aa3ad39466e2f918978",
"ref": "refs/heads/main"
}
}
}
[19:05:39.210] Invocation finished in 5h11m14.819223213s with status FAILED