[15:11:26.146] New invocation is queued and will start shortly
[15:11:27.285] Starting the invocation (attempt 1)
[15:11:27.312] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/88dc260ee0d8c0089e5942bd7d92a1ed6ba091c8"
[15:11:27.312] Popped gitiles commit info from properties and tags
[15:11:27.312] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[15:11:27.313] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[15:11:27.313] Buildbucket request:
{
"requestId": "8865003692173050304",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroid (dbg)"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "88dc260ee0d8c0089e5942bd7d92a1ed6ba091c8",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8865003692173050304"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTAndroid (dbg)"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[15:11:27.869] Scheduled build:
{
"id": "8699573630237969057",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroid (dbg)"
},
"number": 29157,
"createdBy": "project:chromium",
"createTime": "2025-10-30T15:11:27.364429451Z",
"updateTime": "2025-10-30T15:11:27.364429451Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "88dc260ee0d8c0089e5942bd7d92a1ed6ba091c8",
"ref": "refs/heads/main"
}
}
}
[15:11:27.869] Task URL: https://cr-buildbucket.appspot.com/build/8699573630237969057
[15:11:27.869] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:2:0) after 5m0s
[15:11:28.851] Received PubSub notification, asking Buildbucket for the build status
[15:11:28.873] Build status: SCHEDULED
[15:12:34.422] Received PubSub notification, asking Buildbucket for the build status
[15:12:34.437] Build status: STARTED
[15:16:27.900] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:2:0)
[15:16:27.928] Build status: STARTED
[15:16:27.928] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:5:0) after 8m44s
[15:25:12.002] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:5:0)
[15:25:12.035] Build status: STARTED
[15:25:12.035] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:6:0) after 4m0s
[15:29:12.055] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:6:0)
[15:29:12.070] Build status: STARTED
[15:29:12.070] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:7:0) after 5m47s
[15:34:59.161] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:7:0)
[15:34:59.194] Build status: STARTED
[15:34:59.194] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:8:0) after 3m20s
[15:38:19.213] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:8:0)
[15:38:19.227] Build status: STARTED
[15:38:19.227] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:9:0) after 5m46s
[15:44:05.331] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:9:0)
[15:44:05.738] Build status: STARTED
[15:44:05.738] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:10:0) after 3m56s
[15:48:01.791] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:10:0)
[15:48:01.808] Build status: STARTED
[15:48:01.808] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:11:0) after 8m46s
[15:56:47.851] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:11:0)
[15:56:47.865] Build status: STARTED
[15:56:47.865] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:12:0) after 2m1s
[15:58:48.895] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:12:0)
[15:58:48.989] Build status: STARTED
[15:58:48.989] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:13:0) after 5m0s
[16:03:49.008] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:13:0)
[16:03:49.027] Build status: STARTED
[16:03:49.027] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:14:0) after 4m1s
[16:07:50.045] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:14:0)
[16:07:50.066] Build status: STARTED
[16:07:50.066] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:15:0) after 3m59s
[16:11:49.087] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:15:0)
[16:11:49.103] Build status: STARTED
[16:11:49.103] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:16:0) after 5m2s
[16:16:51.289] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:16:0)
[16:16:51.364] Build status: STARTED
[16:16:51.364] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:17:0) after 4m4s
[16:20:55.384] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:17:0)
[16:20:55.403] Build status: STARTED
[16:20:55.403] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:18:0) after 2m59s
[16:23:54.444] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:18:0)
[16:23:54.463] Build status: STARTED
[16:23:54.463] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:19:0) after 9m59s
[16:33:53.577] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:19:0)
[16:33:53.728] Build status: STARTED
[16:33:53.728] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:20:0) after 3m5s
[16:36:58.749] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:20:0)
[16:36:58.765] Build status: STARTED
[16:36:58.765] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:21:0) after 3m30s
[16:40:28.811] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:21:0)
[16:40:28.838] Build status: STARTED
[16:40:28.838] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:22:0) after 3m36s
[16:44:04.856] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:22:0)
[16:44:04.978] Build status: STARTED
[16:44:04.978] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:23:0) after 2m5s
[16:46:10.076] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:23:0)
[16:46:10.093] Build status: STARTED
[16:46:10.093] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:24:0) after 5m32s
[16:51:42.092] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:24:0)
[16:51:42.113] Build status: STARTED
[16:51:42.113] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:25:0) after 9m12s
[17:00:54.134] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:25:0)
[17:00:54.198] Build status: STARTED
[17:00:54.198] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:26:0) after 7m11s
[17:08:05.255] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:26:0)
[17:08:05.269] Build status: STARTED
[17:08:05.269] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:27:0) after 2m57s
[17:11:02.395] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:27:0)
[17:11:02.585] Build status: STARTED
[17:11:02.585] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:28:0) after 7m8s
[17:18:10.805] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:28:0)
[17:18:10.821] Build status: STARTED
[17:18:10.821] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:29:0) after 9m4s
[17:27:14.884] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:29:0)
[17:27:14.903] Build status: STARTED
[17:27:14.903] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:30:0) after 5m53s
[17:33:07.997] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:30:0)
[17:33:08.018] Build status: STARTED
[17:33:08.018] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:31:0) after 1m56s
[17:35:04.065] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:31:0)
[17:35:04.102] Build status: STARTED
[17:35:04.102] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:32:0) after 3m15s
[17:38:19.125] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:32:0)
[17:38:19.150] Build status: STARTED
[17:38:19.150] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:33:0) after 6m51s
[17:45:10.305] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:33:0)
[17:45:10.319] Build status: STARTED
[17:45:10.319] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:34:0) after 1m13s
[17:46:23.538] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:34:0)
[17:46:23.552] Build status: STARTED
[17:46:23.552] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:35:0) after 6m16s
[17:52:39.572] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:35:0)
[17:52:39.593] Build status: STARTED
[17:52:39.593] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:36:0) after 7m12s
[17:59:51.620] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:36:0)
[17:59:51.640] Build status: STARTED
[17:59:51.640] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:37:0) after 2m0s
[18:01:51.660] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:37:0)
[18:01:51.678] Build status: STARTED
[18:01:51.679] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:38:0) after 4m18s
[18:06:09.699] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:38:0)
[18:06:09.720] Build status: STARTED
[18:06:09.720] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:39:0) after 7m6s
[18:13:15.790] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:39:0)
[18:13:15.813] Build status: STARTED
[18:13:15.813] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:40:0) after 8m18s
[18:21:33.885] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:40:0)
[18:21:33.900] Build status: STARTED
[18:21:33.900] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:41:0) after 2m48s
[18:24:21.982] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:41:0)
[18:24:22.012] Build status: STARTED
[18:24:22.012] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:42:0) after 6m28s
[18:30:50.056] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:42:0)
[18:30:50.088] Build status: STARTED
[18:30:50.088] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:43:0) after 7m17s
[18:38:07.110] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:43:0)
[18:38:07.125] Build status: STARTED
[18:38:07.125] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:44:0) after 5m33s
[18:43:40.208] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:44:0)
[18:43:40.232] Build status: STARTED
[18:43:40.232] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:45:0) after 4m56s
[18:48:36.353] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:45:0)
[18:48:36.375] Build status: STARTED
[18:48:36.375] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:46:0) after 7m0s
[18:55:36.398] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:46:0)
[18:55:36.411] Build status: STARTED
[18:55:36.411] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:47:0) after 1m33s
[18:57:09.402] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:47:0)
[18:57:09.428] Build status: STARTED
[18:57:09.428] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:48:0) after 5m37s
[19:02:46.559] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:48:0)
[19:02:46.575] Build status: STARTED
[19:02:46.575] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:49:0) after 7m11s
[19:09:57.667] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:49:0)
[19:09:57.687] Build status: STARTED
[19:09:57.687] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:50:0) after 5m21s
[19:15:18.723] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:50:0)
[19:15:18.751] Build status: STARTED
[19:15:18.751] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:51:0) after 5m44s
[19:21:02.780] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:51:0)
[19:21:02.805] Build status: STARTED
[19:21:02.805] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:52:0) after 9m49s
[19:30:51.827] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:52:0)
[19:30:51.842] Build status: STARTED
[19:30:51.842] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:53:0) after 9m25s
[19:40:16.865] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:53:0)
[19:40:16.922] Build status: STARTED
[19:40:16.922] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:54:0) after 5m59s
[19:46:15.984] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:54:0)
[19:46:16.065] Build status: STARTED
[19:46:16.065] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:55:0) after 4m15s
[19:50:31.088] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:55:0)
[19:50:31.108] Build status: STARTED
[19:50:31.108] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:56:0) after 2m47s
[19:53:18.131] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:56:0)
[19:53:18.146] Build status: STARTED
[19:53:18.146] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:57:0) after 4m37s
[19:57:55.165] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:57:0)
[19:57:55.185] Build status: STARTED
[19:57:55.185] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:58:0) after 8m16s
[20:06:11.315] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:58:0)
[20:06:11.331] Build status: STARTED
[20:06:11.331] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:59:0) after 4m40s
[20:10:51.355] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:59:0)
[20:10:51.411] Build status: STARTED
[20:10:51.411] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:60:0) after 6m30s
[20:17:21.383] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:60:0)
[20:17:21.407] Build status: STARTED
[20:17:21.407] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:61:0) after 4m56s
[20:22:17.426] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:61:0)
[20:22:17.444] Build status: STARTED
[20:22:17.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:62:0) after 2m45s
[20:25:02.483] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:62:0)
[20:25:02.569] Build status: STARTED
[20:25:02.569] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:63:0) after 1m17s
[20:26:19.646] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:63:0)
[20:26:19.662] Build status: STARTED
[20:26:19.662] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:64:0) after 7m27s
[20:33:46.695] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:64:0)
[20:33:46.714] Build status: STARTED
[20:33:46.714] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid (dbg):8865003692173050304:65:0) after 5m24s
[20:35:57.526] Received PubSub notification, asking Buildbucket for the build status
[20:35:57.551] Build:
{
"id": "8699573630237969057",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroid (dbg)"
},
"number": 29157,
"createdBy": "project:chromium",
"createTime": "2025-10-30T15:11:27.364429451Z",
"startTime": "2025-10-30T15:12:34.225711563Z",
"endTime": "2025-10-30T20:35:57.273014140Z",
"updateTime": "2025-10-30T20:35:57.273014140Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "88dc260ee0d8c0089e5942bd7d92a1ed6ba091c8",
"ref": "refs/heads/main"
}
}
}
[20:35:57.551] Invocation finished in 5h24m31.416437977s with status FAILED