[14:37:12.679] New invocation is queued and will start shortly
[14:37:14.856] Starting the invocation (attempt 1)
[14:37:14.890] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/00e259fd33bbd4b92aa0ce3ecdd0d1bff9ec33ac"
[14:37:14.890] Popped gitiles commit info from properties and tags
[14:37:14.890] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[14:37:14.890] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[14:37:14.890] Buildbucket request:
{
"requestId": "8851869285255204176",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroidCoverage x86"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "00e259fd33bbd4b92aa0ce3ecdd0d1bff9ec33ac",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8851869285255204176"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTAndroidCoverage x86"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[14:37:15.526] Scheduled build:
{
"id": "8686439222214629857",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroidCoverage x86"
},
"number": 18113,
"createdBy": "project:chromium",
"createTime": "2026-03-24T14:37:14.958934399Z",
"updateTime": "2026-03-24T14:37:14.958934399Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "00e259fd33bbd4b92aa0ce3ecdd0d1bff9ec33ac",
"ref": "refs/heads/main"
}
}
}
[14:37:15.526] Task URL: https://cr-buildbucket.appspot.com/build/8686439222214629857
[14:37:15.526] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:2:0) after 6m10s
[14:37:15.592] Received PubSub notification, asking Buildbucket for the build status
[14:37:15.610] Build status: SCHEDULED
[14:39:21.382] Received PubSub notification, asking Buildbucket for the build status
[14:39:21.403] Build status: STARTED
[14:43:25.544] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:2:0)
[14:43:25.559] Build status: STARTED
[14:43:25.559] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:5:0) after 3m29s
[14:46:54.673] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:5:0)
[14:46:54.693] Build status: STARTED
[14:46:54.693] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:6:0) after 9m58s
[14:56:52.725] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:6:0)
[14:56:52.749] Build status: STARTED
[14:56:52.749] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:7:0) after 5m55s
[15:02:47.740] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:7:0)
[15:02:47.755] Build status: STARTED
[15:02:47.755] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:8:0) after 9m51s
[15:12:38.764] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:8:0)
[15:12:38.778] Build status: STARTED
[15:12:38.778] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:9:0) after 5m36s
[15:18:14.895] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:9:0)
[15:18:14.912] Build status: STARTED
[15:18:14.912] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:10:0) after 5m51s
[15:24:05.983] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:10:0)
[15:24:06.002] Build status: STARTED
[15:24:06.002] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:11:0) after 2m56s
[15:27:02.086] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:11:0)
[15:27:02.112] Build status: STARTED
[15:27:02.112] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:12:0) after 9m9s
[15:36:11.246] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:12:0)
[15:36:11.264] Build status: STARTED
[15:36:11.264] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:13:0) after 9m15s
[15:45:26.282] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:13:0)
[15:45:26.321] Build status: STARTED
[15:45:26.321] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:14:0) after 5m34s
[15:51:00.339] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:14:0)
[15:51:00.354] Build status: STARTED
[15:51:00.354] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:15:0) after 6m7s
[15:57:07.373] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:15:0)
[15:57:07.401] Build status: STARTED
[15:57:07.401] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:16:0) after 2m39s
[15:59:46.451] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:16:0)
[15:59:46.472] Build status: STARTED
[15:59:46.472] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:17:0) after 8m40s
[16:08:26.570] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:17:0)
[16:08:26.593] Build status: STARTED
[16:08:26.593] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:18:0) after 2m36s
[16:11:02.613] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:18:0)
[16:11:02.672] Build status: STARTED
[16:11:02.672] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:19:0) after 8m26s
[16:19:28.686] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:19:0)
[16:19:28.705] Build status: STARTED
[16:19:28.705] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:20:0) after 3m54s
[16:23:22.764] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:20:0)
[16:23:22.782] Build status: STARTED
[16:23:22.782] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:21:0) after 6m3s
[16:29:25.851] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:21:0)
[16:29:25.892] Build status: STARTED
[16:29:25.892] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:22:0) after 7m54s
[16:37:19.933] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:22:0)
[16:37:19.951] Build status: STARTED
[16:37:19.951] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:23:0) after 2m28s
[16:39:47.969] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:23:0)
[16:39:47.986] Build status: STARTED
[16:39:47.986] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:24:0) after 7m40s
[16:47:28.044] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:24:0)
[16:47:28.074] Build status: STARTED
[16:47:28.074] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:25:0) after 7m18s
[16:54:46.266] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:25:0)
[16:54:46.307] Build status: STARTED
[16:54:46.307] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:26:0) after 9m22s
[17:04:08.329] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:26:0)
[17:04:08.346] Build status: STARTED
[17:04:08.347] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:27:0) after 4m4s
[17:08:12.481] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:27:0)
[17:08:12.501] Build status: STARTED
[17:08:12.501] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:28:0) after 3m26s
[17:11:38.531] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:28:0)
[17:11:38.550] Build status: STARTED
[17:11:38.551] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:29:0) after 3m0s
[17:14:38.568] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:29:0)
[17:14:38.587] Build status: STARTED
[17:14:38.587] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:30:0) after 9m58s
[17:24:36.582] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:30:0)
[17:24:36.599] Build status: STARTED
[17:24:36.599] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:31:0) after 9m16s
[17:33:52.578] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:31:0)
[17:33:52.592] Build status: STARTED
[17:33:52.592] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:32:0) after 5m31s
[17:39:23.610] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:32:0)
[17:39:23.626] Build status: STARTED
[17:39:23.626] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:33:0) after 8m15s
[17:47:38.648] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:33:0)
[17:47:38.666] Build status: STARTED
[17:47:38.666] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:34:0) after 4m28s
[17:52:06.778] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:34:0)
[17:52:06.796] Build status: STARTED
[17:52:06.796] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:35:0) after 4m56s
[17:57:03.039] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:35:0)
[17:57:03.066] Build status: STARTED
[17:57:03.066] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:36:0) after 2m43s
[17:59:46.086] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:36:0)
[17:59:46.103] Build status: STARTED
[17:59:46.103] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:37:0) after 2m4s
[18:01:50.168] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:37:0)
[18:01:50.274] Build status: STARTED
[18:01:50.274] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:38:0) after 1m19s
[18:03:09.294] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:38:0)
[18:03:09.316] Build status: STARTED
[18:03:09.316] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:39:0) after 8m33s
[18:11:42.368] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:39:0)
[18:11:42.427] Build status: STARTED
[18:11:42.428] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:40:0) after 8m35s
[18:20:17.462] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:40:0)
[18:20:17.478] Build status: STARTED
[18:20:17.478] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:41:0) after 6m43s
[18:27:00.644] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:41:0)
[18:27:00.662] Build status: STARTED
[18:27:00.662] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:42:0) after 4m29s
[18:31:29.694] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:42:0)
[18:31:29.712] Build status: STARTED
[18:31:29.712] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:43:0) after 1m17s
[18:32:46.829] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:43:0)
[18:32:46.859] Build status: STARTED
[18:32:46.859] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:44:0) after 7m10s
[18:39:57.038] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:44:0)
[18:39:57.085] Build status: STARTED
[18:39:57.085] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:45:0) after 3m37s
[18:43:34.195] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:45:0)
[18:43:34.214] Build status: STARTED
[18:43:34.214] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:46:0) after 5m12s
[18:48:46.231] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:46:0)
[18:48:46.248] Build status: STARTED
[18:48:46.248] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:47:0) after 5m41s
[18:54:27.366] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:47:0)
[18:54:27.391] Build status: STARTED
[18:54:27.391] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:48:0) after 7m51s
[19:02:18.367] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:48:0)
[19:02:18.441] Build status: STARTED
[19:02:18.441] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:49:0) after 2m18s
[19:04:36.446] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:49:0)
[19:04:36.462] Build status: STARTED
[19:04:36.462] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:50:0) after 8m44s
[19:13:20.500] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:50:0)
[19:13:20.536] Build status: STARTED
[19:13:20.536] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:51:0) after 4m10s
[19:17:30.690] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:51:0)
[19:17:30.703] Build status: STARTED
[19:17:30.703] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:52:0) after 3m43s
[19:21:13.723] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:52:0)
[19:21:13.741] Build status: STARTED
[19:21:13.741] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:53:0) after 7m4s
[19:28:17.814] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:53:0)
[19:28:17.839] Build status: STARTED
[19:28:17.839] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:54:0) after 3m24s
[19:31:41.900] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:54:0)
[19:31:41.918] Build status: STARTED
[19:31:41.918] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:55:0) after 3m59s
[19:35:41.038] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:55:0)
[19:35:41.111] Build status: STARTED
[19:35:41.111] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:56:0) after 5m59s
[19:41:40.155] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:56:0)
[19:41:40.173] Build status: STARTED
[19:41:40.173] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:57:0) after 9m51s
[19:51:31.269] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:57:0)
[19:51:31.284] Build status: STARTED
[19:51:31.284] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:58:0) after 5m16s
[19:56:47.401] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:58:0)
[19:56:47.423] Build status: STARTED
[19:56:47.423] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851869285255204176:59:0) after 8m2s
[19:57:52.054] Received PubSub notification, asking Buildbucket for the build status
[19:57:52.174] Build:
{
"id": "8686439222214629857",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroidCoverage x86"
},
"number": 18113,
"createdBy": "project:chromium",
"createTime": "2026-03-24T14:37:14.958934399Z",
"startTime": "2026-03-24T14:39:20.855017782Z",
"endTime": "2026-03-24T19:57:51.751196467Z",
"updateTime": "2026-03-24T19:57:51.751196467Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "00e259fd33bbd4b92aa0ce3ecdd0d1bff9ec33ac",
"ref": "refs/heads/main"
}
}
}
[19:57:52.174] Invocation finished in 5h20m39.500085223s with status FAILED