[20:24:00.488] New invocation is queued and will start shortly
[20:24:02.048] Starting the invocation (attempt 1)
[20:24:02.084] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/409bcf887e4a5330c642d55ebfe9a2ab464e234c"
[20:24:02.085] Popped gitiles commit info from properties and tags
[20:24:02.085] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[20:24:02.085] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[20:24:02.085] Buildbucket request:
{
"requestId": "8838348518694735312",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroidCoverage x86"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "409bcf887e4a5330c642d55ebfe9a2ab464e234c",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8838348518694735312"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTAndroidCoverage x86"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[20:24:02.650] Scheduled build:
{
"id": "8672918456276356545",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroidCoverage x86"
},
"number": 21648,
"createdBy": "project:chromium",
"createTime": "2026-08-20T20:24:02.171737945Z",
"updateTime": "2026-08-20T20:24:02.171737945Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "409bcf887e4a5330c642d55ebfe9a2ab464e234c",
"ref": "refs/heads/main"
}
}
}
[20:24:02.650] Task URL: https://cr-buildbucket.appspot.com/build/8672918456276356545
[20:24:02.651] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:2:0) after 2m17s
[20:24:02.782] Received PubSub notification, asking Buildbucket for the build status
[20:24:03.238] Build status: SCHEDULED
[20:24:08.687] Received PubSub notification, asking Buildbucket for the build status
[20:24:08.731] Build status: STARTED
[20:26:19.682] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:2:0)
[20:26:19.716] Build status: STARTED
[20:26:19.717] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:5:0) after 6m2s
[20:32:21.743] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:5:0)
[20:32:21.765] Build status: STARTED
[20:32:21.765] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:6:0) after 5m32s
[20:37:53.879] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:6:0)
[20:37:53.898] Build status: STARTED
[20:37:53.898] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:7:0) after 4m20s
[20:42:13.925] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:7:0)
[20:42:13.948] Build status: STARTED
[20:42:13.948] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:8:0) after 8m39s
[20:50:53.258] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:8:0)
[20:50:53.280] Build status: STARTED
[20:50:53.280] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:9:0) after 5m54s
[20:56:47.308] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:9:0)
[20:56:47.332] Build status: STARTED
[20:56:47.332] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:10:0) after 4m0s
[21:00:47.451] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:10:0)
[21:00:47.470] Build status: STARTED
[21:00:47.470] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:11:0) after 3m16s
[21:04:03.459] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:11:0)
[21:04:03.484] Build status: STARTED
[21:04:03.484] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:12:0) after 7m55s
[21:11:58.508] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:12:0)
[21:11:58.537] Build status: STARTED
[21:11:58.537] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:13:0) after 1m11s
[21:13:09.650] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:13:0)
[21:13:09.671] Build status: STARTED
[21:13:09.671] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:14:0) after 9m30s
[21:22:39.732] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:14:0)
[21:22:39.753] Build status: STARTED
[21:22:39.753] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:15:0) after 5m32s
[21:28:11.774] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:15:0)
[21:28:11.794] Build status: STARTED
[21:28:11.794] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:16:0) after 1m57s
[21:30:08.797] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:16:0)
[21:30:08.894] Build status: STARTED
[21:30:08.894] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:17:0) after 3m12s
[21:33:20.967] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:17:0)
[21:33:20.986] Build status: STARTED
[21:33:20.986] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:18:0) after 5m11s
[21:38:32.028] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:18:0)
[21:38:32.048] Build status: STARTED
[21:38:32.048] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:19:0) after 1m0s
[21:39:32.073] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:19:0)
[21:39:32.091] Build status: STARTED
[21:39:32.091] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:20:0) after 6m3s
[21:45:35.237] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:20:0)
[21:45:35.290] Build status: STARTED
[21:45:35.290] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:21:0) after 2m13s
[21:47:48.367] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:21:0)
[21:47:48.385] Build status: STARTED
[21:47:48.385] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:22:0) after 3m37s
[21:51:25.374] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:22:0)
[21:51:25.392] Build status: STARTED
[21:51:25.392] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:23:0) after 6m29s
[21:57:54.491] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:23:0)
[21:57:54.515] Build status: STARTED
[21:57:54.515] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:24:0) after 3m28s
[22:01:22.544] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:24:0)
[22:01:22.568] Build status: STARTED
[22:01:22.568] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:25:0) after 9m9s
[22:10:31.589] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:25:0)
[22:10:31.615] Build status: STARTED
[22:10:31.616] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:26:0) after 7m19s
[22:17:50.644] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:26:0)
[22:17:50.663] Build status: STARTED
[22:17:50.663] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:27:0) after 6m34s
[22:24:24.684] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:27:0)
[22:24:24.702] Build status: STARTED
[22:24:24.702] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:28:0) after 8m58s
[22:33:22.737] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:28:0)
[22:33:22.764] Build status: STARTED
[22:33:22.764] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:29:0) after 9m25s
[22:42:47.811] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:29:0)
[22:42:47.839] Build status: STARTED
[22:42:47.839] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:30:0) after 7m45s
[22:50:32.906] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:30:0)
[22:50:32.923] Build status: STARTED
[22:50:32.923] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:31:0) after 2m53s
[22:53:25.945] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:31:0)
[22:53:26.063] Build status: STARTED
[22:53:26.064] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:32:0) after 7m12s
[23:00:38.128] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:32:0)
[23:00:38.169] Build status: STARTED
[23:00:38.169] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:33:0) after 3m47s
[23:04:25.170] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:33:0)
[23:04:25.187] Build status: STARTED
[23:04:25.187] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:34:0) after 1m57s
[23:06:22.178] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:34:0)
[23:06:22.269] Build status: STARTED
[23:06:22.269] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:35:0) after 8m0s
[23:14:22.304] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:35:0)
[23:14:22.328] Build status: STARTED
[23:14:22.328] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:36:0) after 4m45s
[23:19:07.320] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:36:0)
[23:19:07.341] Build status: STARTED
[23:19:07.341] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:37:0) after 3m6s
[23:22:13.414] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:37:0)
[23:22:13.435] Build status: STARTED
[23:22:13.435] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:38:0) after 3m43s
[23:25:56.616] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:38:0)
[23:25:56.637] Build status: STARTED
[23:25:56.637] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:39:0) after 4m46s
[23:30:42.658] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:39:0)
[23:30:42.684] Build status: STARTED
[23:30:42.684] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:40:0) after 1m22s
[23:32:04.794] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:40:0)
[23:32:04.827] Build status: STARTED
[23:32:04.827] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:41:0) after 2m36s
[23:34:40.850] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:41:0)
[23:34:40.888] Build status: STARTED
[23:34:40.888] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:42:0) after 3m46s
[23:38:26.959] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:42:0)
[23:38:26.982] Build status: STARTED
[23:38:26.982] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:43:0) after 4m59s
[23:43:26.042] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:43:0)
[23:43:26.064] Build status: STARTED
[23:43:26.064] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:44:0) after 8m54s
[23:52:20.137] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:44:0)
[23:52:20.264] Build status: STARTED
[23:52:20.264] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:45:0) after 9m5s
[00:01:25.381] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:45:0)
[00:01:25.413] Build status: STARTED
[00:01:25.413] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:46:0) after 3m45s
[00:05:10.451] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:46:0)
[00:05:10.469] Build status: STARTED
[00:05:10.469] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:47:0) after 3m27s
[00:08:37.585] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:47:0)
[00:08:37.605] Build status: STARTED
[00:08:37.605] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:48:0) after 2m51s
[00:11:28.634] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:48:0)
[00:11:28.662] Build status: STARTED
[00:11:28.662] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:49:0) after 4m20s
[00:15:48.686] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:49:0)
[00:15:48.706] Build status: STARTED
[00:15:48.706] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:50:0) after 3m24s
[00:19:12.735] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:50:0)
[00:19:12.757] Build status: STARTED
[00:19:12.757] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:51:0) after 5m19s
[00:24:31.778] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:51:0)
[00:24:31.836] Build status: STARTED
[00:24:31.836] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:52:0) after 7m12s
[00:31:43.925] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:52:0)
[00:31:43.946] Build status: STARTED
[00:31:43.946] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:53:0) after 5m9s
[00:36:52.968] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:53:0)
[00:36:52.990] Build status: STARTED
[00:36:52.990] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:54:0) after 6m28s
[00:43:21.049] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:54:0)
[00:43:21.068] Build status: STARTED
[00:43:21.068] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:55:0) after 5m54s
[00:49:15.094] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:55:0)
[00:49:15.114] Build status: STARTED
[00:49:15.114] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:56:0) after 8m10s
[00:57:25.136] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:56:0)
[00:57:25.154] Build status: STARTED
[00:57:25.154] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:57:0) after 9m47s
[01:07:12.234] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:57:0)
[01:07:12.269] Build status: STARTED
[01:07:12.270] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:58:0) after 7m46s
[01:14:58.403] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:58:0)
[01:14:58.639] Build status: STARTED
[01:14:58.639] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:59:0) after 5m0s
[01:19:58.689] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:59:0)
[01:19:58.733] Build status: STARTED
[01:19:58.734] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:60:0) after 5m3s
[01:25:01.828] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:60:0)
[01:25:01.854] Build status: STARTED
[01:25:01.854] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:61:0) after 4m56s
[01:29:57.909] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:61:0)
[01:29:57.928] Build status: STARTED
[01:29:57.928] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:62:0) after 5m6s
[01:35:03.950] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:62:0)
[01:35:04.010] Build status: STARTED
[01:35:04.010] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:63:0) after 8m2s
[01:43:06.082] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:63:0)
[01:43:06.155] Build status: STARTED
[01:43:06.155] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8838348518694735312:64:0) after 3m5s
[01:45:58.334] Received PubSub notification, asking Buildbucket for the build status
[01:45:58.365] Build:
{
"id": "8672918456276356545",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroidCoverage x86"
},
"number": 21648,
"createdBy": "project:chromium",
"createTime": "2026-08-20T20:24:02.171737945Z",
"startTime": "2026-08-20T20:24:08.512483530Z",
"endTime": "2026-08-21T01:45:24.422870316Z",
"updateTime": "2026-08-21T01:45:24.422870316Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "409bcf887e4a5330c642d55ebfe9a2ab464e234c",
"ref": "refs/heads/main"
}
}
}
[01:45:58.365] Invocation finished in 5h21m57.883629629s with status FAILED