[23:54:20.998] New invocation is queued and will start shortly
[23:54:22.105] Starting the invocation (attempt 1)
[23:54:22.130] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/12341b7deae739009b8f9732b92d5270227c5e92"
[23:54:22.131] Popped gitiles commit info from properties and tags
[23:54:22.131] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[23:54:22.132] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[23:54:22.132] Buildbucket request:
{
"requestId": "8836704539734366160",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroidCoverage x86"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "12341b7deae739009b8f9732b92d5270227c5e92",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8836704539734366160"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTAndroidCoverage x86"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[23:54:22.741] Scheduled build:
{
"id": "8671274477744140369",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroidCoverage x86"
},
"number": 21818,
"createdBy": "project:chromium",
"createTime": "2026-09-07T23:54:22.274501273Z",
"updateTime": "2026-09-07T23:54:22.274501273Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "12341b7deae739009b8f9732b92d5270227c5e92",
"ref": "refs/heads/main"
}
}
}
[23:54:22.741] Task URL: https://cr-buildbucket.appspot.com/build/8671274477744140369
[23:54:22.742] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:2:0) after 6m14s
[23:54:24.555] Received PubSub notification, asking Buildbucket for the build status
[23:54:24.584] Build status: SCHEDULED
[23:54:34.291] Received PubSub notification, asking Buildbucket for the build status
[23:54:34.316] Build status: STARTED
[00:00:36.808] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:2:0)
[00:00:36.837] Build status: STARTED
[00:00:36.837] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:5:0) after 1m22s
[00:01:58.906] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:5:0)
[00:01:58.924] Build status: STARTED
[00:01:58.925] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:6:0) after 4m29s
[00:06:27.941] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:6:0)
[00:06:28.042] Build status: STARTED
[00:06:28.042] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:7:0) after 2m30s
[00:08:58.057] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:7:0)
[00:08:58.077] Build status: STARTED
[00:08:58.077] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:8:0) after 1m10s
[00:10:08.089] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:8:0)
[00:10:08.108] Build status: STARTED
[00:10:08.108] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:9:0) after 9m4s
[00:19:12.260] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:9:0)
[00:19:12.281] Build status: STARTED
[00:19:12.281] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:10:0) after 3m39s
[00:22:51.347] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:10:0)
[00:22:51.368] Build status: STARTED
[00:22:51.368] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:11:0) after 3m39s
[00:26:30.435] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:11:0)
[00:26:30.453] Build status: STARTED
[00:26:30.453] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:12:0) after 9m54s
[00:36:24.483] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:12:0)
[00:36:24.499] Build status: STARTED
[00:36:24.499] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:13:0) after 8m45s
[00:45:09.632] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:13:0)
[00:45:09.658] Build status: STARTED
[00:45:09.658] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:14:0) after 1m13s
[00:46:22.725] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:14:0)
[00:46:22.749] Build status: STARTED
[00:46:22.750] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:15:0) after 1m4s
[00:47:26.724] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:15:0)
[00:47:26.743] Build status: STARTED
[00:47:26.743] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:16:0) after 2m0s
[00:49:26.758] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:16:0)
[00:49:26.776] Build status: STARTED
[00:49:26.776] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:17:0) after 2m41s
[00:52:07.790] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:17:0)
[00:52:07.872] Build status: STARTED
[00:52:07.872] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:18:0) after 2m33s
[00:54:40.986] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:18:0)
[00:54:41.004] Build status: STARTED
[00:54:41.004] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:19:0) after 9m36s
[01:04:17.001] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:19:0)
[01:04:17.039] Build status: STARTED
[01:04:17.039] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:20:0) after 7m35s
[01:11:52.054] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:20:0)
[01:11:52.074] Build status: STARTED
[01:11:52.074] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:21:0) after 8m54s
[01:20:46.149] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:21:0)
[01:20:46.165] Build status: STARTED
[01:20:46.165] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:22:0) after 8m49s
[01:29:35.380] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:22:0)
[01:29:35.401] Build status: STARTED
[01:29:35.401] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:23:0) after 4m40s
[01:34:15.419] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:23:0)
[01:34:15.440] Build status: STARTED
[01:34:15.441] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:24:0) after 5m27s
[01:39:42.454] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:24:0)
[01:39:42.521] Build status: STARTED
[01:39:42.521] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:25:0) after 6m25s
[01:46:07.536] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:25:0)
[01:46:07.571] Build status: STARTED
[01:46:07.571] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:26:0) after 6m9s
[01:52:16.636] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:26:0)
[01:52:16.654] Build status: STARTED
[01:52:16.654] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:27:0) after 9m2s
[02:01:18.767] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:27:0)
[02:01:18.793] Build status: STARTED
[02:01:18.793] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:28:0) after 8m48s
[02:10:06.860] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:28:0)
[02:10:06.878] Build status: STARTED
[02:10:06.878] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:29:0) after 4m12s
[02:14:18.922] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:29:0)
[02:14:18.944] Build status: STARTED
[02:14:18.944] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:30:0) after 9m52s
[02:24:10.958] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:30:0)
[02:24:10.980] Build status: STARTED
[02:24:10.980] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:31:0) after 7m33s
[02:31:44.086] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:31:0)
[02:31:44.138] Build status: STARTED
[02:31:44.138] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:32:0) after 2m59s
[02:34:43.201] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:32:0)
[02:34:43.241] Build status: STARTED
[02:34:43.241] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:33:0) after 7m49s
[02:42:32.333] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:33:0)
[02:42:32.355] Build status: STARTED
[02:42:32.355] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:34:0) after 6m3s
[02:48:35.411] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:34:0)
[02:48:35.430] Build status: STARTED
[02:48:35.430] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:35:0) after 5m16s
[02:53:51.449] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:35:0)
[02:53:51.468] Build status: STARTED
[02:53:51.468] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:36:0) after 6m16s
[03:00:07.484] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:36:0)
[03:00:07.503] Build status: STARTED
[03:00:07.503] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:37:0) after 4m23s
[03:04:30.608] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:37:0)
[03:04:30.627] Build status: STARTED
[03:04:30.627] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:38:0) after 9m44s
[03:14:14.743] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:38:0)
[03:14:14.762] Build status: STARTED
[03:14:14.762] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:39:0) after 2m8s
[03:16:22.790] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:39:0)
[03:16:22.812] Build status: STARTED
[03:16:22.812] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:40:0) after 4m53s
[03:21:15.827] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:40:0)
[03:21:15.897] Build status: STARTED
[03:21:15.897] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:41:0) after 9m51s
[03:31:06.936] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:41:0)
[03:31:06.961] Build status: STARTED
[03:31:06.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:42:0) after 4m1s
[03:35:08.057] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:42:0)
[03:35:08.078] Build status: STARTED
[03:35:08.079] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:43:0) after 7m32s
[03:42:40.095] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:43:0)
[03:42:40.112] Build status: STARTED
[03:42:40.112] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:44:0) after 6m7s
[03:48:47.126] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:44:0)
[03:48:47.167] Build status: STARTED
[03:48:47.167] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:45:0) after 2m25s
[03:51:12.155] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:45:0)
[03:51:12.172] Build status: STARTED
[03:51:12.172] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:46:0) after 3m30s
[03:54:42.321] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:46:0)
[03:54:42.343] Build status: STARTED
[03:54:42.343] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:47:0) after 5m31s
[04:00:13.403] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:47:0)
[04:00:13.438] Build status: STARTED
[04:00:13.438] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:48:0) after 5m40s
[04:05:53.474] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:48:0)
[04:05:53.494] Build status: STARTED
[04:05:53.494] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:49:0) after 2m25s
[04:08:18.494] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:49:0)
[04:08:18.519] Build status: STARTED
[04:08:18.519] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:50:0) after 9m51s
[04:18:09.536] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:50:0)
[04:18:09.556] Build status: STARTED
[04:18:09.556] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:51:0) after 8m2s
[04:26:11.570] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:51:0)
[04:26:11.589] Build status: STARTED
[04:26:11.589] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:52:0) after 3m8s
[04:29:19.607] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:52:0)
[04:29:19.624] Build status: STARTED
[04:29:19.624] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:53:0) after 2m11s
[04:31:30.782] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:53:0)
[04:31:30.799] Build status: STARTED
[04:31:30.800] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:54:0) after 8m48s
[04:40:18.889] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:54:0)
[04:40:18.935] Build status: STARTED
[04:40:18.935] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:55:0) after 1m47s
[04:42:05.955] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:55:0)
[04:42:06.172] Build status: STARTED
[04:42:06.172] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:56:0) after 5m9s
[04:47:15.230] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:56:0)
[04:47:15.288] Build status: STARTED
[04:47:15.288] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:57:0) after 7m17s
[04:54:32.317] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:57:0)
[04:54:32.336] Build status: STARTED
[04:54:32.336] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:58:0) after 8m49s
[05:03:21.373] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:58:0)
[05:03:21.463] Build status: STARTED
[05:03:21.463] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836704539734366160:59:0) after 7m12s
[05:04:46.332] Received PubSub notification, asking Buildbucket for the build status
[05:04:46.350] Build:
{
"id": "8671274477744140369",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroidCoverage x86"
},
"number": 21818,
"createdBy": "project:chromium",
"createTime": "2026-09-07T23:54:22.274501273Z",
"startTime": "2026-09-07T23:54:33.161621247Z",
"endTime": "2026-09-08T05:04:46.079199853Z",
"updateTime": "2026-09-08T05:04:46.079199853Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "12341b7deae739009b8f9732b92d5270227c5e92",
"ref": "refs/heads/main"
}
}
}
[05:04:46.350] Invocation finished in 5h10m25.358089492s with status FAILED