[13:33:08.185] New invocation is queued and will start shortly
[13:33:09.502] Starting the invocation (attempt 1)
[13:33:09.522] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/9f0d55bb8e06d7d8dc96f49cf6d3c4f5902e1efe"
[13:33:09.522] Popped gitiles commit info from properties and tags
[13:33:09.522] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[13:33:09.522] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[13:33:09.522] Buildbucket request:
{
"requestId": "8852416898306861584",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroidCoverage x86"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9f0d55bb8e06d7d8dc96f49cf6d3c4f5902e1efe",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8852416898306861584"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTAndroidCoverage x86"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[13:33:10.160] Scheduled build:
{
"id": "8686986836187304817",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroidCoverage x86"
},
"number": 18084,
"createdBy": "project:chromium",
"createTime": "2026-03-18T13:33:09.576432956Z",
"updateTime": "2026-03-18T13:33:09.576432956Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9f0d55bb8e06d7d8dc96f49cf6d3c4f5902e1efe",
"ref": "refs/heads/main"
}
}
}
[13:33:10.160] Task URL: https://cr-buildbucket.appspot.com/build/8686986836187304817
[13:33:10.160] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:2:0) after 5m2s
[13:33:10.611] Received PubSub notification, asking Buildbucket for the build status
[13:33:10.663] Build status: SCHEDULED
[13:33:21.246] Received PubSub notification, asking Buildbucket for the build status
[13:33:21.280] Build status: STARTED
[13:38:12.183] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:2:0)
[13:38:12.225] Build status: STARTED
[13:38:12.225] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:5:0) after 6m15s
[13:44:27.317] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:5:0)
[13:44:27.356] Build status: STARTED
[13:44:27.357] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:6:0) after 5m53s
[13:50:20.462] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:6:0)
[13:50:20.539] Build status: STARTED
[13:50:20.539] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:7:0) after 9m56s
[14:00:16.557] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:7:0)
[14:00:16.580] Build status: STARTED
[14:00:16.580] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:8:0) after 4m12s
[14:04:28.679] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:8:0)
[14:04:28.695] Build status: STARTED
[14:04:28.695] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:9:0) after 1m27s
[14:05:55.792] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:9:0)
[14:05:55.847] Build status: STARTED
[14:05:55.847] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:10:0) after 1m47s
[14:07:42.877] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:10:0)
[14:07:42.924] Build status: STARTED
[14:07:42.924] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:11:0) after 1m20s
[14:09:02.986] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:11:0)
[14:09:03.046] Build status: STARTED
[14:09:03.046] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:12:0) after 4m8s
[14:13:11.111] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:12:0)
[14:13:11.128] Build status: STARTED
[14:13:11.128] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:13:0) after 1m55s
[14:15:06.144] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:13:0)
[14:15:06.160] Build status: STARTED
[14:15:06.160] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:14:0) after 7m1s
[14:22:07.180] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:14:0)
[14:22:07.199] Build status: STARTED
[14:22:07.199] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:15:0) after 7m57s
[14:30:04.317] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:15:0)
[14:30:04.338] Build status: STARTED
[14:30:04.338] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:16:0) after 2m50s
[14:32:54.420] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:16:0)
[14:32:54.469] Build status: STARTED
[14:32:54.469] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:17:0) after 9m34s
[14:42:28.515] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:17:0)
[14:42:28.566] Build status: STARTED
[14:42:28.566] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:18:0) after 5m1s
[14:47:29.591] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:18:0)
[14:47:29.607] Build status: STARTED
[14:47:29.607] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:19:0) after 4m10s
[14:51:39.625] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:19:0)
[14:51:39.807] Build status: STARTED
[14:51:39.807] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:20:0) after 9m43s
[15:01:22.826] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:20:0)
[15:01:22.946] Build status: STARTED
[15:01:22.946] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:21:0) after 7m48s
[15:09:11.025] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:21:0)
[15:09:11.104] Build status: STARTED
[15:09:11.104] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:22:0) after 4m40s
[15:13:51.137] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:22:0)
[15:13:51.151] Build status: STARTED
[15:13:51.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:23:0) after 7m24s
[15:21:15.159] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:23:0)
[15:21:15.186] Build status: STARTED
[15:21:15.186] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:24:0) after 2m12s
[15:23:27.216] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:24:0)
[15:23:27.233] Build status: STARTED
[15:23:27.234] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:25:0) after 5m28s
[15:28:55.253] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:25:0)
[15:28:55.281] Build status: STARTED
[15:28:55.281] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:26:0) after 8m55s
[15:37:50.364] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:26:0)
[15:37:50.394] Build status: STARTED
[15:37:50.394] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:27:0) after 2m39s
[15:40:29.412] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:27:0)
[15:40:29.432] Build status: STARTED
[15:40:29.432] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:28:0) after 3m16s
[15:43:45.527] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:28:0)
[15:43:45.551] Build status: STARTED
[15:43:45.551] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:29:0) after 3m34s
[15:47:19.574] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:29:0)
[15:47:19.664] Build status: STARTED
[15:47:19.664] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:30:0) after 7m37s
[15:54:56.677] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:30:0)
[15:54:56.731] Build status: STARTED
[15:54:56.731] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:31:0) after 3m2s
[15:57:58.799] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:31:0)
[15:57:58.891] Build status: STARTED
[15:57:58.891] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:32:0) after 7m37s
[16:05:35.943] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:32:0)
[16:05:36.007] Build status: STARTED
[16:05:36.007] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:33:0) after 9m38s
[16:15:14.070] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:33:0)
[16:15:14.089] Build status: STARTED
[16:15:14.089] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:34:0) after 3m53s
[16:19:07.139] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:34:0)
[16:19:07.264] Build status: STARTED
[16:19:07.264] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:35:0) after 1m49s
[16:20:56.372] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:35:0)
[16:20:56.425] Build status: STARTED
[16:20:56.425] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:36:0) after 6m41s
[16:27:37.496] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:36:0)
[16:27:37.513] Build status: STARTED
[16:27:37.513] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:37:0) after 7m36s
[16:35:13.539] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:37:0)
[16:35:13.558] Build status: STARTED
[16:35:13.558] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:38:0) after 8m33s
[16:43:46.610] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:38:0)
[16:43:46.646] Build status: STARTED
[16:43:46.646] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:39:0) after 4m41s
[16:48:27.701] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:39:0)
[16:48:27.716] Build status: STARTED
[16:48:27.716] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:40:0) after 8m17s
[16:56:44.772] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:40:0)
[16:56:44.950] Build status: STARTED
[16:56:44.950] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:41:0) after 1m5s
[16:57:50.077] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:41:0)
[16:57:50.123] Build status: STARTED
[16:57:50.123] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:42:0) after 2m49s
[17:00:39.145] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:42:0)
[17:00:39.178] Build status: STARTED
[17:00:39.178] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:43:0) after 1m4s
[17:01:43.164] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:43:0)
[17:01:43.192] Build status: STARTED
[17:01:43.192] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:44:0) after 5m39s
[17:07:22.275] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:44:0)
[17:07:22.299] Build status: STARTED
[17:07:22.299] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:45:0) after 3m3s
[17:10:25.289] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:45:0)
[17:10:25.358] Build status: STARTED
[17:10:25.358] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:46:0) after 8m11s
[17:18:36.523] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:46:0)
[17:18:36.541] Build status: STARTED
[17:18:36.541] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:47:0) after 4m2s
[17:22:38.676] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:47:0)
[17:22:38.728] Build status: STARTED
[17:22:38.728] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:48:0) after 1m25s
[17:24:03.711] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:48:0)
[17:24:03.737] Build status: STARTED
[17:24:03.737] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:49:0) after 4m30s
[17:28:33.764] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:49:0)
[17:28:33.794] Build status: STARTED
[17:28:33.794] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:50:0) after 4m59s
[17:33:32.822] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:50:0)
[17:33:32.841] Build status: STARTED
[17:33:32.841] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:51:0) after 2m43s
[17:36:15.935] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:51:0)
[17:36:15.953] Build status: STARTED
[17:36:15.953] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:52:0) after 8m21s
[17:44:37.022] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:52:0)
[17:44:37.049] Build status: STARTED
[17:44:37.049] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:53:0) after 3m22s
[17:47:59.066] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:53:0)
[17:47:59.086] Build status: STARTED
[17:47:59.086] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:54:0) after 6m1s
[17:54:00.064] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:54:0)
[17:54:00.090] Build status: STARTED
[17:54:00.091] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:55:0) after 7m5s
[18:01:05.122] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:55:0)
[18:01:05.201] Build status: STARTED
[18:01:05.201] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:56:0) after 3m40s
[18:04:45.334] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:56:0)
[18:04:45.357] Build status: STARTED
[18:04:45.357] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:57:0) after 8m50s
[18:13:35.429] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:57:0)
[18:13:35.447] Build status: STARTED
[18:13:35.447] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:58:0) after 7m24s
[18:20:59.492] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:58:0)
[18:20:59.564] Build status: STARTED
[18:20:59.564] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8852416898306861584:59:0) after 8m40s
[18:22:02.111] Received PubSub notification, asking Buildbucket for the build status
[18:22:02.132] Build:
{
"id": "8686986836187304817",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroidCoverage x86"
},
"number": 18084,
"createdBy": "project:chromium",
"createTime": "2026-03-18T13:33:09.576432956Z",
"startTime": "2026-03-18T13:33:20.910540289Z",
"endTime": "2026-03-18T18:22:01.839835992Z",
"updateTime": "2026-03-18T18:22:01.839835992Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9f0d55bb8e06d7d8dc96f49cf6d3c4f5902e1efe",
"ref": "refs/heads/main"
}
}
}
[18:22:02.132] Invocation finished in 4h48m53.960299922s with status FAILED