[22:30:09.324] New invocation is queued and will start shortly
[22:30:10.547] Starting the invocation (attempt 1)
[22:30:10.578] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/d99e861d869d21834bd76fb9b5493f6cc98da88f"
[22:30:10.578] Popped gitiles commit info from properties and tags
[22:30:10.578] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[22:30:10.578] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[22:30:10.579] Buildbucket request:
{
"requestId": "8853107887718221600",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroidCoverage x86"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d99e861d869d21834bd76fb9b5493f6cc98da88f",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8853107887718221600"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTAndroidCoverage x86"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[22:30:11.281] Scheduled build:
{
"id": "8687677825686570305",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroidCoverage x86"
},
"number": 18011,
"createdBy": "project:chromium",
"createTime": "2026-03-10T22:30:10.638050017Z",
"updateTime": "2026-03-10T22:30:10.638050017Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d99e861d869d21834bd76fb9b5493f6cc98da88f",
"ref": "refs/heads/main"
}
}
}
[22:30:11.281] Task URL: https://cr-buildbucket.appspot.com/build/8687677825686570305
[22:30:11.282] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:2:0) after 1m57s
[22:30:12.231] Received PubSub notification, asking Buildbucket for the build status
[22:30:12.311] Build status: SCHEDULED
[22:31:04.292] Received PubSub notification, asking Buildbucket for the build status
[22:31:04.309] Build status: STARTED
[22:32:08.298] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:2:0)
[22:32:08.331] Build status: STARTED
[22:32:08.331] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:5:0) after 8m32s
[22:40:40.355] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:5:0)
[22:40:40.378] Build status: STARTED
[22:40:40.378] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:6:0) after 4m2s
[22:44:42.394] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:6:0)
[22:44:42.417] Build status: STARTED
[22:44:42.417] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:7:0) after 4m4s
[22:48:46.483] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:7:0)
[22:48:46.500] Build status: STARTED
[22:48:46.500] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:8:0) after 1m24s
[22:50:10.518] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:8:0)
[22:50:10.642] Build status: STARTED
[22:50:10.642] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:9:0) after 8m30s
[22:58:40.662] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:9:0)
[22:58:40.680] Build status: STARTED
[22:58:40.680] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:10:0) after 3m32s
[23:02:12.699] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:10:0)
[23:02:12.714] Build status: STARTED
[23:02:12.714] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:11:0) after 6m37s
[23:08:49.777] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:11:0)
[23:08:49.795] Build status: STARTED
[23:08:49.795] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:12:0) after 9m22s
[23:18:11.817] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:12:0)
[23:18:11.832] Build status: STARTED
[23:18:11.832] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:13:0) after 3m24s
[23:21:35.845] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:13:0)
[23:21:35.868] Build status: STARTED
[23:21:35.868] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:14:0) after 7m30s
[23:29:05.914] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:14:0)
[23:29:05.930] Build status: STARTED
[23:29:05.931] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:15:0) after 2m28s
[23:31:33.989] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:15:0)
[23:31:34.007] Build status: STARTED
[23:31:34.007] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:16:0) after 8m13s
[23:39:47.071] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:16:0)
[23:39:47.111] Build status: STARTED
[23:39:47.111] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:17:0) after 2m40s
[23:42:27.150] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:17:0)
[23:42:27.173] Build status: STARTED
[23:42:27.173] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:18:0) after 3m57s
[23:46:24.242] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:18:0)
[23:46:24.286] Build status: STARTED
[23:46:24.286] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:19:0) after 2m24s
[23:48:48.342] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:19:0)
[23:48:48.363] Build status: STARTED
[23:48:48.364] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:20:0) after 3m26s
[23:52:14.433] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:20:0)
[23:52:14.454] Build status: STARTED
[23:52:14.454] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:21:0) after 2m53s
[23:55:07.554] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:21:0)
[23:55:07.571] Build status: STARTED
[23:55:07.571] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:22:0) after 5m32s
[00:00:40.343] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:22:0)
[00:00:40.358] Build status: STARTED
[00:00:40.358] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:23:0) after 4m50s
[00:05:30.426] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:23:0)
[00:05:30.443] Build status: STARTED
[00:05:30.443] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:24:0) after 4m55s
[00:10:25.460] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:24:0)
[00:10:25.481] Build status: STARTED
[00:10:25.481] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:25:0) after 8m55s
[00:19:20.593] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:25:0)
[00:19:20.608] Build status: STARTED
[00:19:20.609] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:26:0) after 9m22s
[00:28:42.676] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:26:0)
[00:28:42.696] Build status: STARTED
[00:28:42.696] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:27:0) after 7m45s
[00:36:27.703] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:27:0)
[00:36:27.716] Build status: STARTED
[00:36:27.716] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:28:0) after 3m35s
[00:40:02.821] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:28:0)
[00:40:02.869] Build status: STARTED
[00:40:02.869] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:29:0) after 1m1s
[00:41:04.101] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:29:0)
[00:41:04.207] Build status: STARTED
[00:41:04.207] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:30:0) after 5m9s
[00:46:13.681] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:30:0)
[00:46:13.699] Build status: STARTED
[00:46:13.699] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:31:0) after 9m54s
[00:56:07.808] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:31:0)
[00:56:07.837] Build status: STARTED
[00:56:07.837] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:32:0) after 7m46s
[01:03:53.853] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:32:0)
[01:03:53.892] Build status: STARTED
[01:03:53.893] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:33:0) after 3m11s
[01:07:04.914] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:33:0)
[01:07:04.956] Build status: STARTED
[01:07:04.956] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:34:0) after 2m59s
[01:10:03.974] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:34:0)
[01:10:04.016] Build status: STARTED
[01:10:04.016] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:35:0) after 9m17s
[01:19:21.035] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:35:0)
[01:19:21.087] Build status: STARTED
[01:19:21.087] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:36:0) after 5m31s
[01:24:52.107] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:36:0)
[01:24:52.172] Build status: STARTED
[01:24:52.172] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:37:0) after 9m34s
[01:34:26.189] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:37:0)
[01:34:26.213] Build status: STARTED
[01:34:26.213] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:38:0) after 9m21s
[01:43:47.279] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:38:0)
[01:43:47.302] Build status: STARTED
[01:43:47.302] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:39:0) after 7m23s
[01:51:10.324] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:39:0)
[01:51:10.443] Build status: STARTED
[01:51:10.443] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:40:0) after 4m48s
[01:55:58.468] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:40:0)
[01:55:58.518] Build status: STARTED
[01:55:58.518] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:41:0) after 9m26s
[02:05:24.587] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:41:0)
[02:05:24.606] Build status: STARTED
[02:05:24.606] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:42:0) after 8m58s
[02:14:22.695] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:42:0)
[02:14:22.731] Build status: STARTED
[02:14:22.731] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:43:0) after 7m52s
[02:22:14.806] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:43:0)
[02:22:14.902] Build status: STARTED
[02:22:14.902] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:44:0) after 1m8s
[02:23:22.968] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:44:0)
[02:23:22.988] Build status: STARTED
[02:23:22.988] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:45:0) after 5m22s
[02:28:45.117] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:45:0)
[02:28:45.135] Build status: STARTED
[02:28:45.135] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:46:0) after 8m49s
[02:37:34.215] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:46:0)
[02:37:34.244] Build status: STARTED
[02:37:34.244] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:47:0) after 5m15s
[02:42:49.254] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:47:0)
[02:42:49.272] Build status: STARTED
[02:42:49.272] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:48:0) after 4m42s
[02:47:31.294] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:48:0)
[02:47:31.312] Build status: STARTED
[02:47:31.312] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:49:0) after 8m38s
[02:56:09.379] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:49:0)
[02:56:09.402] Build status: STARTED
[02:56:09.402] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:50:0) after 9m24s
[03:05:33.447] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:50:0)
[03:05:33.469] Build status: STARTED
[03:05:33.469] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:51:0) after 1m26s
[03:06:59.509] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:51:0)
[03:06:59.565] Build status: STARTED
[03:06:59.565] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:52:0) after 1m16s
[03:08:15.568] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:52:0)
[03:08:15.596] Build status: STARTED
[03:08:15.596] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:53:0) after 8m38s
[03:16:53.753] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:53:0)
[03:16:53.769] Build status: STARTED
[03:16:53.769] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:54:0) after 3m58s
[03:20:51.816] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:54:0)
[03:20:51.833] Build status: STARTED
[03:20:51.833] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:55:0) after 8m49s
[03:29:40.876] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:55:0)
[03:29:40.893] Build status: STARTED
[03:29:40.893] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:56:0) after 3m9s
[03:32:49.998] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:56:0)
[03:32:50.015] Build status: STARTED
[03:32:50.015] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8853107887718221600:57:0) after 4m24s
[03:35:50.075] Received PubSub notification, asking Buildbucket for the build status
[03:35:50.093] Build:
{
"id": "8687677825686570305",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroidCoverage x86"
},
"number": 18011,
"createdBy": "project:chromium",
"createTime": "2026-03-10T22:30:10.638050017Z",
"startTime": "2026-03-10T22:31:04.085056792Z",
"endTime": "2026-03-11T03:35:49.634243736Z",
"updateTime": "2026-03-11T03:35:49.634243736Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d99e861d869d21834bd76fb9b5493f6cc98da88f",
"ref": "refs/heads/main"
}
}
}
[03:35:50.093] Invocation finished in 5h5m40.776398623s with status FAILED