[02:57:51.221] New invocation is queued and will start shortly
[02:57:52.288] Starting the invocation (attempt 1)
[02:57:52.321] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/e6fc0a408a9703e37df73c7340fccf7a7e4ba578"
[02:57:52.321] Popped gitiles commit info from properties and tags
[02:57:52.321] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[02:57:52.321] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[02:57:52.321] Buildbucket request:
{
"requestId": "8837689561308744320",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroidCoverage x86"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e6fc0a408a9703e37df73c7340fccf7a7e4ba578",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8837689561308744320"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTAndroidCoverage x86"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[02:57:52.885] Scheduled build:
{
"id": "8672259499424034225",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroidCoverage x86"
},
"number": 21759,
"createdBy": "project:chromium",
"createTime": "2026-08-28T02:57:52.397345530Z",
"updateTime": "2026-08-28T02:57:52.397345530Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e6fc0a408a9703e37df73c7340fccf7a7e4ba578",
"ref": "refs/heads/main"
}
}
}
[02:57:52.885] Task URL: https://cr-buildbucket.appspot.com/build/8672259499424034225
[02:57:52.885] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:2:0) after 1m1s
[02:57:53.820] Received PubSub notification, asking Buildbucket for the build status
[02:57:53.848] Build status: SCHEDULED
[02:57:57.498] Received PubSub notification, asking Buildbucket for the build status
[02:57:57.522] Build status: STARTED
[02:58:53.969] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:2:0)
[02:58:54.006] Build status: STARTED
[02:58:54.007] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:5:0) after 1m21s
[03:00:15.044] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:5:0)
[03:00:15.114] Build status: STARTED
[03:00:15.114] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:6:0) after 2m49s
[03:03:04.135] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:6:0)
[03:03:04.216] Build status: STARTED
[03:03:04.216] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:7:0) after 7m23s
[03:10:27.301] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:7:0)
[03:10:27.336] Build status: STARTED
[03:10:27.336] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:8:0) after 8m36s
[03:19:03.407] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:8:0)
[03:19:03.450] Build status: STARTED
[03:19:03.450] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:9:0) after 8m28s
[03:27:31.522] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:9:0)
[03:27:31.547] Build status: STARTED
[03:27:31.548] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:10:0) after 8m22s
[03:35:53.707] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:10:0)
[03:35:53.735] Build status: STARTED
[03:35:53.735] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:11:0) after 8m18s
[03:44:11.800] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:11:0)
[03:44:11.821] Build status: STARTED
[03:44:11.821] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:12:0) after 9m15s
[03:53:26.957] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:12:0)
[03:53:27.029] Build status: STARTED
[03:53:27.029] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:13:0) after 4m39s
[03:58:06.048] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:13:0)
[03:58:06.094] Build status: STARTED
[03:58:06.094] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:14:0) after 1m13s
[03:59:19.114] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:14:0)
[03:59:19.133] Build status: STARTED
[03:59:19.133] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:15:0) after 2m20s
[04:01:39.214] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:15:0)
[04:01:39.263] Build status: STARTED
[04:01:39.263] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:16:0) after 2m51s
[04:04:30.248] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:16:0)
[04:04:30.274] Build status: STARTED
[04:04:30.274] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:17:0) after 5m9s
[04:09:39.386] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:17:0)
[04:09:39.411] Build status: STARTED
[04:09:39.411] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:18:0) after 3m41s
[04:13:20.399] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:18:0)
[04:13:20.416] Build status: STARTED
[04:13:20.416] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:19:0) after 2m24s
[04:15:44.436] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:19:0)
[04:15:44.457] Build status: STARTED
[04:15:44.457] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:20:0) after 1m53s
[04:17:37.501] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:20:0)
[04:17:37.524] Build status: STARTED
[04:17:37.524] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:21:0) after 7m22s
[04:24:59.546] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:21:0)
[04:24:59.599] Build status: STARTED
[04:24:59.599] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:22:0) after 3m26s
[04:28:25.665] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:22:0)
[04:28:25.737] Build status: STARTED
[04:28:25.737] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:23:0) after 5m41s
[04:34:06.778] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:23:0)
[04:34:06.805] Build status: STARTED
[04:34:06.805] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:24:0) after 7m38s
[04:41:44.879] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:24:0)
[04:41:44.919] Build status: STARTED
[04:41:44.919] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:25:0) after 6m47s
[04:48:31.988] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:25:0)
[04:48:32.061] Build status: STARTED
[04:48:32.061] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:26:0) after 1m27s
[04:49:59.081] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:26:0)
[04:49:59.102] Build status: STARTED
[04:49:59.102] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:27:0) after 3m32s
[04:53:31.084] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:27:0)
[04:53:31.105] Build status: STARTED
[04:53:31.105] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:28:0) after 7m39s
[05:01:10.241] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:28:0)
[05:01:10.317] Build status: STARTED
[05:01:10.317] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:29:0) after 1m8s
[05:02:18.340] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:29:0)
[05:02:18.365] Build status: STARTED
[05:02:18.365] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:30:0) after 2m7s
[05:04:25.378] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:30:0)
[05:04:25.408] Build status: STARTED
[05:04:25.408] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:31:0) after 7m12s
[05:11:37.500] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:31:0)
[05:11:37.567] Build status: STARTED
[05:11:37.567] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:32:0) after 4m58s
[05:16:35.588] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:32:0)
[05:16:35.607] Build status: STARTED
[05:16:35.607] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:33:0) after 7m54s
[05:24:29.624] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:33:0)
[05:24:29.645] Build status: STARTED
[05:24:29.645] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:34:0) after 7m16s
[05:31:45.668] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:34:0)
[05:31:45.691] Build status: STARTED
[05:31:45.691] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:35:0) after 1m34s
[05:33:19.720] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:35:0)
[05:33:19.777] Build status: STARTED
[05:33:19.777] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:36:0) after 3m58s
[05:37:17.797] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:36:0)
[05:37:17.817] Build status: STARTED
[05:37:17.817] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:37:0) after 7m46s
[05:45:03.907] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:37:0)
[05:45:03.928] Build status: STARTED
[05:45:03.928] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:38:0) after 5m34s
[05:50:37.952] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:38:0)
[05:50:38.000] Build status: STARTED
[05:50:38.001] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:39:0) after 4m6s
[05:54:44.022] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:39:0)
[05:54:44.039] Build status: STARTED
[05:54:44.039] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:40:0) after 1m8s
[05:55:52.122] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:40:0)
[05:55:52.160] Build status: STARTED
[05:55:52.160] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:41:0) after 1m5s
[05:56:57.186] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:41:0)
[05:56:57.283] Build status: STARTED
[05:56:57.284] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:42:0) after 3m58s
[06:00:55.307] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:42:0)
[06:00:55.330] Build status: STARTED
[06:00:55.330] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:43:0) after 2m4s
[06:02:59.560] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:43:0)
[06:02:59.583] Build status: STARTED
[06:02:59.583] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:44:0) after 3m31s
[06:06:30.612] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:44:0)
[06:06:30.637] Build status: STARTED
[06:06:30.637] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:45:0) after 4m7s
[06:10:37.657] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:45:0)
[06:10:37.675] Build status: STARTED
[06:10:37.676] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:46:0) after 8m58s
[06:19:35.807] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:46:0)
[06:19:35.860] Build status: STARTED
[06:19:35.860] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:47:0) after 5m33s
[06:25:08.852] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:47:0)
[06:25:08.876] Build status: STARTED
[06:25:08.876] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:48:0) after 8m59s
[06:34:07.932] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:48:0)
[06:34:07.951] Build status: STARTED
[06:34:07.952] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:49:0) after 1m37s
[06:35:45.018] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:49:0)
[06:35:45.039] Build status: STARTED
[06:35:45.039] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:50:0) after 5m20s
[06:41:05.116] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:50:0)
[06:41:05.206] Build status: STARTED
[06:41:05.206] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:51:0) after 3m8s
[06:44:13.247] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:51:0)
[06:44:13.267] Build status: STARTED
[06:44:13.268] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:52:0) after 2m23s
[06:46:36.290] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:52:0)
[06:46:36.343] Build status: STARTED
[06:46:36.343] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:53:0) after 6m7s
[06:52:43.364] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:53:0)
[06:52:43.385] Build status: STARTED
[06:52:43.385] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:54:0) after 4m16s
[06:56:59.374] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:54:0)
[06:56:59.403] Build status: STARTED
[06:56:59.403] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:55:0) after 7m54s
[07:04:53.473] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:55:0)
[07:04:53.494] Build status: STARTED
[07:04:53.494] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:56:0) after 7m41s
[07:12:34.662] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:56:0)
[07:12:34.688] Build status: STARTED
[07:12:34.688] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:57:0) after 8m10s
[07:20:44.871] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:57:0)
[07:20:44.968] Build status: STARTED
[07:20:44.968] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:58:0) after 4m25s
[07:25:09.987] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:58:0)
[07:25:10.163] Build status: STARTED
[07:25:10.163] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:59:0) after 3m56s
[07:29:06.264] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:59:0)
[07:29:06.286] Build status: STARTED
[07:29:06.286] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:60:0) after 9m15s
[07:38:21.312] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:60:0)
[07:38:21.329] Build status: STARTED
[07:38:21.329] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:61:0) after 8m19s
[07:46:40.355] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:61:0)
[07:46:40.392] Build status: STARTED
[07:46:40.392] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:62:0) after 9m54s
[07:56:34.547] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:62:0)
[07:56:34.562] Build status: STARTED
[07:56:34.562] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:63:0) after 6m16s
[08:02:50.608] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:63:0)
[08:02:50.630] Build status: STARTED
[08:02:50.630] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8837689561308744320:64:0) after 7m55s
[08:08:43.569] Received PubSub notification, asking Buildbucket for the build status
[08:08:43.607] Build:
{
"id": "8672259499424034225",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroidCoverage x86"
},
"number": 21759,
"createdBy": "project:chromium",
"createTime": "2026-08-28T02:57:52.397345530Z",
"startTime": "2026-08-28T02:57:57.325286734Z",
"endTime": "2026-08-28T08:08:43.231345681Z",
"updateTime": "2026-08-28T08:08:43.231345681Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e6fc0a408a9703e37df73c7340fccf7a7e4ba578",
"ref": "refs/heads/main"
}
}
}
[08:08:43.607] Invocation finished in 5h10m52.391260943s with status FAILED