[10:45:46.635] New invocation is queued and will start shortly
[10:45:47.669] Starting the invocation (attempt 1)
[10:45:47.691] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/a299f3997ca3eeaf930b6980e7e9fe5487075533"
[10:45:47.691] Popped gitiles commit info from properties and tags
[10:45:47.692] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[10:45:47.692] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[10:45:47.692] Buildbucket request:
{
"requestId": "8836935346370655056",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroidCoverage x86"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a299f3997ca3eeaf930b6980e7e9fe5487075533",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8836935346370655056"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTAndroidCoverage x86"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[10:45:48.487] Scheduled build:
{
"id": "8671505284518831761",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroidCoverage x86"
},
"number": 21803,
"createdBy": "project:chromium",
"createTime": "2026-09-05T10:45:47.781833064Z",
"updateTime": "2026-09-05T10:45:47.781833064Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a299f3997ca3eeaf930b6980e7e9fe5487075533",
"ref": "refs/heads/main"
}
}
}
[10:45:48.487] Task URL: https://cr-buildbucket.appspot.com/build/8671505284518831761
[10:45:48.487] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:2:0) after 3m35s
[10:46:30.670] Received PubSub notification, asking Buildbucket for the build status
[10:46:30.697] Build status: STARTED
[10:46:35.765] Received PubSub notification, asking Buildbucket for the build status
[10:46:35.798] Build status: STARTED
[10:49:23.687] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:2:0)
[10:49:23.709] Build status: STARTED
[10:49:23.709] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:5:0) after 7m42s
[10:57:05.841] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:5:0)
[10:57:05.881] Build status: STARTED
[10:57:05.881] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:6:0) after 8m13s
[11:05:18.951] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:6:0)
[11:05:18.978] Build status: STARTED
[11:05:18.978] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:7:0) after 9m18s
[11:14:37.001] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:7:0)
[11:14:37.020] Build status: STARTED
[11:14:37.021] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:8:0) after 9m9s
[11:23:46.129] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:8:0)
[11:23:46.148] Build status: STARTED
[11:23:46.148] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:9:0) after 3m55s
[11:27:41.202] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:9:0)
[11:27:41.222] Build status: STARTED
[11:27:41.222] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:10:0) after 3m2s
[11:30:43.237] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:10:0)
[11:30:43.257] Build status: STARTED
[11:30:43.257] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:11:0) after 4m34s
[11:35:17.237] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:11:0)
[11:35:17.275] Build status: STARTED
[11:35:17.275] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:12:0) after 4m37s
[11:39:54.407] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:12:0)
[11:39:54.430] Build status: STARTED
[11:39:54.430] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:13:0) after 5m9s
[11:45:03.618] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:13:0)
[11:45:03.640] Build status: STARTED
[11:45:03.640] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:14:0) after 1m36s
[11:46:39.657] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:14:0)
[11:46:39.683] Build status: STARTED
[11:46:39.683] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:15:0) after 8m43s
[11:55:22.948] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:15:0)
[11:55:22.973] Build status: STARTED
[11:55:22.973] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:16:0) after 6m1s
[12:01:23.997] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:16:0)
[12:01:24.027] Build status: STARTED
[12:01:24.027] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:17:0) after 2m27s
[12:03:51.059] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:17:0)
[12:03:51.078] Build status: STARTED
[12:03:51.078] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:18:0) after 6m12s
[12:10:03.147] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:18:0)
[12:10:03.171] Build status: STARTED
[12:10:03.171] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:19:0) after 9m46s
[12:19:49.237] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:19:0)
[12:19:49.256] Build status: STARTED
[12:19:49.257] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:20:0) after 3m3s
[12:22:52.357] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:20:0)
[12:22:52.373] Build status: STARTED
[12:22:52.373] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:21:0) after 8m58s
[12:31:50.471] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:21:0)
[12:31:50.619] Build status: STARTED
[12:31:50.619] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:22:0) after 7m10s
[12:39:00.638] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:22:0)
[12:39:00.690] Build status: STARTED
[12:39:00.690] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:23:0) after 2m18s
[12:41:18.707] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:23:0)
[12:41:18.726] Build status: STARTED
[12:41:18.726] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:24:0) after 2m32s
[12:43:50.765] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:24:0)
[12:43:50.791] Build status: STARTED
[12:43:50.791] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:25:0) after 5m58s
[12:49:48.821] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:25:0)
[12:49:48.838] Build status: STARTED
[12:49:48.838] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:26:0) after 6m37s
[12:56:25.956] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:26:0)
[12:56:26.003] Build status: STARTED
[12:56:26.003] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:27:0) after 2m26s
[12:58:52.266] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:27:0)
[12:58:52.327] Build status: STARTED
[12:58:52.327] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:28:0) after 3m27s
[13:02:19.739] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:28:0)
[13:02:19.761] Build status: STARTED
[13:02:19.761] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:29:0) after 5m21s
[13:07:40.777] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:29:0)
[13:07:40.831] Build status: STARTED
[13:07:40.831] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:30:0) after 1m58s
[13:09:38.913] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:30:0)
[13:09:38.942] Build status: STARTED
[13:09:38.942] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:31:0) after 1m10s
[13:10:48.959] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:31:0)
[13:10:48.987] Build status: STARTED
[13:10:48.987] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:32:0) after 7m32s
[13:18:21.004] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:32:0)
[13:18:21.027] Build status: STARTED
[13:18:21.027] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:33:0) after 4m8s
[13:22:29.095] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:33:0)
[13:22:29.124] Build status: STARTED
[13:22:29.124] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:34:0) after 7m0s
[13:29:29.140] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:34:0)
[13:29:29.168] Build status: STARTED
[13:29:29.168] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:35:0) after 2m3s
[13:31:32.218] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:35:0)
[13:31:32.240] Build status: STARTED
[13:31:32.240] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:36:0) after 8m9s
[13:39:41.259] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:36:0)
[13:39:41.279] Build status: STARTED
[13:39:41.279] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:37:0) after 2m57s
[13:42:38.477] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:37:0)
[13:42:38.496] Build status: STARTED
[13:42:38.496] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:38:0) after 8m2s
[13:50:40.513] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:38:0)
[13:50:40.555] Build status: STARTED
[13:50:40.555] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:39:0) after 5m10s
[13:55:50.603] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:39:0)
[13:55:50.634] Build status: STARTED
[13:55:50.634] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:40:0) after 3m18s
[13:59:08.652] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:40:0)
[13:59:08.674] Build status: STARTED
[13:59:08.674] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:41:0) after 7m56s
[14:07:04.746] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:41:0)
[14:07:04.765] Build status: STARTED
[14:07:04.765] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:42:0) after 2m9s
[14:09:14.249] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:42:0)
[14:09:14.276] Build status: STARTED
[14:09:14.277] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:43:0) after 4m58s
[14:14:12.343] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:43:0)
[14:14:12.381] Build status: STARTED
[14:14:12.381] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:44:0) after 3m59s
[14:18:11.380] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:44:0)
[14:18:11.398] Build status: STARTED
[14:18:11.399] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:45:0) after 5m47s
[14:23:58.730] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:45:0)
[14:23:58.753] Build status: STARTED
[14:23:58.753] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:46:0) after 2m52s
[14:26:50.873] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:46:0)
[14:26:50.895] Build status: STARTED
[14:26:50.895] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:47:0) after 8m44s
[14:35:34.930] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:47:0)
[14:35:34.946] Build status: STARTED
[14:35:34.946] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:48:0) after 7m42s
[14:43:16.965] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:48:0)
[14:43:16.989] Build status: STARTED
[14:43:16.989] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:49:0) after 3m12s
[14:46:29.020] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:49:0)
[14:46:29.102] Build status: STARTED
[14:46:29.102] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:50:0) after 3m40s
[14:50:09.228] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:50:0)
[14:50:09.257] Build status: STARTED
[14:50:09.257] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:51:0) after 8m52s
[14:59:01.499] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:51:0)
[14:59:01.520] Build status: STARTED
[14:59:01.520] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:52:0) after 6m45s
[15:05:46.608] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:52:0)
[15:05:46.631] Build status: STARTED
[15:05:46.631] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:53:0) after 4m38s
[15:10:24.756] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:53:0)
[15:10:24.775] Build status: STARTED
[15:10:24.775] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:54:0) after 9m9s
[15:19:33.873] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:54:0)
[15:19:33.892] Build status: STARTED
[15:19:33.892] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:55:0) after 4m56s
[15:24:29.908] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:55:0)
[15:24:29.928] Build status: STARTED
[15:24:29.928] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:56:0) after 2m22s
[15:26:51.947] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:56:0)
[15:26:52.030] Build status: STARTED
[15:26:52.030] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:57:0) after 6m14s
[15:33:06.102] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:57:0)
[15:33:06.134] Build status: STARTED
[15:33:06.135] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:58:0) after 6m43s
[15:39:49.335] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:58:0)
[15:39:49.355] Build status: STARTED
[15:39:49.355] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8836935346370655056:59:0) after 4m28s
[15:43:44.997] Received PubSub notification, asking Buildbucket for the build status
[15:43:45.023] Build:
{
"id": "8671505284518831761",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroidCoverage x86"
},
"number": 21803,
"createdBy": "project:chromium",
"createTime": "2026-09-05T10:45:47.781833064Z",
"startTime": "2026-09-05T10:45:53.285582221Z",
"endTime": "2026-09-05T15:43:38.865996665Z",
"updateTime": "2026-09-05T15:43:38.865996665Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a299f3997ca3eeaf930b6980e7e9fe5487075533",
"ref": "refs/heads/main"
}
}
}
[15:43:45.023] Invocation finished in 4h57m58.39156661s with status FAILED