[16:27:54.942] New invocation is queued and will start shortly
[16:27:58.152] Starting the invocation (attempt 1)
[16:27:58.177] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/1ab056d16221a5cdb60cc34c6d0328eb1ec34bc7"
[16:27:58.177] Popped gitiles commit info from properties and tags
[16:27:58.177] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[16:27:58.177] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[16:27:58.177] Buildbucket request:
{
"requestId": "8845429935730779056",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroid64"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1ab056d16221a5cdb60cc34c6d0328eb1ec34bc7",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8845429935730779056"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTAndroid64"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[16:27:58.864] Scheduled build:
{
"id": "8679999871558241633",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroid64"
},
"number": 28992,
"createdBy": "project:chromium",
"createTime": "2026-06-03T16:27:58.293758389Z",
"updateTime": "2026-06-03T16:27:58.293758389Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1ab056d16221a5cdb60cc34c6d0328eb1ec34bc7",
"ref": "refs/heads/main"
}
}
}
[16:27:58.864] Task URL: https://cr-buildbucket.appspot.com/build/8679999871558241633
[16:27:58.864] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:2:0) after 9m53s
[16:27:59.884] Received PubSub notification, asking Buildbucket for the build status
[16:27:59.981] Build status: SCHEDULED
[16:28:53.315] Received PubSub notification, asking Buildbucket for the build status
[16:28:53.333] Build status: STARTED
[16:37:51.900] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:2:0)
[16:37:51.916] Build status: STARTED
[16:37:51.916] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:5:0) after 3m6s
[16:40:57.920] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:5:0)
[16:40:57.952] Build status: STARTED
[16:40:57.952] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:6:0) after 4m34s
[16:45:31.971] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:6:0)
[16:45:31.984] Build status: STARTED
[16:45:31.984] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:7:0) after 7m52s
[16:53:24.003] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:7:0)
[16:53:24.017] Build status: STARTED
[16:53:24.017] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:8:0) after 1m56s
[16:55:20.038] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:8:0)
[16:55:20.055] Build status: STARTED
[16:55:20.055] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:9:0) after 2m10s
[16:57:30.071] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:9:0)
[16:57:30.088] Build status: STARTED
[16:57:30.088] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:10:0) after 8m40s
[17:06:10.108] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:10:0)
[17:06:10.130] Build status: STARTED
[17:06:10.130] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:11:0) after 8m34s
[17:14:44.229] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:11:0)
[17:14:44.248] Build status: STARTED
[17:14:44.248] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:12:0) after 8m30s
[17:23:14.217] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:12:0)
[17:23:14.234] Build status: STARTED
[17:23:14.234] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:13:0) after 6m58s
[17:30:12.325] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:13:0)
[17:30:12.343] Build status: STARTED
[17:30:12.343] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:14:0) after 5m59s
[17:36:11.406] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:14:0)
[17:36:11.423] Build status: STARTED
[17:36:11.423] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:15:0) after 3m44s
[17:39:55.433] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:15:0)
[17:39:55.461] Build status: STARTED
[17:39:55.461] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:16:0) after 3m36s
[17:43:31.481] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:16:0)
[17:43:31.494] Build status: STARTED
[17:43:31.494] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:17:0) after 9m59s
[17:53:30.716] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:17:0)
[17:53:30.736] Build status: STARTED
[17:53:30.736] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:18:0) after 2m26s
[17:55:56.762] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:18:0)
[17:55:56.782] Build status: STARTED
[17:55:56.782] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:19:0) after 5m33s
[18:01:29.803] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:19:0)
[18:01:29.825] Build status: STARTED
[18:01:29.825] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:20:0) after 9m16s
[18:10:45.839] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:20:0)
[18:10:45.871] Build status: STARTED
[18:10:45.871] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:21:0) after 6m11s
[18:16:56.962] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:21:0)
[18:16:56.976] Build status: STARTED
[18:16:56.976] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:22:0) after 2m33s
[18:19:30.028] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:22:0)
[18:19:30.052] Build status: STARTED
[18:19:30.052] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:23:0) after 3m57s
[18:23:27.066] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:23:0)
[18:23:27.095] Build status: STARTED
[18:23:27.095] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:24:0) after 7m56s
[18:31:23.191] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:24:0)
[18:31:23.223] Build status: STARTED
[18:31:23.223] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:25:0) after 6m26s
[18:37:49.375] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:25:0)
[18:37:49.418] Build status: STARTED
[18:37:49.418] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:26:0) after 7m5s
[18:44:54.444] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:26:0)
[18:44:54.505] Build status: STARTED
[18:44:54.505] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:27:0) after 4m36s
[18:49:30.552] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:27:0)
[18:49:30.594] Build status: STARTED
[18:49:30.594] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:28:0) after 7m27s
[18:56:57.623] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:28:0)
[18:56:57.641] Build status: STARTED
[18:56:57.641] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:29:0) after 2m50s
[18:59:47.675] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:29:0)
[18:59:47.689] Build status: STARTED
[18:59:47.689] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:30:0) after 5m2s
[19:04:49.738] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:30:0)
[19:04:49.757] Build status: STARTED
[19:04:49.757] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:31:0) after 3m32s
[19:08:21.778] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:31:0)
[19:08:21.797] Build status: STARTED
[19:08:21.797] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:32:0) after 9m21s
[19:17:42.822] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:32:0)
[19:17:42.859] Build status: STARTED
[19:17:42.859] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:33:0) after 9m47s
[19:27:29.931] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:33:0)
[19:27:29.957] Build status: STARTED
[19:27:29.957] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:34:0) after 7m56s
[19:35:25.940] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:34:0)
[19:35:25.972] Build status: STARTED
[19:35:25.972] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:35:0) after 8m0s
[19:43:26.087] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:35:0)
[19:43:26.105] Build status: STARTED
[19:43:26.105] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:36:0) after 7m35s
[19:51:01.086] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:36:0)
[19:51:01.127] Build status: STARTED
[19:51:01.128] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:37:0) after 9m28s
[20:00:29.152] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:37:0)
[20:00:29.255] Build status: STARTED
[20:00:29.255] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:38:0) after 5m15s
[20:05:44.373] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:38:0)
[20:05:44.396] Build status: STARTED
[20:05:44.396] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:39:0) after 9m24s
[20:15:08.440] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:39:0)
[20:15:08.473] Build status: STARTED
[20:15:08.473] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:40:0) after 6m51s
[20:21:59.581] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:40:0)
[20:21:59.609] Build status: STARTED
[20:21:59.609] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:41:0) after 7m6s
[20:29:05.766] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:41:0)
[20:29:05.779] Build status: STARTED
[20:29:05.779] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:42:0) after 4m39s
[20:33:44.841] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:42:0)
[20:33:44.860] Build status: STARTED
[20:33:44.860] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:43:0) after 3m36s
[20:37:20.992] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:43:0)
[20:37:21.017] Build status: STARTED
[20:37:21.017] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:44:0) after 2m46s
[20:40:07.088] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:44:0)
[20:40:07.122] Build status: STARTED
[20:40:07.122] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:45:0) after 8m14s
[20:48:21.139] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:45:0)
[20:48:21.159] Build status: STARTED
[20:48:21.159] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:46:0) after 9m36s
[20:57:57.324] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:46:0)
[20:57:57.383] Build status: STARTED
[20:57:57.383] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:47:0) after 5m25s
[21:03:22.405] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:47:0)
[21:03:22.426] Build status: STARTED
[21:03:22.426] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:48:0) after 4m14s
[21:07:36.517] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:48:0)
[21:07:36.536] Build status: STARTED
[21:07:36.536] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:49:0) after 2m43s
[21:10:19.650] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:49:0)
[21:10:19.695] Build status: STARTED
[21:10:19.695] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8845429935730779056:50:0) after 5m19s
[21:15:00.942] Received PubSub notification, asking Buildbucket for the build status
[21:15:00.959] Build:
{
"id": "8679999871558241633",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroid64"
},
"number": 28992,
"createdBy": "project:chromium",
"createTime": "2026-06-03T16:27:58.293758389Z",
"startTime": "2026-06-03T16:28:53.143055734Z",
"endTime": "2026-06-03T21:15:00.686335946Z",
"updateTime": "2026-06-03T21:15:00.686335946Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1ab056d16221a5cdb60cc34c6d0328eb1ec34bc7",
"ref": "refs/heads/main"
}
}
}
[21:15:00.959] Invocation finished in 4h47m6.028616s with status FAILED