[16:19:47.742] New invocation is queued and will start shortly
[16:19:50.467] Starting the invocation (attempt 1)
[16:19:50.499] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/7500ea704f3ad43f6bcc95c50a64f851e4802eb1"
[16:19:50.499] Popped gitiles commit info from properties and tags
[16:19:50.499] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[16:19:50.499] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[16:19:50.499] Buildbucket request:
{
"requestId": "8851862831206288112",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroid64"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7500ea704f3ad43f6bcc95c50a64f851e4802eb1",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8851862831206288112"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTAndroid64"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[16:19:51.006] Scheduled build:
{
"id": "8686432767603344929",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroid64"
},
"number": 28050,
"createdBy": "project:chromium",
"createTime": "2026-03-24T16:19:50.555179589Z",
"updateTime": "2026-03-24T16:19:50.555179589Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7500ea704f3ad43f6bcc95c50a64f851e4802eb1",
"ref": "refs/heads/main"
}
}
}
[16:19:51.006] Task URL: https://cr-buildbucket.appspot.com/build/8686432767603344929
[16:19:51.006] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:2:0) after 8m55s
[16:19:51.934] Received PubSub notification, asking Buildbucket for the build status
[16:19:51.965] Build status: SCHEDULED
[16:20:57.936] Received PubSub notification, asking Buildbucket for the build status
[16:20:58.078] Build status: STARTED
[16:28:46.124] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:2:0)
[16:28:46.139] Build status: STARTED
[16:28:46.139] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:5:0) after 7m46s
[16:36:32.157] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:5:0)
[16:36:32.173] Build status: STARTED
[16:36:32.173] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:6:0) after 7m44s
[16:44:16.256] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:6:0)
[16:44:16.280] Build status: STARTED
[16:44:16.280] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:7:0) after 8m17s
[16:52:33.317] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:7:0)
[16:52:33.355] Build status: STARTED
[16:52:33.355] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:8:0) after 3m4s
[16:55:37.370] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:8:0)
[16:55:37.393] Build status: STARTED
[16:55:37.393] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:9:0) after 6m31s
[17:02:08.461] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:9:0)
[17:02:08.482] Build status: STARTED
[17:02:08.482] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:10:0) after 9m17s
[17:11:25.588] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:10:0)
[17:11:25.617] Build status: STARTED
[17:11:25.617] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:11:0) after 9m47s
[17:21:12.646] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:11:0)
[17:21:12.675] Build status: STARTED
[17:21:12.675] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:12:0) after 5m33s
[17:26:45.804] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:12:0)
[17:26:45.839] Build status: STARTED
[17:26:45.839] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:13:0) after 2m49s
[17:29:35.007] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:13:0)
[17:29:35.027] Build status: STARTED
[17:29:35.027] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:14:0) after 8m58s
[17:38:33.011] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:14:0)
[17:38:33.028] Build status: STARTED
[17:38:33.028] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:15:0) after 1m37s
[17:40:10.247] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:15:0)
[17:40:10.272] Build status: STARTED
[17:40:10.272] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:16:0) after 9m25s
[17:49:35.317] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:16:0)
[17:49:35.349] Build status: STARTED
[17:49:35.349] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:17:0) after 9m11s
[17:58:46.476] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:17:0)
[17:58:46.497] Build status: STARTED
[17:58:46.497] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:18:0) after 8m43s
[18:07:29.608] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:18:0)
[18:07:29.632] Build status: STARTED
[18:07:29.632] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:19:0) after 3m20s
[18:10:49.652] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:19:0)
[18:10:49.668] Build status: STARTED
[18:10:49.668] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:20:0) after 4m30s
[18:15:19.700] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:20:0)
[18:15:19.863] Build status: STARTED
[18:15:19.863] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:21:0) after 3m38s
[18:18:57.932] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:21:0)
[18:18:57.960] Build status: STARTED
[18:18:57.960] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:22:0) after 4m17s
[18:23:15.300] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:22:0)
[18:23:15.323] Build status: STARTED
[18:23:15.323] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:23:0) after 4m54s
[18:28:09.395] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:23:0)
[18:28:09.420] Build status: STARTED
[18:28:09.420] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:24:0) after 3m36s
[18:31:45.460] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:24:0)
[18:31:45.477] Build status: STARTED
[18:31:45.477] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:25:0) after 3m8s
[18:34:53.469] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:25:0)
[18:34:53.505] Build status: STARTED
[18:34:53.505] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:26:0) after 1m49s
[18:36:42.489] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:26:0)
[18:36:42.521] Build status: STARTED
[18:36:42.521] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:27:0) after 3m13s
[18:39:55.645] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:27:0)
[18:39:55.745] Build status: STARTED
[18:39:55.745] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:28:0) after 2m9s
[18:42:04.824] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:28:0)
[18:42:04.847] Build status: STARTED
[18:42:04.847] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:29:0) after 6m35s
[18:48:39.905] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:29:0)
[18:48:39.944] Build status: STARTED
[18:48:39.944] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:30:0) after 9m56s
[18:58:35.913] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:30:0)
[18:58:35.928] Build status: STARTED
[18:58:35.928] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:31:0) after 8m19s
[19:06:54.992] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:31:0)
[19:06:55.006] Build status: STARTED
[19:06:55.006] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:32:0) after 4m53s
[19:11:48.185] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:32:0)
[19:11:48.244] Build status: STARTED
[19:11:48.244] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:33:0) after 9m17s
[19:21:05.332] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:33:0)
[19:21:05.410] Build status: STARTED
[19:21:05.410] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:34:0) after 4m44s
[19:25:49.465] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:34:0)
[19:25:49.481] Build status: STARTED
[19:25:49.481] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:35:0) after 7m36s
[19:33:25.535] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:35:0)
[19:33:25.555] Build status: STARTED
[19:33:25.555] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:36:0) after 4m30s
[19:37:55.577] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:36:0)
[19:37:55.592] Build status: STARTED
[19:37:55.592] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:37:0) after 9m4s
[19:46:59.664] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:37:0)
[19:46:59.683] Build status: STARTED
[19:46:59.683] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:38:0) after 4m15s
[19:51:14.704] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:38:0)
[19:51:14.728] Build status: STARTED
[19:51:14.728] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:39:0) after 7m42s
[19:58:56.787] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:39:0)
[19:58:56.809] Build status: STARTED
[19:58:56.809] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:40:0) after 8m42s
[20:07:38.923] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:40:0)
[20:07:38.939] Build status: STARTED
[20:07:38.939] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:41:0) after 3m4s
[20:10:43.070] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:41:0)
[20:10:43.086] Build status: STARTED
[20:10:43.086] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:42:0) after 1m40s
[20:12:23.300] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:42:0)
[20:12:23.318] Build status: STARTED
[20:12:23.319] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:43:0) after 9m23s
[20:21:46.392] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:43:0)
[20:21:46.425] Build status: STARTED
[20:21:46.425] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:44:0) after 5m35s
[20:27:21.493] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:44:0)
[20:27:21.511] Build status: STARTED
[20:27:21.511] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:45:0) after 8m40s
[20:36:01.534] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:45:0)
[20:36:01.552] Build status: STARTED
[20:36:01.552] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:46:0) after 4m2s
[20:40:03.578] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:46:0)
[20:40:03.601] Build status: STARTED
[20:40:03.601] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:47:0) after 6m35s
[20:46:38.724] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:47:0)
[20:46:38.746] Build status: STARTED
[20:46:38.746] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:48:0) after 5m22s
[20:52:00.804] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:48:0)
[20:52:00.822] Build status: STARTED
[20:52:00.822] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:49:0) after 6m19s
[20:58:19.841] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:49:0)
[20:58:19.868] Build status: STARTED
[20:58:19.868] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:8851862831206288112:50:0) after 8m2s
[21:03:00.044] Received PubSub notification, asking Buildbucket for the build status
[21:03:00.076] Build:
{
"id": "8686432767603344929",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroid64"
},
"number": 28050,
"createdBy": "project:chromium",
"createTime": "2026-03-24T16:19:50.555179589Z",
"startTime": "2026-03-24T16:20:57.759511547Z",
"endTime": "2026-03-24T21:02:59.509556956Z",
"updateTime": "2026-03-24T21:02:59.509556956Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7500ea704f3ad43f6bcc95c50a64f851e4802eb1",
"ref": "refs/heads/main"
}
}
}
[21:03:00.076] Invocation finished in 4h43m12.340435971s with status FAILED