[19:04:16.333] New invocation is queued and will start shortly
[19:04:17.447] Starting the invocation (attempt 1)
[19:04:17.471] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/af49740d087aa52b97ce698dfe65a35d483d4d41"
[19:04:17.471] Popped gitiles commit info from properties and tags
[19:04:17.471] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[19:04:17.471] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[19:04:17.471] Buildbucket request:
{
"requestId": "8841886816932335520",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroidOfficial"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "af49740d087aa52b97ce698dfe65a35d483d4d41",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8841886816932335520"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTAndroidOfficial"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[19:04:17.983] Scheduled build:
{
"id": "8676456755019640769",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroidOfficial"
},
"number": 27501,
"createdBy": "project:chromium",
"createTime": "2026-07-12T19:04:17.536125088Z",
"updateTime": "2026-07-12T19:04:17.536125088Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "af49740d087aa52b97ce698dfe65a35d483d4d41",
"ref": "refs/heads/main"
}
}
}
[19:04:17.983] Task URL: https://cr-buildbucket.appspot.com/build/8676456755019640769
[19:04:17.983] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:2:0) after 7m32s
[19:04:18.614] Received PubSub notification, asking Buildbucket for the build status
[19:04:18.632] Build status: SCHEDULED
[19:05:44.190] Received PubSub notification, asking Buildbucket for the build status
[19:05:44.218] Build status: STARTED
[19:11:50.105] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:2:0)
[19:11:50.121] Build status: STARTED
[19:11:50.121] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:5:0) after 3m55s
[19:15:45.354] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:5:0)
[19:15:45.376] Build status: STARTED
[19:15:45.376] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:6:0) after 6m14s
[19:21:59.390] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:6:0)
[19:21:59.410] Build status: STARTED
[19:21:59.410] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:7:0) after 1m34s
[19:23:33.526] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:7:0)
[19:23:33.542] Build status: STARTED
[19:23:33.542] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:8:0) after 4m13s
[19:27:46.669] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:8:0)
[19:27:46.728] Build status: STARTED
[19:27:46.728] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:9:0) after 3m32s
[19:31:18.743] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:9:0)
[19:31:18.758] Build status: STARTED
[19:31:18.758] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:10:0) after 2m48s
[19:34:06.775] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:10:0)
[19:34:06.793] Build status: STARTED
[19:34:06.793] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:11:0) after 9m42s
[19:43:48.866] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:11:0)
[19:43:48.882] Build status: STARTED
[19:43:48.882] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:12:0) after 8m24s
[19:52:13.034] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:12:0)
[19:52:13.058] Build status: STARTED
[19:52:13.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:13:0) after 4m5s
[19:56:18.064] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:13:0)
[19:56:18.080] Build status: STARTED
[19:56:18.080] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:14:0) after 7m10s
[20:03:28.280] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:14:0)
[20:03:28.296] Build status: STARTED
[20:03:28.296] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:15:0) after 9m24s
[20:12:52.311] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:15:0)
[20:12:52.336] Build status: STARTED
[20:12:52.336] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:16:0) after 1m39s
[20:14:31.336] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:16:0)
[20:14:31.468] Build status: STARTED
[20:14:31.468] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:17:0) after 5m20s
[20:19:51.493] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:17:0)
[20:19:51.507] Build status: STARTED
[20:19:51.508] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:18:0) after 4m43s
[20:24:34.505] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:18:0)
[20:24:34.528] Build status: STARTED
[20:24:34.528] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:19:0) after 8m51s
[20:33:25.753] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:19:0)
[20:33:25.774] Build status: STARTED
[20:33:25.774] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:20:0) after 4m52s
[20:38:17.887] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:20:0)
[20:38:17.919] Build status: STARTED
[20:38:17.919] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:21:0) after 1m0s
[20:39:17.992] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:21:0)
[20:39:18.017] Build status: STARTED
[20:39:18.017] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:22:0) after 1m55s
[20:41:13.168] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:22:0)
[20:41:13.199] Build status: STARTED
[20:41:13.200] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:23:0) after 4m45s
[20:45:58.463] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:23:0)
[20:45:58.525] Build status: STARTED
[20:45:58.525] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:24:0) after 3m13s
[20:49:11.705] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:24:0)
[20:49:11.738] Build status: STARTED
[20:49:11.738] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:25:0) after 6m24s
[20:55:35.753] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:25:0)
[20:55:35.778] Build status: STARTED
[20:55:35.778] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:26:0) after 5m12s
[21:00:47.779] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:26:0)
[21:00:47.805] Build status: STARTED
[21:00:47.805] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:27:0) after 6m37s
[21:07:25.016] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:27:0)
[21:07:25.033] Build status: STARTED
[21:07:25.033] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:28:0) after 5m17s
[21:12:42.053] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:28:0)
[21:12:42.111] Build status: STARTED
[21:12:42.111] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:29:0) after 5m48s
[21:18:30.433] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:29:0)
[21:18:30.455] Build status: STARTED
[21:18:30.455] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:30:0) after 7m29s
[21:25:59.575] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:30:0)
[21:25:59.598] Build status: STARTED
[21:25:59.598] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:31:0) after 1m39s
[21:27:38.674] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:31:0)
[21:27:38.691] Build status: STARTED
[21:27:38.691] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:32:0) after 2m28s
[21:30:07.532] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:32:0)
[21:30:07.574] Build status: STARTED
[21:30:07.574] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:33:0) after 9m4s
[21:39:11.625] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:33:0)
[21:39:11.648] Build status: STARTED
[21:39:11.649] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:34:0) after 8m39s
[21:47:50.745] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:34:0)
[21:47:50.762] Build status: STARTED
[21:47:50.762] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:35:0) after 5m6s
[21:52:56.875] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:35:0)
[21:52:56.904] Build status: STARTED
[21:52:56.904] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:36:0) after 4m29s
[21:57:26.137] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:36:0)
[21:57:26.154] Build status: STARTED
[21:57:26.154] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:37:0) after 9m16s
[22:06:42.347] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:37:0)
[22:06:42.366] Build status: STARTED
[22:06:42.366] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:38:0) after 5m10s
[22:11:52.389] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:38:0)
[22:11:52.403] Build status: STARTED
[22:11:52.403] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:39:0) after 6m5s
[22:17:57.421] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:39:0)
[22:17:57.442] Build status: STARTED
[22:17:57.442] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:40:0) after 7m29s
[22:25:26.700] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:40:0)
[22:25:26.757] Build status: STARTED
[22:25:26.757] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:41:0) after 6m31s
[22:31:57.945] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:41:0)
[22:31:57.960] Build status: STARTED
[22:31:57.960] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:42:0) after 8m38s
[22:40:36.294] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:42:0)
[22:40:36.308] Build status: STARTED
[22:40:36.308] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:43:0) after 3m57s
[22:44:33.910] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:43:0)
[22:44:33.940] Build status: STARTED
[22:44:33.940] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:44:0) after 2m26s
[22:47:00.239] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:44:0)
[22:47:00.258] Build status: STARTED
[22:47:00.258] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:45:0) after 3m35s
[22:50:35.341] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:45:0)
[22:50:35.359] Build status: STARTED
[22:50:35.359] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:46:0) after 8m18s
[22:58:53.652] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:46:0)
[22:58:53.671] Build status: STARTED
[22:58:53.671] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:47:0) after 6m23s
[23:05:17.053] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:47:0)
[23:05:17.113] Build status: STARTED
[23:05:17.113] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:48:0) after 8m58s
[23:14:15.431] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:48:0)
[23:14:15.447] Build status: STARTED
[23:14:15.447] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:49:0) after 3m53s
[23:18:08.507] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:49:0)
[23:18:08.558] Build status: STARTED
[23:18:08.558] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:50:0) after 8m38s
[23:26:46.699] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:50:0)
[23:26:46.725] Build status: STARTED
[23:26:46.725] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:51:0) after 8m45s
[23:35:31.769] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:51:0)
[23:35:31.784] Build status: STARTED
[23:35:31.784] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:52:0) after 7m5s
[23:42:36.802] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:52:0)
[23:42:36.827] Build status: STARTED
[23:42:36.827] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:53:0) after 1m8s
[23:43:44.976] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:53:0)
[23:43:45.000] Build status: STARTED
[23:43:45.000] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:54:0) after 7m58s
[23:51:43.047] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:54:0)
[23:51:43.072] Build status: STARTED
[23:51:43.072] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:55:0) after 7m27s
[23:59:10.093] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:55:0)
[23:59:10.111] Build status: STARTED
[23:59:10.111] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:56:0) after 3m43s
[00:02:53.778] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:56:0)
[00:02:53.803] Build status: STARTED
[00:02:53.803] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:57:0) after 5m39s
[00:08:33.517] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:57:0)
[00:08:33.538] Build status: STARTED
[00:08:33.538] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:58:0) after 1m35s
[00:10:08.556] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:58:0)
[00:10:08.574] Build status: STARTED
[00:10:08.574] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:59:0) after 5m36s
[00:15:44.779] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:59:0)
[00:15:44.820] Build status: STARTED
[00:15:44.820] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:60:0) after 3m20s
[00:19:04.943] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:60:0)
[00:19:04.965] Build status: STARTED
[00:19:04.965] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:61:0) after 9m47s
[00:28:51.979] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:61:0)
[00:28:52.001] Build status: STARTED
[00:28:52.001] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:62:0) after 4m31s
[00:33:23.305] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:62:0)
[00:33:23.333] Build status: STARTED
[00:33:23.333] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:63:0) after 7m35s
[00:40:58.372] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:63:0)
[00:40:58.394] Build status: STARTED
[00:40:58.394] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:64:0) after 4m19s
[00:45:17.410] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:64:0)
[00:45:17.497] Build status: STARTED
[00:45:17.497] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:65:0) after 5m8s
[00:50:25.536] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:65:0)
[00:50:25.583] Build status: STARTED
[00:50:25.583] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841886816932335520:66:0) after 7m43s
[00:53:37.997] Received PubSub notification, asking Buildbucket for the build status
[00:53:38.014] Build:
{
"id": "8676456755019640769",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroidOfficial"
},
"number": 27501,
"createdBy": "project:chromium",
"createTime": "2026-07-12T19:04:17.536125088Z",
"startTime": "2026-07-12T19:05:43.027022525Z",
"endTime": "2026-07-13T00:53:37.632722478Z",
"updateTime": "2026-07-13T00:53:37.632722478Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "af49740d087aa52b97ce698dfe65a35d483d4d41",
"ref": "refs/heads/main"
}
}
}
[00:53:38.014] Invocation finished in 5h49m21.686482084s with status FAILED