[07:28:20.087] New invocation is queued and will start shortly
[07:28:21.472] Starting the invocation (attempt 1)
[07:28:21.496] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/114d1e2df94e6415fba481770b974860d688b8ae"
[07:28:21.496] Popped gitiles commit info from properties and tags
[07:28:21.496] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[07:28:21.496] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[07:28:21.496] Buildbucket request:
{
"requestId": "8832146129159324432",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroidOfficial"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "114d1e2df94e6415fba481770b974860d688b8ae",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8832146129159324432"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTAndroidOfficial"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[07:28:22.066] Scheduled build:
{
"id": "8666716066916549969",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroidOfficial"
},
"number": 29474,
"createdBy": "project:chromium",
"createTime": "2026-10-28T07:28:21.604994672Z",
"updateTime": "2026-10-28T07:28:21.604994672Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "114d1e2df94e6415fba481770b974860d688b8ae",
"ref": "refs/heads/main"
}
}
}
[07:28:22.066] Task URL: https://cr-buildbucket.appspot.com/build/8666716066916549969
[07:28:22.066] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:2:0) after 5m35s
[07:28:22.211] Received PubSub notification, asking Buildbucket for the build status
[07:28:22.276] Build status: SCHEDULED
[07:29:32.634] Received PubSub notification, asking Buildbucket for the build status
[07:29:32.651] Build status: STARTED
[07:33:57.084] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:2:0)
[07:33:57.116] Build status: STARTED
[07:33:57.116] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:5:0) after 1m2s
[07:34:59.193] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:5:0)
[07:34:59.213] Build status: STARTED
[07:34:59.213] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:6:0) after 2m49s
[07:37:48.232] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:6:0)
[07:37:48.251] Build status: STARTED
[07:37:48.251] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:7:0) after 1m2s
[07:38:50.292] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:7:0)
[07:38:50.308] Build status: STARTED
[07:38:50.308] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:8:0) after 7m57s
[07:46:47.502] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:8:0)
[07:46:47.565] Build status: STARTED
[07:46:47.565] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:9:0) after 2m37s
[07:49:24.595] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:9:0)
[07:49:24.629] Build status: STARTED
[07:49:24.629] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:10:0) after 7m22s
[07:56:46.669] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:10:0)
[07:56:46.689] Build status: STARTED
[07:56:46.689] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:11:0) after 4m40s
[08:01:26.705] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:11:0)
[08:01:26.728] Build status: STARTED
[08:01:26.728] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:12:0) after 6m4s
[08:07:30.779] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:12:0)
[08:07:30.807] Build status: STARTED
[08:07:30.807] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:13:0) after 6m18s
[08:13:48.862] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:13:0)
[08:13:48.893] Build status: STARTED
[08:13:48.893] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:14:0) after 5m9s
[08:18:57.912] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:14:0)
[08:18:57.935] Build status: STARTED
[08:18:57.935] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:15:0) after 9m25s
[08:28:23.152] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:15:0)
[08:28:23.181] Build status: STARTED
[08:28:23.181] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:16:0) after 2m11s
[08:30:34.209] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:16:0)
[08:30:34.256] Build status: STARTED
[08:30:34.256] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:17:0) after 4m34s
[08:35:08.276] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:17:0)
[08:35:08.296] Build status: STARTED
[08:35:08.296] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:18:0) after 7m28s
[08:42:36.446] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:18:0)
[08:42:36.471] Build status: STARTED
[08:42:36.472] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:19:0) after 6m6s
[08:48:42.558] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:19:0)
[08:48:42.639] Build status: STARTED
[08:48:42.639] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:20:0) after 7m45s
[08:56:27.747] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:20:0)
[08:56:27.780] Build status: STARTED
[08:56:27.780] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:21:0) after 4m49s
[09:01:16.840] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:21:0)
[09:01:16.867] Build status: STARTED
[09:01:16.867] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:22:0) after 5m38s
[09:06:54.885] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:22:0)
[09:06:54.907] Build status: STARTED
[09:06:54.907] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:23:0) after 4m46s
[09:11:41.003] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:23:0)
[09:11:41.028] Build status: STARTED
[09:11:41.028] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:24:0) after 3m11s
[09:14:52.255] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:24:0)
[09:14:52.282] Build status: STARTED
[09:14:52.283] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:25:0) after 8m9s
[09:23:01.455] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:25:0)
[09:23:01.498] Build status: STARTED
[09:23:01.498] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:26:0) after 2m56s
[09:25:57.516] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:26:0)
[09:25:57.535] Build status: STARTED
[09:25:57.536] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:27:0) after 7m39s
[09:33:36.601] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:27:0)
[09:33:36.624] Build status: STARTED
[09:33:36.624] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:28:0) after 4m49s
[09:38:25.722] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:28:0)
[09:38:25.770] Build status: STARTED
[09:38:25.770] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:29:0) after 9m45s
[09:48:10.801] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:29:0)
[09:48:10.823] Build status: STARTED
[09:48:10.823] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:30:0) after 6m38s
[09:54:48.855] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:30:0)
[09:54:48.872] Build status: STARTED
[09:54:48.872] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:31:0) after 1m10s
[09:55:58.891] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:31:0)
[09:55:58.968] Build status: STARTED
[09:55:58.968] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:32:0) after 3m46s
[09:59:44.942] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:32:0)
[09:59:44.969] Build status: STARTED
[09:59:44.969] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:33:0) after 3m47s
[10:03:32.043] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:33:0)
[10:03:32.071] Build status: STARTED
[10:03:32.071] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:34:0) after 1m58s
[10:05:30.138] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:34:0)
[10:05:30.158] Build status: STARTED
[10:05:30.159] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:35:0) after 2m12s
[10:07:42.584] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:35:0)
[10:07:42.611] Build status: STARTED
[10:07:42.611] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:36:0) after 3m57s
[10:11:39.628] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:36:0)
[10:11:39.662] Build status: STARTED
[10:11:39.662] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:37:0) after 7m24s
[10:19:03.631] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:37:0)
[10:19:03.650] Build status: STARTED
[10:19:03.650] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:38:0) after 2m4s
[10:21:07.670] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:38:0)
[10:21:07.694] Build status: STARTED
[10:21:07.694] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:39:0) after 7m30s
[10:28:37.768] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:39:0)
[10:28:37.842] Build status: STARTED
[10:28:37.842] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:40:0) after 5m22s
[10:33:59.846] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:40:0)
[10:33:59.869] Build status: STARTED
[10:33:59.869] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:41:0) after 6m41s
[10:40:40.956] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:41:0)
[10:40:40.983] Build status: STARTED
[10:40:40.983] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:42:0) after 9m26s
[10:50:07.082] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:42:0)
[10:50:07.117] Build status: STARTED
[10:50:07.117] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:43:0) after 3m6s
[10:53:13.136] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:43:0)
[10:53:13.155] Build status: STARTED
[10:53:13.155] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:44:0) after 7m29s
[11:00:42.147] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:44:0)
[11:00:42.179] Build status: STARTED
[11:00:42.179] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:45:0) after 5m30s
[11:06:12.197] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:45:0)
[11:06:12.312] Build status: STARTED
[11:06:12.312] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:46:0) after 2m46s
[11:08:58.433] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:46:0)
[11:08:58.459] Build status: STARTED
[11:08:58.459] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:47:0) after 1m10s
[11:10:08.480] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:47:0)
[11:10:08.499] Build status: STARTED
[11:10:08.499] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:48:0) after 5m45s
[11:15:53.518] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:48:0)
[11:15:53.537] Build status: STARTED
[11:15:53.537] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:49:0) after 4m8s
[11:20:01.555] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:49:0)
[11:20:01.575] Build status: STARTED
[11:20:01.575] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:50:0) after 1m3s
[11:21:04.658] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:50:0)
[11:21:04.694] Build status: STARTED
[11:21:04.694] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:51:0) after 9m59s
[11:31:03.763] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:51:0)
[11:31:03.781] Build status: STARTED
[11:31:03.782] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:52:0) after 7m45s
[11:38:48.950] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:52:0)
[11:38:48.966] Build status: STARTED
[11:38:48.966] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:53:0) after 4m34s
[11:43:23.035] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:53:0)
[11:43:23.146] Build status: STARTED
[11:43:23.146] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:54:0) after 6m12s
[11:49:35.282] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:54:0)
[11:49:35.346] Build status: STARTED
[11:49:35.346] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:55:0) after 7m26s
[11:57:01.362] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:55:0)
[11:57:01.385] Build status: STARTED
[11:57:01.385] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:56:0) after 3m27s
[12:00:28.415] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:56:0)
[12:00:28.519] Build status: STARTED
[12:00:28.519] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:57:0) after 6m31s
[12:06:59.572] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:57:0)
[12:06:59.599] Build status: STARTED
[12:06:59.599] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:58:0) after 2m51s
[12:09:50.591] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:58:0)
[12:09:50.618] Build status: STARTED
[12:09:50.618] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:59:0) after 5m3s
[12:14:53.610] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:59:0)
[12:14:53.635] Build status: STARTED
[12:14:53.635] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:60:0) after 7m44s
[12:22:37.661] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:60:0)
[12:22:37.687] Build status: STARTED
[12:22:37.687] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:61:0) after 1m42s
[12:24:19.800] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:61:0)
[12:24:19.818] Build status: STARTED
[12:24:19.818] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:62:0) after 7m5s
[12:31:24.839] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:62:0)
[12:31:24.861] Build status: STARTED
[12:31:24.861] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:63:0) after 5m11s
[12:36:36.146] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:63:0)
[12:36:36.312] Build status: STARTED
[12:36:36.312] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:64:0) after 2m12s
[12:38:48.331] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:64:0)
[12:38:48.377] Build status: STARTED
[12:38:48.377] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8832146129159324432:65:0) after 4m41s
[12:43:28.882] Received PubSub notification, asking Buildbucket for the build status
[12:43:28.991] Build:
{
"id": "8666716066916549969",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroidOfficial"
},
"number": 29474,
"createdBy": "project:chromium",
"createTime": "2026-10-28T07:28:21.604994672Z",
"startTime": "2026-10-28T07:29:32.411135643Z",
"endTime": "2026-10-28T12:43:28.046971148Z",
"updateTime": "2026-10-28T12:43:28.046971148Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "114d1e2df94e6415fba481770b974860d688b8ae",
"ref": "refs/heads/main"
}
}
}
[12:43:28.991] Invocation finished in 5h15m8.910306468s with status FAILED