[14:45:05.368] New invocation is queued and will start shortly
[14:45:08.774] Starting the invocation (attempt 1)
[14:45:08.803] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/babb8af3e3d397e419b49b80853adea6fbcf9ffc"
[14:45:08.803] Popped gitiles commit info from properties and tags
[14:45:08.803] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[14:45:08.803] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[14:45:08.803] Buildbucket request:
{
"requestId": "8851144013876123312",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "babb8af3e3d397e419b49b80853adea6fbcf9ffc",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8851144013876123312"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOS"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[14:45:09.402] Scheduled build:
{
"id": "8685713949540820369",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"number": 35350,
"createdBy": "project:chromium",
"createTime": "2026-04-01T14:45:08.879937799Z",
"updateTime": "2026-04-01T14:45:08.879937799Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "babb8af3e3d397e419b49b80853adea6fbcf9ffc",
"ref": "refs/heads/main"
}
},
"canary": true
}
[14:45:09.402] Task URL: https://cr-buildbucket.appspot.com/build/8685713949540820369
[14:45:09.402] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:2:0) after 1m31s
[14:45:31.458] Received PubSub notification, asking Buildbucket for the build status
[14:45:31.473] Build status: STARTED
[14:45:34.713] Received PubSub notification, asking Buildbucket for the build status
[14:45:34.744] Build status: STARTED
[14:46:40.441] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:2:0)
[14:46:40.456] Build status: STARTED
[14:46:40.456] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:5:0) after 3m30s
[14:50:10.468] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:5:0)
[14:50:10.501] Build status: STARTED
[14:50:10.501] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:6:0) after 7m22s
[14:57:32.519] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:6:0)
[14:57:32.540] Build status: STARTED
[14:57:32.540] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:7:0) after 3m10s
[15:00:42.522] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:7:0)
[15:00:42.540] Build status: STARTED
[15:00:42.540] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:8:0) after 2m47s
[15:03:29.555] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:8:0)
[15:03:29.623] Build status: STARTED
[15:03:29.623] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:9:0) after 4m6s
[15:07:35.641] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:9:0)
[15:07:35.665] Build status: STARTED
[15:07:35.665] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:10:0) after 9m6s
[15:16:41.731] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:10:0)
[15:16:41.747] Build status: STARTED
[15:16:41.747] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:11:0) after 4m2s
[15:20:43.818] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:11:0)
[15:20:43.835] Build status: STARTED
[15:20:43.835] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:12:0) after 5m0s
[15:25:43.878] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:12:0)
[15:25:43.910] Build status: STARTED
[15:25:43.910] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:13:0) after 1m36s
[15:27:19.891] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:13:0)
[15:27:19.918] Build status: STARTED
[15:27:19.918] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:14:0) after 3m56s
[15:31:15.944] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:14:0)
[15:31:15.981] Build status: STARTED
[15:31:15.981] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:15:0) after 5m53s
[15:37:09.013] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:15:0)
[15:37:09.208] Build status: STARTED
[15:37:09.208] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:16:0) after 4m33s
[15:41:42.209] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:16:0)
[15:41:42.231] Build status: STARTED
[15:41:42.231] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:17:0) after 6m55s
[15:48:37.286] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:17:0)
[15:48:37.311] Build status: STARTED
[15:48:37.311] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:18:0) after 8m52s
[15:57:29.540] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:18:0)
[15:57:29.555] Build status: STARTED
[15:57:29.555] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:19:0) after 7m56s
[16:05:25.604] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:19:0)
[16:05:25.652] Build status: STARTED
[16:05:25.652] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:20:0) after 7m41s
[16:13:06.672] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:20:0)
[16:13:06.691] Build status: STARTED
[16:13:06.691] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:21:0) after 4m19s
[16:17:25.709] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:21:0)
[16:17:25.734] Build status: STARTED
[16:17:25.734] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:22:0) after 1m24s
[16:18:49.738] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:22:0)
[16:18:49.757] Build status: STARTED
[16:18:49.757] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:23:0) after 7m34s
[16:26:23.832] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:23:0)
[16:26:23.867] Build status: STARTED
[16:26:23.867] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:24:0) after 8m36s
[16:34:59.946] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:24:0)
[16:34:59.969] Build status: STARTED
[16:34:59.969] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:25:0) after 7m33s
[16:42:33.065] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:25:0)
[16:42:33.089] Build status: STARTED
[16:42:33.089] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:26:0) after 8m33s
[16:51:06.118] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:26:0)
[16:51:06.203] Build status: STARTED
[16:51:06.203] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:27:0) after 7m22s
[16:58:28.222] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:27:0)
[16:58:28.288] Build status: STARTED
[16:58:28.288] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:28:0) after 5m14s
[17:03:42.291] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:28:0)
[17:03:42.313] Build status: STARTED
[17:03:42.313] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:29:0) after 5m0s
[17:08:42.329] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:29:0)
[17:08:42.346] Build status: STARTED
[17:08:42.346] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:30:0) after 9m56s
[17:18:38.423] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:30:0)
[17:18:38.447] Build status: STARTED
[17:18:38.447] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:31:0) after 2m39s
[17:21:17.476] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:31:0)
[17:21:17.541] Build status: STARTED
[17:21:17.541] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:32:0) after 7m16s
[17:28:33.592] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:32:0)
[17:28:33.615] Build status: STARTED
[17:28:33.615] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:33:0) after 3m41s
[17:32:14.696] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:33:0)
[17:32:14.760] Build status: STARTED
[17:32:14.760] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:34:0) after 9m0s
[17:41:14.752] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:34:0)
[17:41:14.789] Build status: STARTED
[17:41:14.789] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:35:0) after 3m53s
[17:45:07.890] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:35:0)
[17:45:07.930] Build status: STARTED
[17:45:07.930] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:36:0) after 5m32s
[17:50:40.201] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:36:0)
[17:50:40.228] Build status: STARTED
[17:50:40.228] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:37:0) after 5m19s
[17:55:59.280] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:37:0)
[17:55:59.311] Build status: STARTED
[17:55:59.311] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:38:0) after 8m2s
[18:04:01.354] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:38:0)
[18:04:01.409] Build status: STARTED
[18:04:01.409] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:39:0) after 6m46s
[18:10:47.504] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:39:0)
[18:10:47.609] Build status: STARTED
[18:10:47.609] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:40:0) after 2m34s
[18:13:21.648] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:40:0)
[18:13:21.663] Build status: STARTED
[18:13:21.663] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:41:0) after 8m43s
[18:22:04.724] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:41:0)
[18:22:04.745] Build status: STARTED
[18:22:04.745] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:42:0) after 2m0s
[18:24:04.756] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:42:0)
[18:24:04.775] Build status: STARTED
[18:24:04.775] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:43:0) after 3m47s
[18:27:51.787] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:43:0)
[18:27:51.816] Build status: STARTED
[18:27:51.816] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:44:0) after 5m48s
[18:33:39.837] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:44:0)
[18:33:39.856] Build status: STARTED
[18:33:39.856] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:45:0) after 5m20s
[18:38:59.941] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:45:0)
[18:38:59.961] Build status: STARTED
[18:38:59.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:46:0) after 9m43s
[18:48:42.981] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:46:0)
[18:48:42.999] Build status: STARTED
[18:48:42.999] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:47:0) after 7m10s
[18:55:53.068] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:47:0)
[18:55:53.092] Build status: STARTED
[18:55:53.092] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851144013876123312:48:0) after 2m1s
[18:56:56.006] Received PubSub notification, asking Buildbucket for the build status
[18:56:56.022] Build:
{
"id": "8685713949540820369",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"number": 35350,
"createdBy": "project:chromium",
"createTime": "2026-04-01T14:45:08.879937799Z",
"startTime": "2026-04-01T14:45:14.134823997Z",
"endTime": "2026-04-01T18:56:55.701452953Z",
"updateTime": "2026-04-01T18:56:55.701452953Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "babb8af3e3d397e419b49b80853adea6fbcf9ffc",
"ref": "refs/heads/main"
}
},
"canary": true
}
[18:56:56.022] Invocation finished in 4h11m50.660405895s with status FAILED