[18:56:16.596] New invocation is queued and will start shortly
[18:56:18.266] Starting the invocation (attempt 1)
[18:56:18.301] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/89b44ffb870b813a5b4c2a5421399c6cd55e1881"
[18:56:18.301] Popped gitiles commit info from properties and tags
[18:56:18.301] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[18:56:18.303] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[18:56:18.303] Buildbucket request:
{
"requestId": "8832102847602342432",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "89b44ffb870b813a5b4c2a5421399c6cd55e1881",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8832102847602342432"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOS"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[18:56:18.878] Scheduled build:
{
"id": "8666672785078602049",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"number": 38391,
"createdBy": "project:chromium",
"createTime": "2026-10-28T18:56:18.381854656Z",
"updateTime": "2026-10-28T18:56:18.381854656Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "89b44ffb870b813a5b4c2a5421399c6cd55e1881",
"ref": "refs/heads/main"
}
},
"canary": true
}
[18:56:18.879] Task URL: https://cr-buildbucket.appspot.com/build/8666672785078602049
[18:56:18.879] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:2:0) after 8m11s
[18:56:19.258] Received PubSub notification, asking Buildbucket for the build status
[18:56:19.283] Build status: SCHEDULED
[18:56:23.433] Received PubSub notification, asking Buildbucket for the build status
[18:56:23.463] Build status: STARTED
[19:04:29.931] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:2:0)
[19:04:30.131] Build status: STARTED
[19:04:30.131] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:5:0) after 1m36s
[19:06:06.205] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:5:0)
[19:06:06.225] Build status: STARTED
[19:06:06.225] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:6:0) after 8m14s
[19:14:20.247] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:6:0)
[19:14:20.284] Build status: STARTED
[19:14:20.284] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:7:0) after 6m34s
[19:20:54.324] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:7:0)
[19:20:54.348] Build status: STARTED
[19:20:54.348] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:8:0) after 1m29s
[19:22:23.426] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:8:0)
[19:22:23.457] Build status: STARTED
[19:22:23.457] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:9:0) after 4m40s
[19:27:03.520] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:9:0)
[19:27:03.602] Build status: STARTED
[19:27:03.602] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:10:0) after 9m32s
[19:36:35.645] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:10:0)
[19:36:35.668] Build status: STARTED
[19:36:35.668] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:11:0) after 5m34s
[19:42:09.684] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:11:0)
[19:42:09.702] Build status: STARTED
[19:42:09.702] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:12:0) after 3m25s
[19:45:34.726] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:12:0)
[19:45:34.838] Build status: STARTED
[19:45:34.838] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:13:0) after 7m40s
[19:53:14.910] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:13:0)
[19:53:14.932] Build status: STARTED
[19:53:14.932] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:14:0) after 1m15s
[19:54:30.003] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:14:0)
[19:54:30.027] Build status: STARTED
[19:54:30.027] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:15:0) after 2m7s
[19:56:37.056] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:15:0)
[19:56:37.092] Build status: STARTED
[19:56:37.093] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:16:0) after 5m6s
[20:01:43.168] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:16:0)
[20:01:43.200] Build status: STARTED
[20:01:43.200] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:17:0) after 6m38s
[20:08:21.333] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:17:0)
[20:08:21.356] Build status: STARTED
[20:08:21.356] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:18:0) after 7m0s
[20:15:21.342] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:18:0)
[20:15:21.454] Build status: STARTED
[20:15:21.454] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:19:0) after 1m37s
[20:16:58.478] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:19:0)
[20:16:58.506] Build status: STARTED
[20:16:58.506] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:20:0) after 5m49s
[20:22:47.532] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:20:0)
[20:22:47.550] Build status: STARTED
[20:22:47.550] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:21:0) after 4m58s
[20:27:45.528] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:21:0)
[20:27:45.556] Build status: STARTED
[20:27:45.557] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:22:0) after 1m28s
[20:29:13.863] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:22:0)
[20:29:13.887] Build status: STARTED
[20:29:13.887] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:23:0) after 3m28s
[20:32:42.048] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:23:0)
[20:32:42.072] Build status: STARTED
[20:32:42.072] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:24:0) after 7m1s
[20:39:43.104] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:24:0)
[20:39:43.131] Build status: STARTED
[20:39:43.131] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:25:0) after 7m2s
[20:46:45.188] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:25:0)
[20:46:45.214] Build status: STARTED
[20:46:45.214] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:26:0) after 5m45s
[20:52:30.541] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:26:0)
[20:52:30.583] Build status: STARTED
[20:52:30.583] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:27:0) after 4m28s
[20:56:58.965] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:27:0)
[20:56:58.984] Build status: STARTED
[20:56:58.984] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:28:0) after 6m22s
[21:03:21.130] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:28:0)
[21:03:21.157] Build status: STARTED
[21:03:21.157] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:29:0) after 9m43s
[21:13:04.264] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:29:0)
[21:13:04.344] Build status: STARTED
[21:13:04.344] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:30:0) after 8m59s
[21:22:03.372] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:30:0)
[21:22:03.406] Build status: STARTED
[21:22:03.406] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:31:0) after 6m26s
[21:28:29.447] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:31:0)
[21:28:29.476] Build status: STARTED
[21:28:29.476] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:32:0) after 8m2s
[21:36:31.804] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:32:0)
[21:36:31.835] Build status: STARTED
[21:36:31.835] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:33:0) after 7m42s
[21:44:13.913] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:33:0)
[21:44:13.934] Build status: STARTED
[21:44:13.935] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:34:0) after 6m35s
[21:50:49.008] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:34:0)
[21:50:49.046] Build status: STARTED
[21:50:49.046] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:35:0) after 1m5s
[21:51:54.173] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:35:0)
[21:51:54.195] Build status: STARTED
[21:51:54.195] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:36:0) after 3m28s
[21:55:22.389] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:36:0)
[21:55:22.409] Build status: STARTED
[21:55:22.409] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:37:0) after 6m7s
[22:01:29.497] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:37:0)
[22:01:29.519] Build status: STARTED
[22:01:29.519] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:38:0) after 6m36s
[22:08:05.551] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:38:0)
[22:08:05.577] Build status: STARTED
[22:08:05.577] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:39:0) after 5m41s
[22:13:46.797] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:39:0)
[22:13:46.813] Build status: STARTED
[22:13:46.813] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:40:0) after 3m44s
[22:17:30.860] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:40:0)
[22:17:30.887] Build status: STARTED
[22:17:30.887] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:41:0) after 1m34s
[22:19:04.948] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:41:0)
[22:19:04.968] Build status: STARTED
[22:19:04.968] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:42:0) after 2m39s
[22:21:43.998] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:42:0)
[22:21:44.023] Build status: STARTED
[22:21:44.023] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:43:0) after 8m39s
[22:30:23.138] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:43:0)
[22:30:23.172] Build status: STARTED
[22:30:23.172] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:44:0) after 6m53s
[22:37:16.267] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:44:0)
[22:37:16.300] Build status: STARTED
[22:37:16.300] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:45:0) after 7m18s
[22:44:34.396] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:45:0)
[22:44:34.458] Build status: STARTED
[22:44:34.458] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:46:0) after 6m8s
[22:50:42.552] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:46:0)
[22:50:42.584] Build status: STARTED
[22:50:42.584] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:47:0) after 4m59s
[22:55:41.638] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:47:0)
[22:55:41.660] Build status: STARTED
[22:55:41.660] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:48:0) after 5m7s
[23:00:48.706] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:48:0)
[23:00:48.768] Build status: STARTED
[23:00:48.768] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:49:0) after 3m45s
[23:04:33.937] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:49:0)
[23:04:33.954] Build status: STARTED
[23:04:33.954] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:50:0) after 8m25s
[23:12:58.978] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:50:0)
[23:12:59.004] Build status: STARTED
[23:12:59.004] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:51:0) after 9m53s
[23:22:52.123] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:51:0)
[23:22:52.142] Build status: STARTED
[23:22:52.142] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:52:0) after 8m42s
[23:31:34.343] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:52:0)
[23:31:34.376] Build status: STARTED
[23:31:34.376] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:53:0) after 5m15s
[23:36:49.419] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:53:0)
[23:36:49.481] Build status: STARTED
[23:36:49.481] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:54:0) after 4m2s
[23:40:51.649] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:54:0)
[23:40:51.671] Build status: STARTED
[23:40:51.671] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:55:0) after 2m43s
[23:43:34.751] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:55:0)
[23:43:34.773] Build status: STARTED
[23:43:34.773] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:56:0) after 4m24s
[23:47:58.833] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:56:0)
[23:47:58.866] Build status: STARTED
[23:47:58.866] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832102847602342432:57:0) after 8m22s
[23:53:42.431] Received PubSub notification, asking Buildbucket for the build status
[23:53:42.449] Build:
{
"id": "8666672785078602049",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"number": 38391,
"createdBy": "project:chromium",
"createTime": "2026-10-28T18:56:18.381854656Z",
"startTime": "2026-10-28T18:56:23.223861442Z",
"endTime": "2026-10-28T23:53:42.053311324Z",
"updateTime": "2026-10-28T23:53:42.053311324Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "89b44ffb870b813a5b4c2a5421399c6cd55e1881",
"ref": "refs/heads/main"
}
},
"canary": true
}
[23:53:42.449] Invocation finished in 4h57m25.858045515s with status FAILED