[08:22:08.691] New invocation is queued and will start shortly
[08:22:09.989] Starting the invocation (attempt 1)
[08:22:10.046] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/d01256ab564fd7256e1e61f2de0ba6867af82564"
[08:22:10.046] Popped gitiles commit info from properties and tags
[08:22:10.046] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[08:22:10.046] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[08:22:10.046] Buildbucket request:
{
"requestId": "8831961549788372256",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d01256ab564fd7256e1e61f2de0ba6867af82564",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8831961549788372256"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[08:22:10.639] Scheduled build:
{
"id": "8666531487627255841",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 44409,
"createdBy": "project:chromium",
"createTime": "2026-10-30T08:22:10.131137523Z",
"updateTime": "2026-10-30T08:22:10.131137523Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d01256ab564fd7256e1e61f2de0ba6867af82564",
"ref": "refs/heads/main"
}
}
}
[08:22:10.639] Task URL: https://cr-buildbucket.appspot.com/build/8666531487627255841
[08:22:10.639] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:2:0) after 6m32s
[08:22:11.087] Received PubSub notification, asking Buildbucket for the build status
[08:22:11.118] Build status: SCHEDULED
[08:22:16.335] Received PubSub notification, asking Buildbucket for the build status
[08:22:16.457] Build status: STARTED
[08:28:42.697] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:2:0)
[08:28:42.723] Build status: STARTED
[08:28:42.723] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:5:0) after 2m52s
[08:31:34.752] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:5:0)
[08:31:34.802] Build status: STARTED
[08:31:34.802] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:6:0) after 6m1s
[08:37:35.922] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:6:0)
[08:37:35.947] Build status: STARTED
[08:37:35.947] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:7:0) after 6m26s
[08:44:02.079] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:7:0)
[08:44:02.100] Build status: STARTED
[08:44:02.100] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:8:0) after 2m39s
[08:46:41.265] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:8:0)
[08:46:41.305] Build status: STARTED
[08:46:41.305] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:9:0) after 9m5s
[08:55:46.388] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:9:0)
[08:55:46.567] Build status: STARTED
[08:55:46.567] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:10:0) after 2m17s
[08:58:03.576] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:10:0)
[08:58:03.609] Build status: STARTED
[08:58:03.609] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:11:0) after 7m32s
[09:05:35.720] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:11:0)
[09:05:35.738] Build status: STARTED
[09:05:35.738] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:12:0) after 2m15s
[09:07:50.806] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:12:0)
[09:07:50.915] Build status: STARTED
[09:07:50.915] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:13:0) after 2m25s
[09:10:15.973] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:13:0)
[09:10:15.994] Build status: STARTED
[09:10:15.994] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:14:0) after 8m25s
[09:18:41.063] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:14:0)
[09:18:41.083] Build status: STARTED
[09:18:41.083] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:15:0) after 4m6s
[09:22:47.175] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:15:0)
[09:22:47.196] Build status: STARTED
[09:22:47.196] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:16:0) after 3m47s
[09:26:34.219] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:16:0)
[09:26:34.235] Build status: STARTED
[09:26:34.236] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:17:0) after 5m24s
[09:31:58.341] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:17:0)
[09:31:58.361] Build status: STARTED
[09:31:58.361] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:18:0) after 8m27s
[09:40:25.434] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:18:0)
[09:40:25.451] Build status: STARTED
[09:40:25.451] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:19:0) after 1m0s
[09:41:25.560] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:19:0)
[09:41:25.585] Build status: STARTED
[09:41:25.585] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:20:0) after 1m5s
[09:42:30.653] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:20:0)
[09:42:30.700] Build status: STARTED
[09:42:30.700] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:21:0) after 8m0s
[09:50:30.769] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:21:0)
[09:50:30.799] Build status: STARTED
[09:50:30.799] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:22:0) after 8m58s
[09:59:28.824] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:22:0)
[09:59:28.897] Build status: STARTED
[09:59:28.897] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:23:0) after 7m2s
[10:06:31.009] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:23:0)
[10:06:31.029] Build status: STARTED
[10:06:31.029] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:24:0) after 1m30s
[10:08:01.221] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:24:0)
[10:08:01.249] Build status: STARTED
[10:08:01.249] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:25:0) after 8m16s
[10:16:17.297] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:25:0)
[10:16:17.332] Build status: STARTED
[10:16:17.332] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:26:0) after 9m6s
[10:25:23.314] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:26:0)
[10:25:23.332] Build status: STARTED
[10:25:23.332] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:27:0) after 9m22s
[10:34:45.407] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:27:0)
[10:34:45.429] Build status: STARTED
[10:34:45.430] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:28:0) after 8m39s
[10:43:24.454] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:28:0)
[10:43:24.472] Build status: STARTED
[10:43:24.473] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:29:0) after 3m1s
[10:46:25.492] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:29:0)
[10:46:25.526] Build status: STARTED
[10:46:25.526] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:30:0) after 3m19s
[10:49:44.638] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:30:0)
[10:49:44.653] Build status: STARTED
[10:49:44.653] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:31:0) after 8m51s
[10:58:35.723] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:31:0)
[10:58:35.772] Build status: STARTED
[10:58:35.772] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:32:0) after 7m47s
[11:06:22.802] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:32:0)
[11:06:22.822] Build status: STARTED
[11:06:22.822] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:33:0) after 5m37s
[11:11:59.841] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:33:0)
[11:11:59.864] Build status: STARTED
[11:11:59.864] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:34:0) after 3m46s
[11:15:45.887] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:34:0)
[11:15:45.921] Build status: STARTED
[11:15:45.921] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:35:0) after 3m10s
[11:18:56.027] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:35:0)
[11:18:56.047] Build status: STARTED
[11:18:56.047] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:36:0) after 9m22s
[11:28:18.086] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:36:0)
[11:28:18.111] Build status: STARTED
[11:28:18.111] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:37:0) after 6m39s
[11:34:57.227] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:37:0)
[11:34:57.247] Build status: STARTED
[11:34:57.248] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:38:0) after 6m6s
[11:41:03.301] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:38:0)
[11:41:03.321] Build status: STARTED
[11:41:03.321] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:39:0) after 5m16s
[11:46:19.402] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:39:0)
[11:46:19.421] Build status: STARTED
[11:46:19.421] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:40:0) after 6m10s
[11:52:29.456] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:40:0)
[11:52:29.477] Build status: STARTED
[11:52:29.477] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:41:0) after 8m11s
[12:00:40.497] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:41:0)
[12:00:40.520] Build status: STARTED
[12:00:40.520] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:42:0) after 4m53s
[12:05:33.504] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:42:0)
[12:05:33.527] Build status: STARTED
[12:05:33.527] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:43:0) after 7m17s
[12:12:50.555] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:43:0)
[12:12:50.578] Build status: STARTED
[12:12:50.578] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:44:0) after 9m53s
[12:22:43.645] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:44:0)
[12:22:43.676] Build status: STARTED
[12:22:43.676] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:45:0) after 2m26s
[12:25:09.823] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:45:0)
[12:25:09.848] Build status: STARTED
[12:25:09.848] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8831961549788372256:46:0) after 1m43s
[12:25:15.597] Received PubSub notification, asking Buildbucket for the build status
[12:25:15.617] Build:
{
"id": "8666531487627255841",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 44409,
"createdBy": "project:chromium",
"createTime": "2026-10-30T08:22:10.131137523Z",
"startTime": "2026-10-30T08:22:15.239564194Z",
"endTime": "2026-10-30T12:25:15.321406111Z",
"updateTime": "2026-10-30T12:25:15.321406111Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d01256ab564fd7256e1e61f2de0ba6867af82564",
"ref": "refs/heads/main"
}
}
}
[12:25:15.617] Invocation finished in 4h3m6.929972661s with status FAILED