[10:27:01.639] New invocation is queued and will start shortly
[10:27:05.054] Starting the invocation (attempt 1)
[10:27:05.074] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/06aa78c1ef0cc0dda7aa9fd381f24178837dbd11"
[10:27:05.074] Popped gitiles commit info from properties and tags
[10:27:05.074] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[10:27:05.075] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[10:27:05.075] Buildbucket request:
{
"requestId": "8857139649531811040",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "06aa78c1ef0cc0dda7aa9fd381f24178837dbd11",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8857139649531811040"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[10:27:05.577] Scheduled build:
{
"id": "8691709585219509121",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 40639,
"createdBy": "project:chromium",
"createTime": "2026-01-25T10:27:05.122202444Z",
"updateTime": "2026-01-25T10:27:05.122202444Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "06aa78c1ef0cc0dda7aa9fd381f24178837dbd11",
"ref": "refs/heads/main"
}
}
}
[10:27:05.577] Task URL: https://cr-buildbucket.appspot.com/build/8691709585219509121
[10:27:05.577] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:2:0) after 7m55s
[10:27:06.517] Received PubSub notification, asking Buildbucket for the build status
[10:27:06.549] Build status: SCHEDULED
[10:28:04.360] Received PubSub notification, asking Buildbucket for the build status
[10:28:04.383] Build status: STARTED
[10:35:00.586] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:2:0)
[10:35:00.613] Build status: STARTED
[10:35:00.613] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:5:0) after 4m13s
[10:39:13.775] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:5:0)
[10:39:13.805] Build status: STARTED
[10:39:13.805] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:6:0) after 7m34s
[10:46:47.882] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:6:0)
[10:46:47.897] Build status: STARTED
[10:46:47.897] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:7:0) after 4m16s
[10:51:03.984] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:7:0)
[10:51:04.007] Build status: STARTED
[10:51:04.007] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:8:0) after 2m29s
[10:53:33.814] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:8:0)
[10:53:33.838] Build status: STARTED
[10:53:33.838] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:9:0) after 7m45s
[11:01:18.850] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:9:0)
[11:01:18.865] Build status: STARTED
[11:01:18.865] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:10:0) after 4m55s
[11:06:13.880] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:10:0)
[11:06:13.899] Build status: STARTED
[11:06:13.900] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:11:0) after 9m59s
[11:16:12.910] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:11:0)
[11:16:12.967] Build status: STARTED
[11:16:12.967] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:12:0) after 8m5s
[11:24:17.998] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:12:0)
[11:24:18.029] Build status: STARTED
[11:24:18.029] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:13:0) after 8m8s
[11:32:26.072] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:13:0)
[11:32:26.127] Build status: STARTED
[11:32:26.127] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:14:0) after 4m19s
[11:36:45.138] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:14:0)
[11:36:45.158] Build status: STARTED
[11:36:45.158] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:15:0) after 7m22s
[11:44:07.171] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:15:0)
[11:44:07.187] Build status: STARTED
[11:44:07.187] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:16:0) after 7m22s
[11:51:29.200] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:16:0)
[11:51:29.229] Build status: STARTED
[11:51:29.229] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:17:0) after 8m13s
[11:59:42.342] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:17:0)
[11:59:42.356] Build status: STARTED
[11:59:42.356] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:18:0) after 8m26s
[12:08:08.375] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:18:0)
[12:08:08.388] Build status: STARTED
[12:08:08.388] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:19:0) after 2m47s
[12:10:55.496] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:19:0)
[12:10:55.514] Build status: STARTED
[12:10:55.514] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:20:0) after 4m51s
[12:15:46.702] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:20:0)
[12:15:46.717] Build status: STARTED
[12:15:46.717] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:21:0) after 2m21s
[12:18:07.905] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:21:0)
[12:18:07.925] Build status: STARTED
[12:18:07.925] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:22:0) after 9m59s
[12:28:06.940] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:22:0)
[12:28:06.954] Build status: STARTED
[12:28:06.954] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:23:0) after 2m32s
[12:30:38.966] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:23:0)
[12:30:38.982] Build status: STARTED
[12:30:38.982] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:24:0) after 4m51s
[12:35:30.178] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:24:0)
[12:35:30.196] Build status: STARTED
[12:35:30.196] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:25:0) after 7m15s
[12:42:45.452] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:25:0)
[12:42:45.466] Build status: STARTED
[12:42:45.466] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:26:0) after 2m55s
[12:45:40.634] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:26:0)
[12:45:40.653] Build status: STARTED
[12:45:40.653] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:27:0) after 5m11s
[12:50:51.668] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:27:0)
[12:50:51.686] Build status: STARTED
[12:50:51.686] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:28:0) after 6m18s
[12:57:09.702] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:28:0)
[12:57:09.728] Build status: STARTED
[12:57:09.728] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:29:0) after 3m18s
[13:00:27.720] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:29:0)
[13:00:27.742] Build status: STARTED
[13:00:27.742] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:30:0) after 1m47s
[13:02:14.755] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:30:0)
[13:02:14.774] Build status: STARTED
[13:02:14.774] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:31:0) after 3m9s
[13:05:24.065] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:31:0)
[13:05:24.084] Build status: STARTED
[13:05:24.084] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:32:0) after 7m46s
[13:13:10.430] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:32:0)
[13:13:10.448] Build status: STARTED
[13:13:10.448] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:33:0) after 5m42s
[13:18:52.698] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:33:0)
[13:18:52.713] Build status: STARTED
[13:18:52.713] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:34:0) after 5m48s
[13:24:40.770] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:34:0)
[13:24:40.822] Build status: STARTED
[13:24:40.822] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:35:0) after 1m0s
[13:25:41.118] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:35:0)
[13:25:41.132] Build status: STARTED
[13:25:41.132] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:36:0) after 3m25s
[13:29:06.146] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:36:0)
[13:29:06.162] Build status: STARTED
[13:29:06.162] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:37:0) after 5m38s
[13:34:44.248] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:37:0)
[13:34:44.261] Build status: STARTED
[13:34:44.262] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:38:0) after 6m30s
[13:41:14.403] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:38:0)
[13:41:14.422] Build status: STARTED
[13:41:14.422] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:39:0) after 7m20s
[13:48:34.534] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:39:0)
[13:48:34.569] Build status: STARTED
[13:48:34.569] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:40:0) after 4m3s
[13:52:37.703] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:40:0)
[13:52:37.716] Build status: STARTED
[13:52:37.716] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:41:0) after 7m47s
[14:00:24.722] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:41:0)
[14:00:24.737] Build status: STARTED
[14:00:24.737] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:42:0) after 1m36s
[14:02:00.759] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:42:0)
[14:02:00.779] Build status: STARTED
[14:02:00.779] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:43:0) after 7m0s
[14:09:00.844] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:43:0)
[14:09:00.882] Build status: STARTED
[14:09:00.882] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:44:0) after 9m35s
[14:18:35.984] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:44:0)
[14:18:36.001] Build status: STARTED
[14:18:36.002] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:45:0) after 3m21s
[14:21:57.036] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:45:0)
[14:21:57.051] Build status: STARTED
[14:21:57.052] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:46:0) after 6m31s
[14:28:28.069] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:46:0)
[14:28:28.156] Build status: STARTED
[14:28:28.156] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:47:0) after 7m6s
[14:35:34.330] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:47:0)
[14:35:34.345] Build status: STARTED
[14:35:34.345] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:48:0) after 3m11s
[14:38:45.349] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:48:0)
[14:38:45.364] Build status: STARTED
[14:38:45.364] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:49:0) after 4m46s
[14:43:31.425] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:49:0)
[14:43:31.444] Build status: STARTED
[14:43:31.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:50:0) after 5m49s
[14:49:20.773] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:50:0)
[14:49:20.796] Build status: STARTED
[14:49:20.796] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:51:0) after 3m35s
[14:52:55.910] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:51:0)
[14:52:55.925] Build status: STARTED
[14:52:55.925] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:52:0) after 1m53s
[14:54:48.943] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:52:0)
[14:54:48.958] Build status: STARTED
[14:54:48.958] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:53:0) after 2m35s
[14:57:23.970] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:53:0)
[14:57:23.986] Build status: STARTED
[14:57:23.986] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8857139649531811040:54:0) after 7m39s
[14:59:27.279] Received PubSub notification, asking Buildbucket for the build status
[14:59:27.296] Build:
{
"id": "8691709585219509121",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 40639,
"createdBy": "project:chromium",
"createTime": "2026-01-25T10:27:05.122202444Z",
"startTime": "2026-01-25T10:28:03.691782537Z",
"endTime": "2026-01-25T14:59:26.897393496Z",
"updateTime": "2026-01-25T14:59:26.897393496Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "06aa78c1ef0cc0dda7aa9fd381f24178837dbd11",
"ref": "refs/heads/main"
}
}
}
[14:59:27.296] Invocation finished in 4h32m25.669948961s with status FAILED