[19:59:07.418] New invocation is queued and will start shortly
[19:59:08.892] Starting the invocation (attempt 1)
[19:59:08.919] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/c84ca941ef52262a47a01cbf1e57615670c346a6"
[19:59:08.919] Popped gitiles commit info from properties and tags
[19:59:08.919] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[19:59:08.921] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[19:59:08.921] Buildbucket request:
{
"requestId": "8851849032288007024",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c84ca941ef52262a47a01cbf1e57615670c346a6",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8851849032288007024"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[19:59:09.594] Scheduled build:
{
"id": "8686418969970465201",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 41080,
"createdBy": "project:chromium",
"createTime": "2026-03-24T19:59:09.003180466Z",
"updateTime": "2026-03-24T19:59:09.003180466Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c84ca941ef52262a47a01cbf1e57615670c346a6",
"ref": "refs/heads/main"
}
}
}
[19:59:09.594] Task URL: https://cr-buildbucket.appspot.com/build/8686418969970465201
[19:59:09.594] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851849032288007024:2:0) after 2m23s
[19:59:10.436] Received PubSub notification, asking Buildbucket for the build status
[19:59:10.476] Build status: SCHEDULED
[19:59:49.661] Received PubSub notification, asking Buildbucket for the build status
[19:59:49.681] Build status: STARTED
[20:01:32.623] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851849032288007024:2:0)
[20:01:32.665] Build status: STARTED
[20:01:32.665] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851849032288007024:5:0) after 5m5s
[20:06:37.687] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851849032288007024:5:0)
[20:06:37.727] Build status: STARTED
[20:06:37.727] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851849032288007024:6:0) after 9m48s
[20:16:25.795] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851849032288007024:6:0)
[20:16:25.837] Build status: STARTED
[20:16:25.837] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851849032288007024:7:0) after 9m36s
[20:26:01.907] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851849032288007024:7:0)
[20:26:01.950] Build status: STARTED
[20:26:01.950] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851849032288007024:8:0) after 5m32s
[20:31:34.006] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851849032288007024:8:0)
[20:31:34.022] Build status: STARTED
[20:31:34.022] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851849032288007024:9:0) after 2m10s
[20:33:44.070] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851849032288007024:9:0)
[20:33:44.101] Build status: STARTED
[20:33:44.101] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851849032288007024:10:0) after 6m1s
[20:39:45.106] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851849032288007024:10:0)
[20:39:45.135] Build status: STARTED
[20:39:45.135] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851849032288007024:11:0) after 4m5s
[20:43:50.229] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851849032288007024:11:0)
[20:43:50.247] Build status: STARTED
[20:43:50.247] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851849032288007024:12:0) after 8m41s
[20:52:31.272] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851849032288007024:12:0)
[20:52:31.292] Build status: STARTED
[20:52:31.292] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851849032288007024:13:0) after 6m38s
[20:59:09.350] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851849032288007024:13:0)
[20:59:09.383] Build status: STARTED
[20:59:09.383] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851849032288007024:14:0) after 4m58s
[21:04:07.491] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851849032288007024:14:0)
[21:04:07.509] Build status: STARTED
[21:04:07.509] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851849032288007024:15:0) after 8m22s
[21:12:29.528] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851849032288007024:15:0)
[21:12:29.545] Build status: STARTED
[21:12:29.545] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851849032288007024:16:0) after 8m3s
[21:20:32.577] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851849032288007024:16:0)
[21:20:32.592] Build status: STARTED
[21:20:32.592] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851849032288007024:17:0) after 5m11s
[21:25:43.625] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851849032288007024:17:0)
[21:25:43.646] Build status: STARTED
[21:25:43.646] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851849032288007024:18:0) after 1m34s
[21:27:17.672] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851849032288007024:18:0)
[21:27:17.696] Build status: STARTED
[21:27:17.696] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851849032288007024:19:0) after 2m49s
[21:30:06.717] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851849032288007024:19:0)
[21:30:06.774] Build status: STARTED
[21:30:06.774] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851849032288007024:20:0) after 7m3s
[21:37:09.815] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851849032288007024:20:0)
[21:37:09.845] Build status: STARTED
[21:37:09.845] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851849032288007024:21:0) after 3m53s
[21:41:02.921] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851849032288007024:21:0)
[21:41:02.940] Build status: STARTED
[21:41:02.940] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851849032288007024:22:0) after 7m51s
[21:48:54.012] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851849032288007024:22:0)
[21:48:54.032] Build status: STARTED
[21:48:54.032] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851849032288007024:23:0) after 9m53s
[21:58:47.088] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851849032288007024:23:0)
[21:58:47.105] Build status: STARTED
[21:58:47.106] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851849032288007024:24:0) after 9m17s
[22:08:04.174] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851849032288007024:24:0)
[22:08:04.194] Build status: STARTED
[22:08:04.194] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851849032288007024:25:0) after 5m18s
[22:13:22.217] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851849032288007024:25:0)
[22:13:22.255] Build status: STARTED
[22:13:22.255] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851849032288007024:26:0) after 5m2s
[22:18:24.306] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851849032288007024:26:0)
[22:18:24.329] Build status: STARTED
[22:18:24.329] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851849032288007024:27:0) after 8m16s
[22:26:40.368] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851849032288007024:27:0)
[22:26:40.386] Build status: STARTED
[22:26:40.386] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851849032288007024:28:0) after 3m39s
[22:30:19.406] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851849032288007024:28:0)
[22:30:19.496] Build status: STARTED
[22:30:19.496] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851849032288007024:29:0) after 4m37s
[22:34:56.598] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851849032288007024:29:0)
[22:34:56.617] Build status: STARTED
[22:34:56.617] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851849032288007024:30:0) after 4m29s
[22:39:25.646] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851849032288007024:30:0)
[22:39:25.662] Build status: STARTED
[22:39:25.662] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851849032288007024:31:0) after 9m29s
[22:48:54.770] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851849032288007024:31:0)
[22:48:54.785] Build status: STARTED
[22:48:54.785] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851849032288007024:32:0) after 5m38s
[22:54:32.809] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851849032288007024:32:0)
[22:54:32.833] Build status: STARTED
[22:54:32.833] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851849032288007024:33:0) after 4m9s
[22:58:41.866] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851849032288007024:33:0)
[22:58:41.886] Build status: STARTED
[22:58:41.886] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851849032288007024:34:0) after 5m26s
[23:04:07.941] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851849032288007024:34:0)
[23:04:08.002] Build status: STARTED
[23:04:08.002] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851849032288007024:35:0) after 3m37s
[23:07:45.019] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851849032288007024:35:0)
[23:07:45.035] Build status: STARTED
[23:07:45.035] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851849032288007024:36:0) after 9m9s
[23:16:54.086] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851849032288007024:36:0)
[23:16:54.100] Build status: STARTED
[23:16:54.100] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851849032288007024:37:0) after 5m17s
[23:22:11.143] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851849032288007024:37:0)
[23:22:11.166] Build status: STARTED
[23:22:11.167] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851849032288007024:38:0) after 5m58s
[23:23:06.476] Received PubSub notification, asking Buildbucket for the build status
[23:23:06.492] Build:
{
"id": "8686418969970465201",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 41080,
"createdBy": "project:chromium",
"createTime": "2026-03-24T19:59:09.003180466Z",
"startTime": "2026-03-24T19:59:49.422955519Z",
"endTime": "2026-03-24T23:23:06.247667084Z",
"updateTime": "2026-03-24T23:23:06.247667084Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c84ca941ef52262a47a01cbf1e57615670c346a6",
"ref": "refs/heads/main"
}
}
}
[23:23:06.492] Invocation finished in 3h23m59.08293359s with status FAILED