[10:07:51.409] New invocation is queued and will start shortly
[10:07:52.489] Starting the invocation (attempt 1)
[10:07:52.516] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/29e7f72feceeb504e307016c87823a7bc3a820ac"
[10:07:52.517] Popped gitiles commit info from properties and tags
[10:07:52.517] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[10:07:52.517] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[10:07:52.517] Buildbucket request:
{
"requestId": "8848081158984267008",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "29e7f72feceeb504e307016c87823a7bc3a820ac",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8848081158984267008"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[10:07:53.018] Scheduled build:
{
"id": "8682651097108202993",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 41459,
"createdBy": "project:chromium",
"createTime": "2026-05-05T10:07:52.579146483Z",
"updateTime": "2026-05-05T10:07:52.579146483Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "29e7f72feceeb504e307016c87823a7bc3a820ac",
"ref": "refs/heads/main"
}
}
}
[10:07:53.018] Task URL: https://cr-buildbucket.appspot.com/build/8682651097108202993
[10:07:53.019] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:2:0) after 2m8s
[10:07:54.007] Received PubSub notification, asking Buildbucket for the build status
[10:07:54.030] Build status: SCHEDULED
[10:08:28.344] Received PubSub notification, asking Buildbucket for the build status
[10:08:28.364] Build status: STARTED
[10:10:01.045] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:2:0)
[10:10:01.092] Build status: STARTED
[10:10:01.093] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:5:0) after 7m49s
[10:17:50.263] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:5:0)
[10:17:50.288] Build status: STARTED
[10:17:50.288] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:6:0) after 8m58s
[10:26:48.360] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:6:0)
[10:26:48.415] Build status: STARTED
[10:26:48.415] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:7:0) after 5m24s
[10:32:12.535] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:7:0)
[10:32:12.552] Build status: STARTED
[10:32:12.552] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:8:0) after 3m15s
[10:35:27.591] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:8:0)
[10:35:27.606] Build status: STARTED
[10:35:27.606] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:9:0) after 1m59s
[10:37:26.628] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:9:0)
[10:37:26.647] Build status: STARTED
[10:37:26.647] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:10:0) after 9m7s
[10:46:33.743] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:10:0)
[10:46:33.762] Build status: STARTED
[10:46:33.762] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:11:0) after 8m40s
[10:55:13.822] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:11:0)
[10:55:13.842] Build status: STARTED
[10:55:13.842] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:12:0) after 2m59s
[10:58:13.009] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:12:0)
[10:58:13.027] Build status: STARTED
[10:58:13.027] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:13:0) after 1m27s
[10:59:40.104] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:13:0)
[10:59:40.123] Build status: STARTED
[10:59:40.123] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:14:0) after 1m0s
[11:00:40.099] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:14:0)
[11:00:40.117] Build status: STARTED
[11:00:40.117] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:15:0) after 1m36s
[11:02:16.531] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:15:0)
[11:02:16.545] Build status: STARTED
[11:02:16.545] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:16:0) after 9m42s
[11:11:58.604] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:16:0)
[11:11:58.649] Build status: STARTED
[11:11:58.649] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:17:0) after 9m6s
[11:21:04.620] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:17:0)
[11:21:04.638] Build status: STARTED
[11:21:04.638] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:18:0) after 4m10s
[11:25:14.649] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:18:0)
[11:25:14.702] Build status: STARTED
[11:25:14.702] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:19:0) after 8m44s
[11:33:58.817] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:19:0)
[11:33:58.844] Build status: STARTED
[11:33:58.844] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:20:0) after 5m59s
[11:39:58.024] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:20:0)
[11:39:58.040] Build status: STARTED
[11:39:58.041] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:21:0) after 1m31s
[11:41:29.111] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:21:0)
[11:41:29.148] Build status: STARTED
[11:41:29.148] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:22:0) after 3m32s
[11:45:01.183] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:22:0)
[11:45:01.199] Build status: STARTED
[11:45:01.200] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:23:0) after 1m0s
[11:46:01.337] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:23:0)
[11:46:01.366] Build status: STARTED
[11:46:01.366] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:24:0) after 3m50s
[11:49:51.381] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:24:0)
[11:49:51.395] Build status: STARTED
[11:49:51.395] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:25:0) after 8m57s
[11:58:48.550] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:25:0)
[11:58:48.567] Build status: STARTED
[11:58:48.567] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:26:0) after 3m38s
[12:02:26.721] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:26:0)
[12:02:26.895] Build status: STARTED
[12:02:26.895] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:27:0) after 6m12s
[12:08:38.913] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:27:0)
[12:08:38.927] Build status: STARTED
[12:08:38.927] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:28:0) after 7m42s
[12:16:20.914] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:28:0)
[12:16:20.933] Build status: STARTED
[12:16:20.933] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:29:0) after 6m15s
[12:22:36.092] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:29:0)
[12:22:36.108] Build status: STARTED
[12:22:36.108] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:30:0) after 3m34s
[12:26:10.178] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:30:0)
[12:26:10.195] Build status: STARTED
[12:26:10.196] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:31:0) after 6m8s
[12:32:18.286] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:31:0)
[12:32:18.369] Build status: STARTED
[12:32:18.369] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:32:0) after 5m51s
[12:38:09.508] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:32:0)
[12:38:09.527] Build status: STARTED
[12:38:09.527] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:33:0) after 5m4s
[12:43:13.531] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:33:0)
[12:43:13.546] Build status: STARTED
[12:43:13.546] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:34:0) after 7m27s
[12:50:40.664] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:34:0)
[12:50:40.855] Build status: STARTED
[12:50:40.855] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:35:0) after 2m30s
[12:53:10.891] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:35:0)
[12:53:10.908] Build status: STARTED
[12:53:10.908] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:36:0) after 1m48s
[12:54:59.142] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:36:0)
[12:54:59.159] Build status: STARTED
[12:54:59.159] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:37:0) after 8m18s
[13:03:17.246] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:37:0)
[13:03:17.280] Build status: STARTED
[13:03:17.280] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:38:0) after 4m25s
[13:07:42.345] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:38:0)
[13:07:42.362] Build status: STARTED
[13:07:42.362] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:39:0) after 4m48s
[13:12:30.544] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:39:0)
[13:12:30.680] Build status: STARTED
[13:12:30.680] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:40:0) after 9m57s
[13:22:27.694] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:40:0)
[13:22:27.713] Build status: STARTED
[13:22:27.713] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:41:0) after 3m10s
[13:25:37.735] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:41:0)
[13:25:37.752] Build status: STARTED
[13:25:37.752] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:42:0) after 2m44s
[13:28:21.811] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:42:0)
[13:28:21.851] Build status: STARTED
[13:28:21.851] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:43:0) after 5m51s
[13:34:12.899] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:43:0)
[13:34:12.935] Build status: STARTED
[13:34:12.935] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:44:0) after 9m11s
[13:43:23.944] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:44:0)
[13:43:23.960] Build status: STARTED
[13:43:23.960] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:45:0) after 1m40s
[13:45:04.038] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:45:0)
[13:45:04.184] Build status: STARTED
[13:45:04.184] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:46:0) after 5m58s
[13:51:02.208] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:46:0)
[13:51:02.247] Build status: STARTED
[13:51:02.247] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:47:0) after 1m17s
[13:52:19.282] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:47:0)
[13:52:19.346] Build status: STARTED
[13:52:19.346] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:48:0) after 1m24s
[13:53:43.433] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:48:0)
[13:53:43.449] Build status: STARTED
[13:53:43.449] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:49:0) after 8m35s
[14:02:18.468] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:49:0)
[14:02:18.494] Build status: STARTED
[14:02:18.494] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:50:0) after 5m45s
[14:08:03.649] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:50:0)
[14:08:03.665] Build status: STARTED
[14:08:03.665] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:51:0) after 3m35s
[14:11:38.886] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:51:0)
[14:11:38.900] Build status: STARTED
[14:11:38.900] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:52:0) after 4m1s
[14:15:39.914] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:52:0)
[14:15:39.933] Build status: STARTED
[14:15:39.933] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:53:0) after 9m27s
[14:25:07.012] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:53:0)
[14:25:07.040] Build status: STARTED
[14:25:07.040] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:54:0) after 1m1s
[14:26:08.404] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:54:0)
[14:26:08.487] Build status: STARTED
[14:26:08.487] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848081158984267008:55:0) after 6m25s
[14:31:13.753] Received PubSub notification, asking Buildbucket for the build status
[14:31:13.812] Build:
{
"id": "8682651097108202993",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 41459,
"createdBy": "project:chromium",
"createTime": "2026-05-05T10:07:52.579146483Z",
"startTime": "2026-05-05T10:08:28.184003502Z",
"endTime": "2026-05-05T14:31:13.505269234Z",
"updateTime": "2026-05-05T14:31:13.505269234Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "29e7f72feceeb504e307016c87823a7bc3a820ac",
"ref": "refs/heads/main"
}
}
}
[14:31:13.812] Invocation finished in 4h23m22.40618762s with status FAILED