[17:12:56.736] New invocation is queued and will start shortly
[17:12:58.259] Starting the invocation (attempt 1)
[17:12:58.291] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/1e096439642c4bb9a812c7dc0dee6757fd5cf529"
[17:12:58.292] Popped gitiles commit info from properties and tags
[17:12:58.292] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[17:12:58.292] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[17:12:58.292] Buildbucket request:
{
"requestId": "8834102481888816992",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1e096439642c4bb9a812c7dc0dee6757fd5cf529",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8834102481888816992"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[17:12:58.927] Scheduled build:
{
"id": "8668672419448109777",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 44179,
"createdBy": "project:chromium",
"createTime": "2026-10-06T17:12:58.441188435Z",
"updateTime": "2026-10-06T17:12:58.441188435Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1e096439642c4bb9a812c7dc0dee6757fd5cf529",
"ref": "refs/heads/main"
}
}
}
[17:12:58.927] Task URL: https://cr-buildbucket.appspot.com/build/8668672419448109777
[17:12:58.927] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:2:0) after 4m25s
[17:12:59.875] Received PubSub notification, asking Buildbucket for the build status
[17:12:59.899] Build status: SCHEDULED
[17:13:03.387] Received PubSub notification, asking Buildbucket for the build status
[17:13:03.459] Build status: STARTED
[17:17:23.994] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:2:0)
[17:17:24.115] Build status: STARTED
[17:17:24.115] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:5:0) after 3m35s
[17:20:59.315] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:5:0)
[17:20:59.338] Build status: STARTED
[17:20:59.338] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:6:0) after 6m57s
[17:27:56.377] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:6:0)
[17:27:56.408] Build status: STARTED
[17:27:56.408] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:7:0) after 1m6s
[17:29:02.433] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:7:0)
[17:29:02.459] Build status: STARTED
[17:29:02.459] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:8:0) after 9m53s
[17:38:55.489] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:8:0)
[17:38:55.665] Build status: STARTED
[17:38:55.665] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:9:0) after 4m46s
[17:43:41.858] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:9:0)
[17:43:41.876] Build status: STARTED
[17:43:41.876] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:10:0) after 5m15s
[17:48:56.872] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:10:0)
[17:48:56.892] Build status: STARTED
[17:48:56.892] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:11:0) after 1m13s
[17:50:09.917] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:11:0)
[17:50:09.934] Build status: STARTED
[17:50:09.934] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:12:0) after 7m47s
[17:57:56.956] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:12:0)
[17:57:56.983] Build status: STARTED
[17:57:56.983] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:13:0) after 9m35s
[18:07:32.083] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:13:0)
[18:07:32.098] Build status: STARTED
[18:07:32.098] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:14:0) after 9m35s
[18:17:07.119] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:14:0)
[18:17:07.147] Build status: STARTED
[18:17:07.147] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:15:0) after 4m14s
[18:21:21.248] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:15:0)
[18:21:21.331] Build status: STARTED
[18:21:21.331] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:16:0) after 7m6s
[18:28:27.365] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:16:0)
[18:28:27.389] Build status: STARTED
[18:28:27.389] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:17:0) after 4m20s
[18:32:47.410] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:17:0)
[18:32:47.430] Build status: STARTED
[18:32:47.430] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:18:0) after 6m5s
[18:38:52.514] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:18:0)
[18:38:52.584] Build status: STARTED
[18:38:52.584] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:19:0) after 5m38s
[18:44:30.640] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:19:0)
[18:44:30.694] Build status: STARTED
[18:44:30.694] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:20:0) after 1m49s
[18:46:19.691] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:20:0)
[18:46:19.708] Build status: STARTED
[18:46:19.708] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:21:0) after 4m46s
[18:51:05.689] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:21:0)
[18:51:05.712] Build status: STARTED
[18:51:05.712] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:22:0) after 4m11s
[18:55:16.733] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:22:0)
[18:55:16.757] Build status: STARTED
[18:55:16.757] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:23:0) after 3m23s
[18:58:39.919] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:23:0)
[18:58:39.936] Build status: STARTED
[18:58:39.936] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:24:0) after 4m33s
[19:03:12.987] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:24:0)
[19:03:13.069] Build status: STARTED
[19:03:13.069] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:25:0) after 2m32s
[19:05:45.142] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:25:0)
[19:05:45.158] Build status: STARTED
[19:05:45.158] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:26:0) after 4m52s
[19:10:37.208] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:26:0)
[19:10:37.233] Build status: STARTED
[19:10:37.233] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:27:0) after 1m41s
[19:12:18.283] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:27:0)
[19:12:18.302] Build status: STARTED
[19:12:18.302] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:28:0) after 2m18s
[19:14:36.378] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:28:0)
[19:14:36.429] Build status: STARTED
[19:14:36.429] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:29:0) after 5m25s
[19:20:01.416] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:29:0)
[19:20:01.445] Build status: STARTED
[19:20:01.445] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:30:0) after 7m36s
[19:27:37.469] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:30:0)
[19:27:37.495] Build status: STARTED
[19:27:37.495] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:31:0) after 8m6s
[19:35:43.728] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:31:0)
[19:35:43.772] Build status: STARTED
[19:35:43.772] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:32:0) after 6m19s
[19:42:02.985] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:32:0)
[19:42:03.012] Build status: STARTED
[19:42:03.012] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:33:0) after 7m21s
[19:49:24.200] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:33:0)
[19:49:24.217] Build status: STARTED
[19:49:24.218] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:34:0) after 8m45s
[19:58:09.238] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:34:0)
[19:58:09.264] Build status: STARTED
[19:58:09.264] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:35:0) after 1m58s
[20:00:07.451] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:35:0)
[20:00:07.485] Build status: STARTED
[20:00:07.485] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:36:0) after 8m24s
[20:08:31.962] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:36:0)
[20:08:31.984] Build status: STARTED
[20:08:31.984] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:37:0) after 9m44s
[20:18:16.057] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:37:0)
[20:18:16.081] Build status: STARTED
[20:18:16.081] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:38:0) after 3m17s
[20:21:33.220] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:38:0)
[20:21:33.243] Build status: STARTED
[20:21:33.243] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:39:0) after 6m56s
[20:28:29.462] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:39:0)
[20:28:29.480] Build status: STARTED
[20:28:29.480] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:40:0) after 7m56s
[20:36:25.577] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:40:0)
[20:36:25.597] Build status: STARTED
[20:36:25.597] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:41:0) after 4m9s
[20:40:34.622] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:41:0)
[20:40:34.643] Build status: STARTED
[20:40:34.643] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:42:0) after 2m22s
[20:42:56.654] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:42:0)
[20:42:56.680] Build status: STARTED
[20:42:56.680] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:43:0) after 2m43s
[20:45:39.737] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:43:0)
[20:45:39.777] Build status: STARTED
[20:45:39.777] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:44:0) after 9m18s
[20:54:57.793] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:44:0)
[20:54:57.850] Build status: STARTED
[20:54:57.850] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:45:0) after 8m41s
[21:03:38.873] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:45:0)
[21:03:38.891] Build status: STARTED
[21:03:38.891] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:46:0) after 9m14s
[21:12:52.932] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:46:0)
[21:12:52.955] Build status: STARTED
[21:12:52.955] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:47:0) after 8m57s
[21:21:50.051] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:47:0)
[21:21:50.067] Build status: STARTED
[21:21:50.067] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:48:0) after 4m10s
[21:26:00.279] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:48:0)
[21:26:00.299] Build status: STARTED
[21:26:00.299] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8834102481888816992:49:0) after 9m19s
[21:31:10.443] Received PubSub notification, asking Buildbucket for the build status
[21:31:10.495] Build:
{
"id": "8668672419448109777",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 44179,
"createdBy": "project:chromium",
"createTime": "2026-10-06T17:12:58.441188435Z",
"startTime": "2026-10-06T17:13:02.886087081Z",
"endTime": "2026-10-06T21:31:10.120142786Z",
"updateTime": "2026-10-06T21:31:10.120142786Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1e096439642c4bb9a812c7dc0dee6757fd5cf529",
"ref": "refs/heads/main"
}
}
}
[21:31:10.495] Invocation finished in 4h18m13.766197665s with status FAILED