[21:55:50.493] New invocation is queued and will start shortly
[21:55:51.538] Starting the invocation (attempt 1)
[21:55:51.564] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/aa43a2919d8aa09998100a30f488e13b867966ff"
[21:55:51.564] Popped gitiles commit info from properties and tags
[21:55:51.564] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[21:55:51.564] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[21:55:51.564] Buildbucket request:
{
"requestId": "8836440204740088160",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "aa43a2919d8aa09998100a30f488e13b867966ff",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8836440204740088160"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[21:55:52.089] Scheduled build:
{
"id": "8671010142891168513",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 43176,
"createdBy": "project:chromium",
"createTime": "2026-09-10T21:55:51.634213639Z",
"updateTime": "2026-09-10T21:55:51.634213639Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "aa43a2919d8aa09998100a30f488e13b867966ff",
"ref": "refs/heads/main"
}
}
}
[21:55:52.089] Task URL: https://cr-buildbucket.appspot.com/build/8671010142891168513
[21:55:52.089] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:2:0) after 8m22s
[21:55:53.081] Received PubSub notification, asking Buildbucket for the build status
[21:55:53.116] Build status: SCHEDULED
[21:55:58.631] Received PubSub notification, asking Buildbucket for the build status
[21:55:58.689] Build status: STARTED
[22:04:14.115] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:2:0)
[22:04:14.136] Build status: STARTED
[22:04:14.136] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:5:0) after 3m21s
[22:07:35.115] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:5:0)
[22:07:35.174] Build status: STARTED
[22:07:35.174] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:6:0) after 9m46s
[22:17:21.485] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:6:0)
[22:17:21.529] Build status: STARTED
[22:17:21.529] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:7:0) after 3m38s
[22:20:59.662] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:7:0)
[22:20:59.680] Build status: STARTED
[22:20:59.682] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:8:0) after 5m20s
[22:26:19.785] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:8:0)
[22:26:19.803] Build status: STARTED
[22:26:19.803] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:9:0) after 1m9s
[22:27:28.826] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:9:0)
[22:27:29.019] Build status: STARTED
[22:27:29.019] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:10:0) after 7m24s
[22:34:53.042] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:10:0)
[22:34:53.065] Build status: STARTED
[22:34:53.065] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:11:0) after 4m58s
[22:39:51.063] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:11:0)
[22:39:51.084] Build status: STARTED
[22:39:51.084] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:12:0) after 3m9s
[22:43:00.313] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:12:0)
[22:43:00.334] Build status: STARTED
[22:43:00.334] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:13:0) after 9m55s
[22:52:55.463] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:13:0)
[22:52:55.485] Build status: STARTED
[22:52:55.485] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:14:0) after 1m23s
[22:54:18.495] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:14:0)
[22:54:18.567] Build status: STARTED
[22:54:18.567] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:15:0) after 1m15s
[22:55:33.589] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:15:0)
[22:55:33.612] Build status: STARTED
[22:55:33.612] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:16:0) after 7m55s
[23:03:29.187] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:16:0)
[23:03:29.207] Build status: STARTED
[23:03:29.207] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:17:0) after 9m26s
[23:12:55.246] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:17:0)
[23:12:55.272] Build status: STARTED
[23:12:55.272] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:18:0) after 6m56s
[23:19:51.326] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:18:0)
[23:19:51.361] Build status: STARTED
[23:19:51.361] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:19:0) after 6m4s
[23:25:55.347] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:19:0)
[23:25:55.369] Build status: STARTED
[23:25:55.370] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:20:0) after 3m57s
[23:29:52.492] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:20:0)
[23:29:52.519] Build status: STARTED
[23:29:52.519] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:21:0) after 8m33s
[23:38:25.637] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:21:0)
[23:38:25.662] Build status: STARTED
[23:38:25.662] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:22:0) after 4m21s
[23:42:46.686] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:22:0)
[23:42:46.715] Build status: STARTED
[23:42:46.715] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:23:0) after 7m53s
[23:50:39.737] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:23:0)
[23:50:39.755] Build status: STARTED
[23:50:39.755] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:24:0) after 7m45s
[23:58:24.777] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:24:0)
[23:58:24.795] Build status: STARTED
[23:58:24.795] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:25:0) after 8m43s
[00:07:07.847] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:25:0)
[00:07:07.864] Build status: STARTED
[00:07:07.864] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:26:0) after 7m7s
[00:14:14.975] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:26:0)
[00:14:15.006] Build status: STARTED
[00:14:15.006] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:27:0) after 6m22s
[00:20:37.183] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:27:0)
[00:20:37.209] Build status: STARTED
[00:20:37.209] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:28:0) after 1m52s
[00:22:29.322] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:28:0)
[00:22:29.341] Build status: STARTED
[00:22:29.341] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:29:0) after 8m5s
[00:30:34.358] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:29:0)
[00:30:34.377] Build status: STARTED
[00:30:34.377] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:30:0) after 7m28s
[00:38:02.425] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:30:0)
[00:38:02.443] Build status: STARTED
[00:38:02.443] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:31:0) after 7m3s
[00:45:05.466] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:31:0)
[00:45:05.491] Build status: STARTED
[00:45:05.491] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:32:0) after 2m38s
[00:47:43.614] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:32:0)
[00:47:43.629] Build status: STARTED
[00:47:43.629] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:33:0) after 3m48s
[00:51:31.657] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:33:0)
[00:51:31.681] Build status: STARTED
[00:51:31.681] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:34:0) after 3m32s
[00:55:03.990] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:34:0)
[00:55:04.218] Build status: STARTED
[00:55:04.218] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:35:0) after 4m24s
[00:59:28.505] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:35:0)
[00:59:28.530] Build status: STARTED
[00:59:28.530] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:36:0) after 9m13s
[01:08:41.610] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:36:0)
[01:08:41.731] Build status: STARTED
[01:08:41.731] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:37:0) after 1m18s
[01:09:59.854] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:37:0)
[01:09:59.877] Build status: STARTED
[01:09:59.877] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:38:0) after 5m4s
[01:15:04.085] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:38:0)
[01:15:04.117] Build status: STARTED
[01:15:04.117] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:39:0) after 1m41s
[01:16:45.312] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:39:0)
[01:16:45.331] Build status: STARTED
[01:16:45.331] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:40:0) after 4m14s
[01:20:59.358] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:40:0)
[01:20:59.387] Build status: STARTED
[01:20:59.387] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:41:0) after 7m17s
[01:28:16.470] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:41:0)
[01:28:16.492] Build status: STARTED
[01:28:16.492] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:42:0) after 3m44s
[01:32:00.577] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:42:0)
[01:32:00.606] Build status: STARTED
[01:32:00.607] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:43:0) after 6m8s
[01:38:08.636] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:43:0)
[01:38:08.657] Build status: STARTED
[01:38:08.657] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:44:0) after 7m6s
[01:45:14.688] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:44:0)
[01:45:14.720] Build status: STARTED
[01:45:14.720] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:45:0) after 8m59s
[01:54:13.742] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:45:0)
[01:54:13.781] Build status: STARTED
[01:54:13.781] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:46:0) after 2m6s
[01:56:19.853] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:46:0)
[01:56:19.879] Build status: STARTED
[01:56:19.879] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:47:0) after 8m19s
[02:04:39.170] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:47:0)
[02:04:39.191] Build status: STARTED
[02:04:39.191] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:48:0) after 7m29s
[02:12:08.473] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:48:0)
[02:12:08.502] Build status: STARTED
[02:12:08.502] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:49:0) after 3m22s
[02:15:30.539] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:49:0)
[02:15:30.578] Build status: STARTED
[02:15:30.578] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:50:0) after 8m2s
[02:23:32.718] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:50:0)
[02:23:32.776] Build status: STARTED
[02:23:32.777] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:51:0) after 6m10s
[02:29:42.829] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:51:0)
[02:29:42.849] Build status: STARTED
[02:29:42.849] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:52:0) after 8m22s
[02:38:04.921] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:52:0)
[02:38:04.940] Build status: STARTED
[02:38:04.940] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:53:0) after 6m56s
[02:45:01.142] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:53:0)
[02:45:01.162] Build status: STARTED
[02:45:01.162] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:54:0) after 2m42s
[02:47:43.231] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:54:0)
[02:47:43.256] Build status: STARTED
[02:47:43.256] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8836440204740088160:55:0) after 4m43s
[02:49:09.120] Received PubSub notification, asking Buildbucket for the build status
[02:49:09.138] Build:
{
"id": "8671010142891168513",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 43176,
"createdBy": "project:chromium",
"createTime": "2026-09-10T21:55:51.634213639Z",
"startTime": "2026-09-10T21:55:58.314703888Z",
"endTime": "2026-09-11T02:49:07.383709612Z",
"updateTime": "2026-09-11T02:49:07.383709612Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "aa43a2919d8aa09998100a30f488e13b867966ff",
"ref": "refs/heads/main"
}
}
}
[02:49:09.138] Invocation finished in 4h53m18.651426374s with status FAILED