[14:07:46.298] New invocation is queued and will start shortly
[14:07:47.334] Starting the invocation (attempt 1)
[14:07:47.364] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/45570c45654c7ff73a53e4f2e7ffe6c668a7f41e"
[14:07:47.365] Popped gitiles commit info from properties and tags
[14:07:47.365] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[14:07:47.365] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[14:07:47.365] Buildbucket request:
{
"requestId": "8854317255531692064",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "45570c45654c7ff73a53e4f2e7ffe6c668a7f41e",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8854317255531692064"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[14:07:47.857] Scheduled build:
{
"id": "8688887193704400465",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 40800,
"createdBy": "project:chromium",
"createTime": "2026-02-25T14:07:47.420188604Z",
"updateTime": "2026-02-25T14:07:47.420188604Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "45570c45654c7ff73a53e4f2e7ffe6c668a7f41e",
"ref": "refs/heads/main"
}
}
}
[14:07:47.858] Task URL: https://cr-buildbucket.appspot.com/build/8688887193704400465
[14:07:47.858] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:2:0) after 5m7s
[14:07:48.807] Received PubSub notification, asking Buildbucket for the build status
[14:07:48.829] Build status: SCHEDULED
[14:09:02.592] Received PubSub notification, asking Buildbucket for the build status
[14:09:02.667] Build status: STARTED
[14:12:54.880] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:2:0)
[14:12:54.933] Build status: STARTED
[14:12:54.933] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:5:0) after 3m26s
[14:16:20.998] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:5:0)
[14:16:21.013] Build status: STARTED
[14:16:21.013] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:6:0) after 1m16s
[14:17:37.087] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:6:0)
[14:17:37.132] Build status: STARTED
[14:17:37.132] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:7:0) after 9m24s
[14:27:01.107] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:7:0)
[14:27:01.130] Build status: STARTED
[14:27:01.130] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:8:0) after 8m26s
[14:35:27.147] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:8:0)
[14:35:27.184] Build status: STARTED
[14:35:27.184] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:9:0) after 2m12s
[14:37:39.200] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:9:0)
[14:37:39.222] Build status: STARTED
[14:37:39.222] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:10:0) after 1m40s
[14:39:19.245] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:10:0)
[14:39:19.258] Build status: STARTED
[14:39:19.258] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:11:0) after 3m15s
[14:42:34.274] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:11:0)
[14:42:34.339] Build status: STARTED
[14:42:34.340] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:12:0) after 1m47s
[14:44:21.406] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:12:0)
[14:44:21.421] Build status: STARTED
[14:44:21.421] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:13:0) after 3m14s
[14:47:35.459] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:13:0)
[14:47:35.473] Build status: STARTED
[14:47:35.473] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:14:0) after 5m59s
[14:53:34.577] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:14:0)
[14:53:34.639] Build status: STARTED
[14:53:34.639] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:15:0) after 8m18s
[15:01:52.752] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:15:0)
[15:01:52.790] Build status: STARTED
[15:01:52.791] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:16:0) after 7m45s
[15:09:37.895] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:16:0)
[15:09:37.911] Build status: STARTED
[15:09:37.911] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:17:0) after 4m17s
[15:13:54.968] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:17:0)
[15:13:55.165] Build status: STARTED
[15:13:55.165] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:18:0) after 3m45s
[15:17:40.184] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:18:0)
[15:17:40.211] Build status: STARTED
[15:17:40.211] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:19:0) after 3m28s
[15:21:08.227] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:19:0)
[15:21:08.270] Build status: STARTED
[15:21:08.270] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:20:0) after 2m37s
[15:23:45.291] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:20:0)
[15:23:45.373] Build status: STARTED
[15:23:45.373] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:21:0) after 6m43s
[15:30:28.389] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:21:0)
[15:30:28.412] Build status: STARTED
[15:30:28.412] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:22:0) after 6m15s
[15:36:43.534] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:22:0)
[15:36:43.548] Build status: STARTED
[15:36:43.548] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:23:0) after 9m30s
[15:46:13.627] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:23:0)
[15:46:13.646] Build status: STARTED
[15:46:13.646] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:24:0) after 2m39s
[15:48:52.665] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:24:0)
[15:48:52.691] Build status: STARTED
[15:48:52.691] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:25:0) after 5m33s
[15:54:25.709] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:25:0)
[15:54:25.723] Build status: STARTED
[15:54:25.723] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:26:0) after 6m53s
[16:01:18.784] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:26:0)
[16:01:18.802] Build status: STARTED
[16:01:18.802] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:27:0) after 8m28s
[16:09:46.938] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:27:0)
[16:09:46.974] Build status: STARTED
[16:09:46.974] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:28:0) after 4m38s
[16:14:24.992] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:28:0)
[16:14:25.013] Build status: STARTED
[16:14:25.013] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:29:0) after 4m55s
[16:19:20.070] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:29:0)
[16:19:20.089] Build status: STARTED
[16:19:20.089] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:30:0) after 5m55s
[16:25:15.130] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:30:0)
[16:25:15.151] Build status: STARTED
[16:25:15.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:31:0) after 2m26s
[16:27:41.268] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:31:0)
[16:27:41.284] Build status: STARTED
[16:27:41.284] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:32:0) after 5m5s
[16:32:46.401] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:32:0)
[16:32:46.452] Build status: STARTED
[16:32:46.452] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:33:0) after 1m57s
[16:34:43.617] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:33:0)
[16:34:43.636] Build status: STARTED
[16:34:43.636] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:34:0) after 6m8s
[16:40:51.656] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:34:0)
[16:40:51.672] Build status: STARTED
[16:40:51.673] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:35:0) after 9m48s
[16:50:39.691] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:35:0)
[16:50:39.706] Build status: STARTED
[16:50:39.706] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:36:0) after 8m16s
[16:58:55.701] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:36:0)
[16:58:55.722] Build status: STARTED
[16:58:55.722] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:37:0) after 3m42s
[17:02:37.889] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:37:0)
[17:02:37.929] Build status: STARTED
[17:02:37.929] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:38:0) after 8m51s
[17:11:28.958] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:38:0)
[17:11:28.988] Build status: STARTED
[17:11:28.988] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:39:0) after 3m15s
[17:14:44.056] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:39:0)
[17:14:44.077] Build status: STARTED
[17:14:44.077] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:40:0) after 6m14s
[17:20:58.130] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:40:0)
[17:20:58.153] Build status: STARTED
[17:20:58.153] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:41:0) after 8m34s
[17:29:32.170] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:41:0)
[17:29:32.185] Build status: STARTED
[17:29:32.185] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:42:0) after 7m35s
[17:37:07.272] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:42:0)
[17:37:07.298] Build status: STARTED
[17:37:07.298] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:43:0) after 8m46s
[17:45:53.316] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:43:0)
[17:45:53.336] Build status: STARTED
[17:45:53.336] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:44:0) after 7m37s
[17:53:30.504] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:44:0)
[17:53:30.526] Build status: STARTED
[17:53:30.526] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:45:0) after 1m26s
[17:54:56.595] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:45:0)
[17:54:56.653] Build status: STARTED
[17:54:56.653] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:46:0) after 8m53s
[18:03:49.673] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:46:0)
[18:03:49.689] Build status: STARTED
[18:03:49.689] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:47:0) after 2m17s
[18:06:06.704] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:47:0)
[18:06:06.720] Build status: STARTED
[18:06:06.720] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:48:0) after 1m58s
[18:08:04.740] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:48:0)
[18:08:04.783] Build status: STARTED
[18:08:04.783] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:49:0) after 8m9s
[18:16:13.798] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:49:0)
[18:16:13.816] Build status: STARTED
[18:16:13.816] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:50:0) after 3m11s
[18:19:24.881] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:50:0)
[18:19:24.916] Build status: STARTED
[18:19:24.916] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:51:0) after 3m50s
[18:23:15.008] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:51:0)
[18:23:15.024] Build status: STARTED
[18:23:15.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:52:0) after 9m9s
[18:32:24.099] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:52:0)
[18:32:24.113] Build status: STARTED
[18:32:24.113] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:53:0) after 1m2s
[18:33:26.134] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:53:0)
[18:33:26.150] Build status: STARTED
[18:33:26.150] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854317255531692064:54:0) after 8m11s
[18:37:53.708] Received PubSub notification, asking Buildbucket for the build status
[18:37:53.723] Build:
{
"id": "8688887193704400465",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 40800,
"createdBy": "project:chromium",
"createTime": "2026-02-25T14:07:47.420188604Z",
"startTime": "2026-02-25T14:09:02.335552553Z",
"endTime": "2026-02-25T18:37:53.142910516Z",
"updateTime": "2026-02-25T18:37:53.142910516Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "45570c45654c7ff73a53e4f2e7ffe6c668a7f41e",
"ref": "refs/heads/main"
}
}
}
[18:37:53.723] Invocation finished in 4h30m7.429369356s with status FAILED