[02:57:31.335] New invocation is queued and will start shortly
[02:57:32.427] Starting the invocation (attempt 1)
[02:57:32.453] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/143ddd0853b7de224f52b6f281aa0956f2a5add9"
[02:57:32.453] Popped gitiles commit info from properties and tags
[02:57:32.453] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[02:57:32.453] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[02:57:32.453] Buildbucket request:
{
"requestId": "8842853609247217872",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "143ddd0853b7de224f52b6f281aa0956f2a5add9",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8842853609247217872"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[02:57:33.034] Scheduled build:
{
"id": "8677423547349333681",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 42355,
"createdBy": "project:chromium",
"createTime": "2026-07-02T02:57:32.522510868Z",
"updateTime": "2026-07-02T02:57:32.522510868Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "143ddd0853b7de224f52b6f281aa0956f2a5add9",
"ref": "refs/heads/main"
}
}
}
[02:57:33.034] Task URL: https://cr-buildbucket.appspot.com/build/8677423547349333681
[02:57:33.034] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:2:0) after 7m54s
[02:57:33.219] Received PubSub notification, asking Buildbucket for the build status
[02:57:33.235] Build status: SCHEDULED
[02:57:38.744] Received PubSub notification, asking Buildbucket for the build status
[02:57:38.765] Build status: STARTED
[03:05:27.041] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:2:0)
[03:05:27.087] Build status: STARTED
[03:05:27.087] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:5:0) after 6m30s
[03:11:57.077] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:5:0)
[03:11:57.102] Build status: STARTED
[03:11:57.102] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:6:0) after 2m25s
[03:14:22.116] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:6:0)
[03:14:22.131] Build status: STARTED
[03:14:22.131] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:7:0) after 1m32s
[03:15:54.167] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:7:0)
[03:15:54.271] Build status: STARTED
[03:15:54.271] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:8:0) after 9m32s
[03:25:26.289] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:8:0)
[03:25:26.314] Build status: STARTED
[03:25:26.314] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:9:0) after 1m24s
[03:26:50.332] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:9:0)
[03:26:50.429] Build status: STARTED
[03:26:50.429] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:10:0) after 4m0s
[03:30:50.486] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:10:0)
[03:30:50.512] Build status: STARTED
[03:30:50.512] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:11:0) after 9m20s
[03:40:10.651] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:11:0)
[03:40:10.674] Build status: STARTED
[03:40:10.674] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:12:0) after 5m14s
[03:45:24.741] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:12:0)
[03:45:24.757] Build status: STARTED
[03:45:24.757] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:13:0) after 2m33s
[03:47:57.796] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:13:0)
[03:47:57.817] Build status: STARTED
[03:47:57.817] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:14:0) after 1m57s
[03:49:54.833] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:14:0)
[03:49:54.849] Build status: STARTED
[03:49:54.849] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:15:0) after 5m49s
[03:55:43.866] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:15:0)
[03:55:43.921] Build status: STARTED
[03:55:43.921] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:16:0) after 1m23s
[03:57:07.125] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:16:0)
[03:57:07.177] Build status: STARTED
[03:57:07.177] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:17:0) after 5m44s
[04:02:51.195] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:17:0)
[04:02:51.218] Build status: STARTED
[04:02:51.218] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:18:0) after 5m3s
[04:07:54.250] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:18:0)
[04:07:54.358] Build status: STARTED
[04:07:54.358] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:19:0) after 4m18s
[04:12:12.378] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:19:0)
[04:12:12.399] Build status: STARTED
[04:12:12.399] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:20:0) after 2m1s
[04:14:13.417] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:20:0)
[04:14:13.438] Build status: STARTED
[04:14:13.438] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:21:0) after 4m13s
[04:18:26.680] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:21:0)
[04:18:26.702] Build status: STARTED
[04:18:26.702] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:22:0) after 7m45s
[04:26:11.721] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:22:0)
[04:26:11.741] Build status: STARTED
[04:26:11.741] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:23:0) after 6m29s
[04:32:40.806] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:23:0)
[04:32:40.870] Build status: STARTED
[04:32:40.870] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:24:0) after 6m30s
[04:39:10.967] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:24:0)
[04:39:10.992] Build status: STARTED
[04:39:10.992] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:25:0) after 3m3s
[04:42:14.007] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:25:0)
[04:42:14.024] Build status: STARTED
[04:42:14.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:26:0) after 1m32s
[04:43:46.044] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:26:0)
[04:43:46.079] Build status: STARTED
[04:43:46.079] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:27:0) after 8m49s
[04:52:35.095] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:27:0)
[04:52:35.149] Build status: STARTED
[04:52:35.150] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:28:0) after 7m3s
[04:59:38.164] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:28:0)
[04:59:38.230] Build status: STARTED
[04:59:38.230] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:29:0) after 8m0s
[05:07:38.261] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:29:0)
[05:07:38.276] Build status: STARTED
[05:07:38.276] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:30:0) after 6m13s
[05:13:51.304] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:30:0)
[05:13:51.325] Build status: STARTED
[05:13:51.325] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:31:0) after 5m27s
[05:19:18.324] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:31:0)
[05:19:18.415] Build status: STARTED
[05:19:18.415] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:32:0) after 1m51s
[05:21:09.432] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:32:0)
[05:21:09.453] Build status: STARTED
[05:21:09.453] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:33:0) after 2m47s
[05:23:56.565] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:33:0)
[05:23:56.584] Build status: STARTED
[05:23:56.584] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:34:0) after 4m14s
[05:28:10.561] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:34:0)
[05:28:10.586] Build status: STARTED
[05:28:10.586] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:35:0) after 4m30s
[05:32:40.605] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:35:0)
[05:32:40.626] Build status: STARTED
[05:32:40.626] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:36:0) after 3m41s
[05:36:21.649] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:36:0)
[05:36:21.671] Build status: STARTED
[05:36:21.671] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:37:0) after 3m50s
[05:40:11.717] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:37:0)
[05:40:11.771] Build status: STARTED
[05:40:11.771] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:38:0) after 4m35s
[05:44:46.789] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:38:0)
[05:44:46.807] Build status: STARTED
[05:44:46.807] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:39:0) after 2m32s
[05:47:18.821] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:39:0)
[05:47:18.839] Build status: STARTED
[05:47:18.839] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:40:0) after 2m9s
[05:49:27.945] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:40:0)
[05:49:27.967] Build status: STARTED
[05:49:27.967] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:41:0) after 8m56s
[05:58:23.983] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:41:0)
[05:58:24.002] Build status: STARTED
[05:58:24.003] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:42:0) after 4m26s
[06:02:50.024] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:42:0)
[06:02:50.045] Build status: STARTED
[06:02:50.045] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:43:0) after 7m53s
[06:10:43.044] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:43:0)
[06:10:43.064] Build status: STARTED
[06:10:43.064] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:44:0) after 9m58s
[06:20:41.153] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:44:0)
[06:20:41.170] Build status: STARTED
[06:20:41.170] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:45:0) after 1m35s
[06:22:16.157] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:45:0)
[06:22:16.179] Build status: STARTED
[06:22:16.179] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:46:0) after 4m33s
[06:26:49.219] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:46:0)
[06:26:49.271] Build status: STARTED
[06:26:49.271] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:47:0) after 2m49s
[06:29:38.406] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:47:0)
[06:29:38.428] Build status: STARTED
[06:29:38.428] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:48:0) after 6m53s
[06:36:31.444] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:48:0)
[06:36:31.469] Build status: STARTED
[06:36:31.469] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:49:0) after 1m56s
[06:38:27.486] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:49:0)
[06:38:27.504] Build status: STARTED
[06:38:27.504] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:50:0) after 2m48s
[06:41:15.547] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:50:0)
[06:41:15.564] Build status: STARTED
[06:41:15.564] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:51:0) after 7m45s
[06:49:00.583] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:51:0)
[06:49:00.599] Build status: STARTED
[06:49:00.599] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:52:0) after 9m56s
[06:58:56.665] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:52:0)
[06:58:56.682] Build status: STARTED
[06:58:56.682] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:53:0) after 2m9s
[07:01:05.694] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:53:0)
[07:01:05.710] Build status: STARTED
[07:01:05.710] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:54:0) after 6m49s
[07:07:54.736] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:54:0)
[07:07:54.754] Build status: STARTED
[07:07:54.754] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:55:0) after 3m10s
[07:11:04.769] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:55:0)
[07:11:04.787] Build status: STARTED
[07:11:04.787] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:56:0) after 5m7s
[07:16:11.837] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:56:0)
[07:16:11.855] Build status: STARTED
[07:16:11.855] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:57:0) after 3m2s
[07:19:13.895] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:57:0)
[07:19:13.922] Build status: STARTED
[07:19:13.922] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842853609247217872:58:0) after 8m25s
[07:24:22.386] Received PubSub notification, asking Buildbucket for the build status
[07:24:22.401] Build:
{
"id": "8677423547349333681",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 42355,
"createdBy": "project:chromium",
"createTime": "2026-07-02T02:57:32.522510868Z",
"startTime": "2026-07-02T02:57:38.547420400Z",
"endTime": "2026-07-02T07:24:22.131994623Z",
"updateTime": "2026-07-02T07:24:22.131994623Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "143ddd0853b7de224f52b6f281aa0956f2a5add9",
"ref": "refs/heads/main"
}
}
}
[07:24:22.401] Invocation finished in 4h26m51.072813476s with status FAILED