[13:55:44.271] New invocation is queued and will start shortly
[13:55:45.404] Starting the invocation (attempt 1)
[13:55:45.437] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/736c7aa0220e2120a49afdc033321240b4e065dd"
[13:55:45.437] Popped gitiles commit info from properties and tags
[13:55:45.437] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[13:55:45.437] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[13:55:45.437] Buildbucket request:
{
"requestId": "8875698896705852160",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "736c7aa0220e2120a49afdc033321240b4e065dd",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8875698896705852160"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[13:55:45.997] Scheduled build:
{
"id": "8710268834767368273",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 38752,
"createdBy": "project:chromium",
"createTime": "2025-07-04T13:55:45.496111223Z",
"updateTime": "2025-07-04T13:55:45.496111223Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "736c7aa0220e2120a49afdc033321240b4e065dd",
"ref": "refs/heads/main"
}
}
}
[13:55:45.997] Task URL: https://cr-buildbucket.appspot.com/build/8710268834767368273
[13:55:45.997] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:2:0) after 6m20s
[13:55:47.016] Received PubSub notification, asking Buildbucket for the build status
[13:55:47.046] Build status: SCHEDULED
[13:55:49.622] Received PubSub notification, asking Buildbucket for the build status
[13:55:49.673] Build status: STARTED
[14:02:06.067] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:2:0)
[14:02:06.098] Build status: STARTED
[14:02:06.098] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:5:0) after 5m41s
[14:07:47.115] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:5:0)
[14:07:47.151] Build status: STARTED
[14:07:47.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:6:0) after 7m53s
[14:15:40.156] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:6:0)
[14:15:40.184] Build status: STARTED
[14:15:40.184] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:7:0) after 4m11s
[14:19:51.199] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:7:0)
[14:19:51.234] Build status: STARTED
[14:19:51.234] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:8:0) after 2m43s
[14:22:34.348] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:8:0)
[14:22:34.383] Build status: STARTED
[14:22:34.383] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:9:0) after 6m7s
[14:28:41.406] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:9:0)
[14:28:41.431] Build status: STARTED
[14:28:41.431] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:10:0) after 3m6s
[14:31:47.457] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:10:0)
[14:31:47.490] Build status: STARTED
[14:31:47.490] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:11:0) after 3m41s
[14:35:28.474] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:11:0)
[14:35:28.548] Build status: STARTED
[14:35:28.548] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:12:0) after 6m52s
[14:42:20.554] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:12:0)
[14:42:20.571] Build status: STARTED
[14:42:20.572] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:13:0) after 9m31s
[14:51:51.592] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:13:0)
[14:51:51.670] Build status: STARTED
[14:51:51.670] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:14:0) after 8m13s
[15:00:05.016] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:14:0)
[15:00:05.039] Build status: STARTED
[15:00:05.039] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:15:0) after 4m50s
[15:04:55.378] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:15:0)
[15:04:55.404] Build status: STARTED
[15:04:55.404] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:16:0) after 1m39s
[15:06:34.579] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:16:0)
[15:06:34.612] Build status: STARTED
[15:06:34.612] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:17:0) after 5m5s
[15:11:39.875] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:17:0)
[15:11:39.928] Build status: STARTED
[15:11:39.929] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:18:0) after 2m33s
[15:14:12.946] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:18:0)
[15:14:12.965] Build status: STARTED
[15:14:12.965] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:19:0) after 8m41s
[15:22:54.315] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:19:0)
[15:22:54.334] Build status: STARTED
[15:22:54.334] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:20:0) after 9m26s
[15:32:20.359] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:20:0)
[15:32:20.393] Build status: STARTED
[15:32:20.393] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:21:0) after 5m10s
[15:37:30.467] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:21:0)
[15:37:30.484] Build status: STARTED
[15:37:30.484] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:22:0) after 1m5s
[15:38:35.501] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:22:0)
[15:38:35.523] Build status: STARTED
[15:38:35.523] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:23:0) after 2m58s
[15:41:33.681] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:23:0)
[15:41:33.788] Build status: STARTED
[15:41:33.788] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:24:0) after 4m32s
[15:46:05.913] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:24:0)
[15:46:05.957] Build status: STARTED
[15:46:05.957] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:25:0) after 4m25s
[15:50:30.924] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:25:0)
[15:50:30.944] Build status: STARTED
[15:50:30.944] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:26:0) after 9m34s
[16:00:04.954] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:26:0)
[16:00:04.973] Build status: STARTED
[16:00:04.973] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:27:0) after 4m11s
[16:04:16.015] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:27:0)
[16:04:16.032] Build status: STARTED
[16:04:16.032] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:28:0) after 7m30s
[16:11:46.050] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:28:0)
[16:11:46.081] Build status: STARTED
[16:11:46.082] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:29:0) after 9m59s
[16:21:45.125] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:29:0)
[16:21:45.146] Build status: STARTED
[16:21:45.146] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:30:0) after 7m39s
[16:29:24.250] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:30:0)
[16:29:24.270] Build status: STARTED
[16:29:24.270] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:31:0) after 8m43s
[16:38:07.252] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:31:0)
[16:38:07.278] Build status: STARTED
[16:38:07.278] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:32:0) after 2m44s
[16:40:51.956] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:32:0)
[16:40:51.977] Build status: STARTED
[16:40:51.977] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:33:0) after 1m34s
[16:42:26.025] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:33:0)
[16:42:26.057] Build status: STARTED
[16:42:26.057] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:34:0) after 7m40s
[16:50:06.104] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:34:0)
[16:50:06.124] Build status: STARTED
[16:50:06.124] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:35:0) after 8m47s
[16:58:53.143] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:35:0)
[16:58:53.169] Build status: STARTED
[16:58:53.169] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:36:0) after 1m41s
[17:00:34.181] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:36:0)
[17:00:34.203] Build status: STARTED
[17:00:34.203] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:37:0) after 1m21s
[17:01:55.226] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:37:0)
[17:01:55.245] Build status: STARTED
[17:01:55.245] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:38:0) after 2m58s
[17:04:53.265] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:38:0)
[17:04:53.283] Build status: STARTED
[17:04:53.283] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:39:0) after 2m48s
[17:07:41.304] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:39:0)
[17:07:41.432] Build status: STARTED
[17:07:41.432] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:40:0) after 2m11s
[17:09:52.716] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:40:0)
[17:09:52.737] Build status: STARTED
[17:09:52.737] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:41:0) after 7m43s
[17:17:35.889] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:41:0)
[17:17:35.910] Build status: STARTED
[17:17:35.910] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:42:0) after 8m53s
[17:26:28.951] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:42:0)
[17:26:28.983] Build status: STARTED
[17:26:28.983] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:43:0) after 9m54s
[17:36:23.075] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:43:0)
[17:36:23.097] Build status: STARTED
[17:36:23.097] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:44:0) after 9m7s
[17:45:30.713] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:44:0)
[17:45:30.756] Build status: STARTED
[17:45:30.756] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:45:0) after 1m40s
[17:47:10.891] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:45:0)
[17:47:10.909] Build status: STARTED
[17:47:10.909] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875698896705852160:46:0) after 5m49s
[17:48:03.709] Received PubSub notification, asking Buildbucket for the build status
[17:48:03.728] Build:
{
"id": "8710268834767368273",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 38752,
"createdBy": "project:chromium",
"createTime": "2025-07-04T13:55:45.496111223Z",
"startTime": "2025-07-04T13:55:49.428742268Z",
"endTime": "2025-07-04T17:48:02.260538957Z",
"updateTime": "2025-07-04T17:48:02.260538957Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "736c7aa0220e2120a49afdc033321240b4e065dd",
"ref": "refs/heads/main"
}
}
}
[17:48:03.728] Invocation finished in 3h52m19.463621498s with status FAILED