[18:04:24.309] New invocation is queued and will start shortly
[18:04:25.922] Starting the invocation (attempt 1)
[18:04:25.951] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/2917eac972cbcade78acdd4913628b93bef3937f"
[18:04:25.951] Popped gitiles commit info from properties and tags
[18:04:25.952] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[18:04:25.952] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[18:04:25.952] Buildbucket request:
{
"requestId": "8842887150073368480",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2917eac972cbcade78acdd4913628b93bef3937f",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8842887150073368480"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[18:04:27.372] Scheduled build:
{
"id": "8677457087197858513",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 42353,
"createdBy": "project:chromium",
"createTime": "2026-07-01T18:04:26.430633095Z",
"updateTime": "2026-07-01T18:04:26.430633095Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2917eac972cbcade78acdd4913628b93bef3937f",
"ref": "refs/heads/main"
}
}
}
[18:04:27.372] Task URL: https://cr-buildbucket.appspot.com/build/8677457087197858513
[18:04:27.372] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:2:0) after 8m59s
[18:04:28.309] Received PubSub notification, asking Buildbucket for the build status
[18:04:28.329] Build status: SCHEDULED
[18:04:31.298] Received PubSub notification, asking Buildbucket for the build status
[18:04:31.333] Build status: STARTED
[18:13:26.422] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:2:0)
[18:13:26.439] Build status: STARTED
[18:13:26.439] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:5:0) after 9m7s
[18:22:33.502] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:5:0)
[18:22:33.589] Build status: STARTED
[18:22:33.589] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:6:0) after 4m22s
[18:26:55.572] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:6:0)
[18:26:55.598] Build status: STARTED
[18:26:55.598] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:7:0) after 9m31s
[18:36:26.663] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:7:0)
[18:36:26.744] Build status: STARTED
[18:36:26.744] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:8:0) after 2m20s
[18:38:46.824] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:8:0)
[18:38:46.842] Build status: STARTED
[18:38:46.842] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:9:0) after 6m55s
[18:45:41.862] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:9:0)
[18:45:41.902] Build status: STARTED
[18:45:41.902] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:10:0) after 5m48s
[18:51:29.922] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:10:0)
[18:51:29.944] Build status: STARTED
[18:51:29.944] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:11:0) after 5m32s
[18:57:02.037] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:11:0)
[18:57:02.058] Build status: STARTED
[18:57:02.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:12:0) after 5m20s
[19:02:22.112] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:12:0)
[19:02:22.151] Build status: STARTED
[19:02:22.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:13:0) after 6m12s
[19:08:34.404] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:13:0)
[19:08:34.419] Build status: STARTED
[19:08:34.419] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:14:0) after 4m56s
[19:13:30.681] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:14:0)
[19:13:30.699] Build status: STARTED
[19:13:30.699] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:15:0) after 8m42s
[19:22:12.950] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:15:0)
[19:22:13.020] Build status: STARTED
[19:22:13.020] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:16:0) after 3m18s
[19:25:31.040] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:16:0)
[19:25:31.061] Build status: STARTED
[19:25:31.062] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:17:0) after 3m23s
[19:28:54.119] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:17:0)
[19:28:54.209] Build status: STARTED
[19:28:54.209] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:18:0) after 7m45s
[19:36:39.280] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:18:0)
[19:36:39.296] Build status: STARTED
[19:36:39.296] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:19:0) after 1m2s
[19:37:41.325] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:19:0)
[19:37:41.402] Build status: STARTED
[19:37:41.402] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:20:0) after 6m4s
[19:43:45.505] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:20:0)
[19:43:45.526] Build status: STARTED
[19:43:45.527] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:21:0) after 6m25s
[19:50:10.547] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:21:0)
[19:50:10.562] Build status: STARTED
[19:50:10.562] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:22:0) after 7m41s
[19:57:51.565] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:22:0)
[19:57:51.584] Build status: STARTED
[19:57:51.584] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:23:0) after 4m36s
[20:02:27.601] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:23:0)
[20:02:27.633] Build status: STARTED
[20:02:27.633] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:24:0) after 5m19s
[20:07:46.724] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:24:0)
[20:07:46.814] Build status: STARTED
[20:07:46.814] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:25:0) after 8m3s
[20:15:49.878] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:25:0)
[20:15:49.896] Build status: STARTED
[20:15:49.896] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:26:0) after 1m31s
[20:17:20.898] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:26:0)
[20:17:20.929] Build status: STARTED
[20:17:20.929] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:27:0) after 9m51s
[20:27:11.926] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:27:0)
[20:27:11.945] Build status: STARTED
[20:27:11.945] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:28:0) after 9m35s
[20:36:47.044] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:28:0)
[20:36:47.064] Build status: STARTED
[20:36:47.064] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:29:0) after 9m39s
[20:46:26.064] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:29:0)
[20:46:26.144] Build status: STARTED
[20:46:26.144] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:30:0) after 6m49s
[20:53:37.321] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:30:0)
[20:53:37.339] Build status: STARTED
[20:53:37.339] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:31:0) after 3m24s
[20:57:01.364] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:31:0)
[20:57:01.387] Build status: STARTED
[20:57:01.387] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:32:0) after 2m27s
[20:59:28.387] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:32:0)
[20:59:28.472] Build status: STARTED
[20:59:28.472] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:33:0) after 7m20s
[21:06:48.520] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:33:0)
[21:06:48.654] Build status: STARTED
[21:06:48.654] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:34:0) after 8m14s
[21:15:02.676] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:34:0)
[21:15:02.693] Build status: STARTED
[21:15:02.693] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:35:0) after 9m39s
[21:24:41.733] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:35:0)
[21:24:41.750] Build status: STARTED
[21:24:41.750] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:36:0) after 5m6s
[21:29:47.886] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:36:0)
[21:29:48.000] Build status: STARTED
[21:29:48.000] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:37:0) after 3m29s
[21:33:17.297] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:37:0)
[21:33:17.323] Build status: STARTED
[21:33:17.323] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:38:0) after 5m23s
[21:38:40.350] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:38:0)
[21:38:40.375] Build status: STARTED
[21:38:40.375] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:39:0) after 5m17s
[21:43:57.458] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:39:0)
[21:43:57.487] Build status: STARTED
[21:43:57.488] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:40:0) after 8m6s
[21:52:03.616] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:40:0)
[21:52:03.632] Build status: STARTED
[21:52:03.632] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:41:0) after 6m7s
[21:58:10.654] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:41:0)
[21:58:10.688] Build status: STARTED
[21:58:10.688] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:42:0) after 1m2s
[21:59:12.754] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:42:0)
[21:59:12.772] Build status: STARTED
[21:59:12.772] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:43:0) after 9m6s
[22:08:18.790] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:43:0)
[22:08:19.036] Build status: STARTED
[22:08:19.036] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:44:0) after 1m53s
[22:10:12.059] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:44:0)
[22:10:12.087] Build status: STARTED
[22:10:12.087] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:45:0) after 1m55s
[22:12:07.169] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:45:0)
[22:12:07.192] Build status: STARTED
[22:12:07.192] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:46:0) after 1m46s
[22:13:53.216] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:46:0)
[22:13:53.234] Build status: STARTED
[22:13:53.234] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:47:0) after 9m16s
[22:23:09.321] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:47:0)
[22:23:09.342] Build status: STARTED
[22:23:09.342] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:48:0) after 1m36s
[22:24:45.367] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:48:0)
[22:24:45.395] Build status: STARTED
[22:24:45.395] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:49:0) after 3m10s
[22:27:55.489] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:49:0)
[22:27:55.507] Build status: STARTED
[22:27:55.508] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842887150073368480:50:0) after 3m59s
[22:30:44.316] Received PubSub notification, asking Buildbucket for the build status
[22:30:44.370] Build:
{
"id": "8677457087197858513",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 42353,
"createdBy": "project:chromium",
"createTime": "2026-07-01T18:04:26.430633095Z",
"startTime": "2026-07-01T18:04:31.105381788Z",
"endTime": "2026-07-01T22:30:43.762184093Z",
"updateTime": "2026-07-01T22:30:43.762184093Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2917eac972cbcade78acdd4913628b93bef3937f",
"ref": "refs/heads/main"
}
}
}
[22:30:44.370] Invocation finished in 4h26m20.066025744s with status FAILED