[17:09:13.527] New invocation is queued and will start shortly
[17:09:14.604] Starting the invocation (attempt 1)
[17:09:14.641] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/d9dc3d4a6e9b34ecea662b3005c443f97fbd2b77"
[17:09:14.642] Popped gitiles commit info from properties and tags
[17:09:14.642] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[17:09:14.642] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[17:09:14.642] Buildbucket request:
{
"requestId": "8869344935876680768",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d9dc3d4a6e9b34ecea662b3005c443f97fbd2b77",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8869344935876680768"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[17:09:15.897] Scheduled build:
{
"id": "8703914873881934289",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 39431,
"createdBy": "project:chromium",
"createTime": "2025-09-12T17:09:14.800061444Z",
"updateTime": "2025-09-12T17:09:14.800061444Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d9dc3d4a6e9b34ecea662b3005c443f97fbd2b77",
"ref": "refs/heads/main"
}
}
}
[17:09:15.897] Task URL: https://cr-buildbucket.appspot.com/build/8703914873881934289
[17:09:15.897] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:2:0) after 8m38s
[17:09:18.254] Received PubSub notification, asking Buildbucket for the build status
[17:09:18.303] Build status: SCHEDULED
[17:10:35.411] Received PubSub notification, asking Buildbucket for the build status
[17:10:35.426] Build status: STARTED
[17:17:53.906] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:2:0)
[17:17:53.924] Build status: STARTED
[17:17:53.924] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:5:0) after 8m58s
[17:26:51.922] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:5:0)
[17:26:51.941] Build status: STARTED
[17:26:51.941] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:6:0) after 2m40s
[17:29:32.057] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:6:0)
[17:29:32.077] Build status: STARTED
[17:29:32.077] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:7:0) after 7m46s
[17:37:18.085] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:7:0)
[17:37:18.104] Build status: STARTED
[17:37:18.104] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:8:0) after 2m28s
[17:39:46.184] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:8:0)
[17:39:46.200] Build status: STARTED
[17:39:46.200] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:9:0) after 4m5s
[17:43:51.281] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:9:0)
[17:43:51.297] Build status: STARTED
[17:43:51.297] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:10:0) after 8m25s
[17:52:16.366] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:10:0)
[17:52:16.388] Build status: STARTED
[17:52:16.388] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:11:0) after 8m37s
[18:00:53.405] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:11:0)
[18:00:53.421] Build status: STARTED
[18:00:53.421] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:12:0) after 8m1s
[18:08:54.439] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:12:0)
[18:08:54.456] Build status: STARTED
[18:08:54.456] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:13:0) after 2m24s
[18:11:18.473] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:13:0)
[18:11:18.491] Build status: STARTED
[18:11:18.491] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:14:0) after 2m3s
[18:13:21.529] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:14:0)
[18:13:21.552] Build status: STARTED
[18:13:21.552] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:15:0) after 3m24s
[18:16:45.582] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:15:0)
[18:16:45.597] Build status: STARTED
[18:16:45.597] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:16:0) after 6m37s
[18:23:22.652] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:16:0)
[18:23:22.728] Build status: STARTED
[18:23:22.728] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:17:0) after 4m32s
[18:27:54.791] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:17:0)
[18:27:54.827] Build status: STARTED
[18:27:54.827] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:18:0) after 7m42s
[18:35:37.002] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:18:0)
[18:35:37.020] Build status: STARTED
[18:35:37.020] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:19:0) after 1m12s
[18:36:49.019] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:19:0)
[18:36:49.036] Build status: STARTED
[18:36:49.055] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:20:0) after 1m52s
[18:38:41.077] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:20:0)
[18:38:41.093] Build status: STARTED
[18:38:41.093] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:21:0) after 7m57s
[18:46:38.223] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:21:0)
[18:46:38.238] Build status: STARTED
[18:46:38.239] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:22:0) after 5m47s
[18:52:25.328] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:22:0)
[18:52:25.376] Build status: STARTED
[18:52:25.376] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:23:0) after 7m21s
[18:59:46.445] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:23:0)
[18:59:46.469] Build status: STARTED
[18:59:46.469] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:24:0) after 8m8s
[19:07:54.537] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:24:0)
[19:07:54.558] Build status: STARTED
[19:07:54.558] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:25:0) after 5m14s
[19:13:08.630] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:25:0)
[19:13:08.651] Build status: STARTED
[19:13:08.651] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:26:0) after 2m40s
[19:15:48.693] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:26:0)
[19:15:48.771] Build status: STARTED
[19:15:48.772] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:27:0) after 2m9s
[19:17:57.785] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:27:0)
[19:17:57.809] Build status: STARTED
[19:17:57.809] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:28:0) after 3m3s
[19:21:00.825] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:28:0)
[19:21:00.844] Build status: STARTED
[19:21:00.844] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:29:0) after 4m20s
[19:25:20.862] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:29:0)
[19:25:20.881] Build status: STARTED
[19:25:20.881] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:30:0) after 8m7s
[19:33:27.910] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:30:0)
[19:33:27.929] Build status: STARTED
[19:33:27.929] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:31:0) after 1m12s
[19:34:40.019] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:31:0)
[19:34:40.075] Build status: STARTED
[19:34:40.075] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:32:0) after 8m11s
[19:42:51.090] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:32:0)
[19:42:51.113] Build status: STARTED
[19:42:51.113] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:33:0) after 2m5s
[19:44:56.133] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:33:0)
[19:44:56.224] Build status: STARTED
[19:44:56.224] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:34:0) after 3m51s
[19:48:47.238] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:34:0)
[19:48:47.274] Build status: STARTED
[19:48:47.274] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:35:0) after 3m30s
[19:52:17.347] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:35:0)
[19:52:17.363] Build status: STARTED
[19:52:17.363] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:36:0) after 2m51s
[19:55:08.426] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:36:0)
[19:55:08.445] Build status: STARTED
[19:55:08.445] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:37:0) after 7m21s
[20:02:29.515] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:37:0)
[20:02:29.547] Build status: STARTED
[20:02:29.547] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:38:0) after 6m53s
[20:09:22.603] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:38:0)
[20:09:22.628] Build status: STARTED
[20:09:22.628] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:39:0) after 5m49s
[20:15:11.658] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:39:0)
[20:15:11.683] Build status: STARTED
[20:15:11.683] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:40:0) after 6m49s
[20:22:00.812] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:40:0)
[20:22:00.834] Build status: STARTED
[20:22:00.834] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:41:0) after 3m37s
[20:25:37.859] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:41:0)
[20:25:37.877] Build status: STARTED
[20:25:37.877] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:42:0) after 4m2s
[20:29:39.866] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:42:0)
[20:29:39.885] Build status: STARTED
[20:29:39.885] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:43:0) after 5m24s
[20:35:03.992] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:43:0)
[20:35:04.008] Build status: STARTED
[20:35:04.008] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:44:0) after 5m0s
[20:40:04.032] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:44:0)
[20:40:04.059] Build status: STARTED
[20:40:04.059] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869344935876680768:45:0) after 5m55s
[20:42:09.056] Received PubSub notification, asking Buildbucket for the build status
[20:42:09.075] Build:
{
"id": "8703914873881934289",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 39431,
"createdBy": "project:chromium",
"createTime": "2025-09-12T17:09:14.800061444Z",
"startTime": "2025-09-12T17:10:16.146337776Z",
"endTime": "2025-09-12T20:42:08.575234807Z",
"updateTime": "2025-09-12T20:42:08.575234807Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d9dc3d4a6e9b34ecea662b3005c443f97fbd2b77",
"ref": "refs/heads/main"
}
}
}
[20:42:09.075] Invocation finished in 3h32m55.560884887s with status FAILED