[19:10:12.651] New invocation is queued and will start shortly
[19:10:13.707] Starting the invocation (attempt 1)
[19:10:13.734] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/bfc6fa4c95ea226a841f48030763341ad660ede5"
[19:10:13.734] Popped gitiles commit info from properties and tags
[19:10:13.734] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[19:10:13.734] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[19:10:13.735] Buildbucket request:
{
"requestId": "8875497917842657392",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "bfc6fa4c95ea226a841f48030763341ad660ede5",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8875497917842657392"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[19:10:14.250] Scheduled build:
{
"id": "8710067855999824977",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 38766,
"createdBy": "project:chromium",
"createTime": "2025-07-06T19:10:13.785222391Z",
"updateTime": "2025-07-06T19:10:13.785222391Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "bfc6fa4c95ea226a841f48030763341ad660ede5",
"ref": "refs/heads/main"
}
}
}
[19:10:14.250] Task URL: https://cr-buildbucket.appspot.com/build/8710067855999824977
[19:10:14.250] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:2:0) after 5m54s
[19:10:15.202] Received PubSub notification, asking Buildbucket for the build status
[19:10:15.220] Build status: SCHEDULED
[19:10:20.923] Received PubSub notification, asking Buildbucket for the build status
[19:10:21.037] Build status: STARTED
[19:16:08.528] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:2:0)
[19:16:08.591] Build status: STARTED
[19:16:08.591] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:5:0) after 9m10s
[19:25:18.636] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:5:0)
[19:25:18.661] Build status: STARTED
[19:25:18.661] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:6:0) after 4m44s
[19:30:02.685] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:6:0)
[19:30:02.715] Build status: STARTED
[19:30:02.715] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:7:0) after 2m16s
[19:32:18.741] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:7:0)
[19:32:18.785] Build status: STARTED
[19:32:18.785] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:8:0) after 3m30s
[19:35:48.852] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:8:0)
[19:35:48.884] Build status: STARTED
[19:35:48.884] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:9:0) after 2m1s
[19:37:49.893] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:9:0)
[19:37:49.918] Build status: STARTED
[19:37:49.918] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:10:0) after 2m16s
[19:40:05.997] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:10:0)
[19:40:06.087] Build status: STARTED
[19:40:06.087] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:11:0) after 9m4s
[19:49:10.106] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:11:0)
[19:49:10.133] Build status: STARTED
[19:49:10.133] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:12:0) after 2m35s
[19:51:45.244] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:12:0)
[19:51:45.377] Build status: STARTED
[19:51:45.377] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:13:0) after 5m10s
[19:56:55.446] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:13:0)
[19:56:55.468] Build status: STARTED
[19:56:55.469] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:14:0) after 6m24s
[20:03:19.703] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:14:0)
[20:03:19.733] Build status: STARTED
[20:03:19.733] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:15:0) after 6m35s
[20:09:54.840] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:15:0)
[20:09:54.877] Build status: STARTED
[20:09:54.877] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:16:0) after 1m15s
[20:11:10.069] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:16:0)
[20:11:10.093] Build status: STARTED
[20:11:10.093] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:17:0) after 3m15s
[20:14:25.123] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:17:0)
[20:14:25.141] Build status: STARTED
[20:14:25.141] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:18:0) after 2m24s
[20:16:49.157] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:18:0)
[20:16:49.181] Build status: STARTED
[20:16:49.181] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:19:0) after 6m27s
[20:23:16.451] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:19:0)
[20:23:16.480] Build status: STARTED
[20:23:16.480] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:20:0) after 9m45s
[20:33:01.499] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:20:0)
[20:33:01.558] Build status: STARTED
[20:33:01.558] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:21:0) after 7m36s
[20:40:37.680] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:21:0)
[20:40:37.696] Build status: STARTED
[20:40:37.696] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:22:0) after 3m12s
[20:43:49.710] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:22:0)
[20:43:49.739] Build status: STARTED
[20:43:49.739] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:23:0) after 2m10s
[20:45:59.761] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:23:0)
[20:45:59.793] Build status: STARTED
[20:45:59.793] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:24:0) after 6m32s
[20:52:31.872] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:24:0)
[20:52:31.897] Build status: STARTED
[20:52:31.897] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:25:0) after 6m41s
[20:59:13.082] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:25:0)
[20:59:13.104] Build status: STARTED
[20:59:13.104] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:26:0) after 2m32s
[21:01:45.130] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:26:0)
[21:01:45.153] Build status: STARTED
[21:01:45.153] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:27:0) after 7m27s
[21:09:12.190] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:27:0)
[21:09:12.263] Build status: STARTED
[21:09:12.263] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:28:0) after 7m19s
[21:16:31.304] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:28:0)
[21:16:31.326] Build status: STARTED
[21:16:31.326] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:29:0) after 7m52s
[21:24:23.352] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:29:0)
[21:24:23.374] Build status: STARTED
[21:24:23.374] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:30:0) after 2m54s
[21:27:17.532] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:30:0)
[21:27:17.551] Build status: STARTED
[21:27:17.551] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:31:0) after 5m4s
[21:32:21.571] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:31:0)
[21:32:21.592] Build status: STARTED
[21:32:21.592] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:32:0) after 4m6s
[21:36:27.664] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:32:0)
[21:36:27.743] Build status: STARTED
[21:36:27.743] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:33:0) after 8m24s
[21:44:51.761] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:33:0)
[21:44:51.829] Build status: STARTED
[21:44:51.829] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:34:0) after 8m35s
[21:53:27.320] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:34:0)
[21:53:27.342] Build status: STARTED
[21:53:27.342] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:35:0) after 7m9s
[22:00:36.379] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:35:0)
[22:00:36.398] Build status: STARTED
[22:00:36.398] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:36:0) after 4m30s
[22:05:06.420] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:36:0)
[22:05:06.443] Build status: STARTED
[22:05:06.443] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:37:0) after 2m4s
[22:07:10.480] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:37:0)
[22:07:10.510] Build status: STARTED
[22:07:10.510] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:38:0) after 8m18s
[22:15:28.536] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:38:0)
[22:15:28.582] Build status: STARTED
[22:15:28.582] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:39:0) after 9m54s
[22:25:22.603] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:39:0)
[22:25:22.653] Build status: STARTED
[22:25:22.653] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:40:0) after 1m20s
[22:26:42.709] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:40:0)
[22:26:42.779] Build status: STARTED
[22:26:42.779] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:41:0) after 2m50s
[22:29:32.853] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:41:0)
[22:29:32.909] Build status: STARTED
[22:29:32.909] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:42:0) after 9m46s
[22:39:19.026] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:42:0)
[22:39:19.072] Build status: STARTED
[22:39:19.072] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:43:0) after 3m6s
[22:42:25.402] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:43:0)
[22:42:25.421] Build status: STARTED
[22:42:25.421] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:44:0) after 3m19s
[22:45:44.606] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:44:0)
[22:45:44.649] Build status: STARTED
[22:45:44.649] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:45:0) after 3m5s
[22:48:49.795] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:45:0)
[22:48:49.811] Build status: STARTED
[22:48:49.811] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:46:0) after 3m58s
[22:52:47.937] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:46:0)
[22:52:47.955] Build status: STARTED
[22:52:47.955] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875497917842657392:47:0) after 5m57s
[22:56:07.263] Received PubSub notification, asking Buildbucket for the build status
[22:56:07.279] Build:
{
"id": "8710067855999824977",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 38766,
"createdBy": "project:chromium",
"createTime": "2025-07-06T19:10:13.785222391Z",
"startTime": "2025-07-06T19:10:20.686613837Z",
"endTime": "2025-07-06T22:56:06.758084253Z",
"updateTime": "2025-07-06T22:56:06.758084253Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "bfc6fa4c95ea226a841f48030763341ad660ede5",
"ref": "refs/heads/main"
}
}
}
[22:56:07.279] Invocation finished in 3h45m54.634478529s with status FAILED