[06:05:26.794] New invocation is queued and will start shortly
[06:05:27.931] Starting the invocation (attempt 1)
[06:05:27.958] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/1ef2b77bb4414969924929ac44548cef351a11a7"
[06:05:27.958] Popped gitiles commit info from properties and tags
[06:05:27.958] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[06:05:27.960] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[06:05:27.960] Buildbucket request:
{
"requestId": "8877449827234243776",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1ef2b77bb4414969924929ac44548cef351a11a7",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8877449827234243776"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[06:05:28.428] Scheduled build:
{
"id": "8712019765297760929",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 38507,
"createdBy": "project:chromium",
"createTime": "2025-06-15T06:05:28.019112109Z",
"updateTime": "2025-06-15T06:05:28.019112109Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1ef2b77bb4414969924929ac44548cef351a11a7",
"ref": "refs/heads/main"
}
}
}
[06:05:28.428] Task URL: https://cr-buildbucket.appspot.com/build/8712019765297760929
[06:05:28.428] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:2:0) after 3m8s
[06:05:36.522] Received PubSub notification, asking Buildbucket for the build status
[06:05:36.548] Build status: SCHEDULED
[06:05:52.751] Received PubSub notification, asking Buildbucket for the build status
[06:05:52.828] Build status: STARTED
[06:08:36.446] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:2:0)
[06:08:36.476] Build status: STARTED
[06:08:36.476] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:5:0) after 3m17s
[06:11:53.495] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:5:0)
[06:11:53.520] Build status: STARTED
[06:11:53.520] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:6:0) after 1m20s
[06:13:13.544] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:6:0)
[06:13:13.571] Build status: STARTED
[06:13:13.571] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:7:0) after 5m46s
[06:18:59.600] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:7:0)
[06:18:59.618] Build status: STARTED
[06:18:59.618] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:8:0) after 6m56s
[06:25:55.645] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:8:0)
[06:25:55.716] Build status: STARTED
[06:25:55.716] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:9:0) after 6m39s
[06:32:34.736] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:9:0)
[06:32:34.755] Build status: STARTED
[06:32:34.755] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:10:0) after 9m59s
[06:42:33.930] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:10:0)
[06:42:33.955] Build status: STARTED
[06:42:33.955] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:11:0) after 2m16s
[06:44:50.071] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:11:0)
[06:44:50.097] Build status: STARTED
[06:44:50.097] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:12:0) after 6m58s
[06:51:48.230] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:12:0)
[06:51:48.288] Build status: STARTED
[06:51:48.288] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:13:0) after 6m55s
[06:58:43.411] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:13:0)
[06:58:43.429] Build status: STARTED
[06:58:43.429] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:14:0) after 1m46s
[07:00:29.562] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:14:0)
[07:00:29.584] Build status: STARTED
[07:00:29.584] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:15:0) after 7m57s
[07:08:26.628] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:15:0)
[07:08:26.654] Build status: STARTED
[07:08:26.654] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:16:0) after 3m53s
[07:12:19.776] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:16:0)
[07:12:19.817] Build status: STARTED
[07:12:19.817] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:17:0) after 7m4s
[07:19:23.991] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:17:0)
[07:19:24.011] Build status: STARTED
[07:19:24.011] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:18:0) after 3m51s
[07:23:15.448] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:18:0)
[07:23:15.473] Build status: STARTED
[07:23:15.473] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:19:0) after 3m59s
[07:27:14.516] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:19:0)
[07:27:14.536] Build status: STARTED
[07:27:14.536] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:20:0) after 2m53s
[07:30:07.672] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:20:0)
[07:30:07.710] Build status: STARTED
[07:30:07.710] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:21:0) after 7m14s
[07:37:21.730] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:21:0)
[07:37:21.754] Build status: STARTED
[07:37:21.754] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:22:0) after 8m9s
[07:45:30.775] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:22:0)
[07:45:30.800] Build status: STARTED
[07:45:30.800] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:23:0) after 9m13s
[07:54:43.819] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:23:0)
[07:54:43.844] Build status: STARTED
[07:54:43.844] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:24:0) after 5m14s
[07:59:57.867] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:24:0)
[07:59:57.970] Build status: STARTED
[07:59:57.970] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:25:0) after 4m7s
[08:04:04.990] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:25:0)
[08:04:05.019] Build status: STARTED
[08:04:05.019] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:26:0) after 2m46s
[08:06:51.061] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:26:0)
[08:06:51.080] Build status: STARTED
[08:06:51.080] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:27:0) after 6m40s
[08:13:31.148] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:27:0)
[08:13:31.173] Build status: STARTED
[08:13:31.174] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:28:0) after 7m32s
[08:21:03.195] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:28:0)
[08:21:03.337] Build status: STARTED
[08:21:03.338] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:29:0) after 6m50s
[08:27:53.350] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:29:0)
[08:27:53.372] Build status: STARTED
[08:27:53.372] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:30:0) after 1m30s
[08:29:23.492] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:30:0)
[08:29:23.504] Build status: STARTED
[08:29:23.504] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:31:0) after 8m51s
[08:38:14.716] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:31:0)
[08:38:14.935] Build status: STARTED
[08:38:14.935] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:32:0) after 1m28s
[08:39:42.960] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:32:0)
[08:39:42.982] Build status: STARTED
[08:39:42.982] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:33:0) after 9m33s
[08:49:16.215] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:33:0)
[08:49:16.233] Build status: STARTED
[08:49:16.233] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:34:0) after 2m37s
[08:51:53.281] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:34:0)
[08:51:53.300] Build status: STARTED
[08:51:53.300] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:35:0) after 5m1s
[08:56:54.323] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:35:0)
[08:56:54.339] Build status: STARTED
[08:56:54.339] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:36:0) after 4m50s
[09:01:44.517] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:36:0)
[09:01:44.537] Build status: STARTED
[09:01:44.537] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:37:0) after 9m29s
[09:11:13.565] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:37:0)
[09:11:13.637] Build status: STARTED
[09:11:13.637] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:38:0) after 2m26s
[09:13:39.698] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:38:0)
[09:13:39.723] Build status: STARTED
[09:13:39.723] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:39:0) after 3m10s
[09:16:49.809] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:39:0)
[09:16:49.923] Build status: STARTED
[09:16:49.923] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:40:0) after 2m59s
[09:19:49.029] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:40:0)
[09:19:49.043] Build status: STARTED
[09:19:49.043] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:41:0) after 6m22s
[09:26:11.138] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:41:0)
[09:26:11.166] Build status: STARTED
[09:26:11.166] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:42:0) after 8m59s
[09:35:10.227] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:42:0)
[09:35:10.245] Build status: STARTED
[09:35:10.245] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:43:0) after 5m5s
[09:40:15.364] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:43:0)
[09:40:15.653] Build status: STARTED
[09:40:15.653] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:44:0) after 8m4s
[09:48:19.720] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:44:0)
[09:48:19.737] Build status: STARTED
[09:48:19.737] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877449827234243776:45:0) after 6m47s
[09:48:44.078] Received PubSub notification, asking Buildbucket for the build status
[09:48:44.092] Build:
{
"id": "8712019765297760929",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 38507,
"createdBy": "project:chromium",
"createTime": "2025-06-15T06:05:28.019112109Z",
"startTime": "2025-06-15T06:05:45.220478833Z",
"endTime": "2025-06-15T09:48:43.770200139Z",
"updateTime": "2025-06-15T09:48:43.770200139Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1ef2b77bb4414969924929ac44548cef351a11a7",
"ref": "refs/heads/main"
}
}
}
[09:48:44.092] Invocation finished in 3h43m17.302922697s with status FAILED