[05:18:52.202] New invocation is queued and will start shortly
[05:18:53.339] Starting the invocation (attempt 1)
[05:18:53.365] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/33496c14b92a42705fa3793e5209d25d62e6af97"
[05:18:53.365] Popped gitiles commit info from properties and tags
[05:18:53.365] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[05:18:53.367] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[05:18:53.367] Buildbucket request:
{
"requestId": "8878721115112635584",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "33496c14b92a42705fa3793e5209d25d62e6af97",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8878721115112635584"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[05:18:53.906] Scheduled build:
{
"id": "8713291053151708673",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 38407,
"createdBy": "project:chromium",
"createTime": "2025-06-01T05:18:53.444602244Z",
"updateTime": "2025-06-01T05:18:53.444602244Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "33496c14b92a42705fa3793e5209d25d62e6af97",
"ref": "refs/heads/main"
}
}
}
[05:18:53.906] Task URL: https://cr-buildbucket.appspot.com/build/8713291053151708673
[05:18:53.906] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:2:0) after 6m17s
[05:18:54.941] Received PubSub notification, asking Buildbucket for the build status
[05:18:54.957] Build status: SCHEDULED
[05:18:57.610] Received PubSub notification, asking Buildbucket for the build status
[05:18:57.634] Build status: STARTED
[05:25:10.924] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:2:0)
[05:25:10.945] Build status: STARTED
[05:25:10.945] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:5:0) after 8m27s
[05:33:38.007] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:5:0)
[05:33:38.027] Build status: STARTED
[05:33:38.027] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:6:0) after 5m29s
[05:39:07.077] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:6:0)
[05:39:07.211] Build status: STARTED
[05:39:07.211] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:7:0) after 7m17s
[05:46:24.265] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:7:0)
[05:46:24.284] Build status: STARTED
[05:46:24.284] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:8:0) after 1m13s
[05:47:37.411] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:8:0)
[05:47:37.432] Build status: STARTED
[05:47:37.432] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:9:0) after 3m2s
[05:50:39.570] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:9:0)
[05:50:39.602] Build status: STARTED
[05:50:39.602] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:10:0) after 5m44s
[05:56:23.618] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:10:0)
[05:56:23.655] Build status: STARTED
[05:56:23.655] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:11:0) after 2m18s
[05:58:41.706] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:11:0)
[05:58:41.719] Build status: STARTED
[05:58:41.719] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:12:0) after 4m0s
[06:02:41.754] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:12:0)
[06:02:41.772] Build status: STARTED
[06:02:41.772] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:13:0) after 8m16s
[06:10:57.970] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:13:0)
[06:10:57.990] Build status: STARTED
[06:10:57.990] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:14:0) after 3m7s
[06:14:05.091] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:14:0)
[06:14:05.141] Build status: STARTED
[06:14:05.141] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:15:0) after 3m39s
[06:17:44.253] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:15:0)
[06:17:44.268] Build status: STARTED
[06:17:44.268] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:16:0) after 1m59s
[06:19:43.284] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:16:0)
[06:19:43.299] Build status: STARTED
[06:19:43.299] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:17:0) after 1m1s
[06:20:44.322] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:17:0)
[06:20:44.339] Build status: STARTED
[06:20:44.339] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:18:0) after 4m24s
[06:25:08.365] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:18:0)
[06:25:08.437] Build status: STARTED
[06:25:08.437] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:19:0) after 5m22s
[06:30:30.416] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:19:0)
[06:30:30.446] Build status: STARTED
[06:30:30.446] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:20:0) after 8m25s
[06:38:55.712] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:20:0)
[06:38:55.730] Build status: STARTED
[06:38:55.730] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:21:0) after 6m53s
[06:45:49.114] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:21:0)
[06:45:49.132] Build status: STARTED
[06:45:49.132] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:22:0) after 7m42s
[06:53:31.354] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:22:0)
[06:53:31.399] Build status: STARTED
[06:53:31.399] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:23:0) after 8m34s
[07:02:05.547] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:23:0)
[07:02:05.567] Build status: STARTED
[07:02:05.567] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:24:0) after 8m16s
[07:10:21.590] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:24:0)
[07:10:21.610] Build status: STARTED
[07:10:21.610] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:25:0) after 8m45s
[07:19:06.823] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:25:0)
[07:19:06.901] Build status: STARTED
[07:19:06.901] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:26:0) after 3m57s
[07:23:03.921] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:26:0)
[07:23:03.960] Build status: STARTED
[07:23:03.960] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:27:0) after 9m1s
[07:32:04.979] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:27:0)
[07:32:04.998] Build status: STARTED
[07:32:04.998] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:28:0) after 1m14s
[07:33:19.022] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:28:0)
[07:33:19.128] Build status: STARTED
[07:33:19.128] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:29:0) after 4m4s
[07:37:23.235] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:29:0)
[07:37:23.259] Build status: STARTED
[07:37:23.259] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:30:0) after 5m48s
[07:43:11.482] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:30:0)
[07:43:11.503] Build status: STARTED
[07:43:11.503] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:31:0) after 8m21s
[07:51:32.522] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:31:0)
[07:51:32.637] Build status: STARTED
[07:51:32.637] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:32:0) after 1m39s
[07:53:11.658] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:32:0)
[07:53:11.672] Build status: STARTED
[07:53:11.672] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:33:0) after 3m53s
[07:57:04.702] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:33:0)
[07:57:04.864] Build status: STARTED
[07:57:04.864] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:34:0) after 9m53s
[08:06:57.983] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:34:0)
[08:06:58.001] Build status: STARTED
[08:06:58.001] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:35:0) after 4m2s
[08:11:00.018] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:35:0)
[08:11:00.037] Build status: STARTED
[08:11:00.037] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:36:0) after 9m40s
[08:20:40.049] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:36:0)
[08:20:40.063] Build status: STARTED
[08:20:40.063] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:37:0) after 3m24s
[08:24:04.084] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:37:0)
[08:24:04.099] Build status: STARTED
[08:24:04.099] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:38:0) after 1m50s
[08:25:54.196] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:38:0)
[08:25:54.216] Build status: STARTED
[08:25:54.216] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:39:0) after 1m57s
[08:27:51.232] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:39:0)
[08:27:51.301] Build status: STARTED
[08:27:51.301] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:40:0) after 5m1s
[08:32:52.590] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:40:0)
[08:32:52.610] Build status: STARTED
[08:32:52.610] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:41:0) after 9m52s
[08:42:44.944] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:41:0)
[08:42:44.964] Build status: STARTED
[08:42:44.964] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:42:0) after 3m26s
[08:46:11.140] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:42:0)
[08:46:11.174] Build status: STARTED
[08:46:11.174] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:43:0) after 9m3s
[08:55:14.382] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:43:0)
[08:55:14.397] Build status: STARTED
[08:55:14.397] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:44:0) after 1m53s
[08:57:07.495] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:44:0)
[08:57:07.513] Build status: STARTED
[08:57:07.513] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:45:0) after 5m23s
[09:02:30.538] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:45:0)
[09:02:30.632] Build status: STARTED
[09:02:30.632] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878721115112635584:46:0) after 5m54s
[09:06:55.121] Received PubSub notification, asking Buildbucket for the build status
[09:06:55.140] Build:
{
"id": "8713291053151708673",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 38407,
"createdBy": "project:chromium",
"createTime": "2025-06-01T05:18:53.444602244Z",
"startTime": "2025-06-01T05:18:57.136989120Z",
"endTime": "2025-06-01T09:06:54.858613990Z",
"updateTime": "2025-06-01T09:06:54.858613990Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "33496c14b92a42705fa3793e5209d25d62e6af97",
"ref": "refs/heads/main"
}
}
}
[09:06:55.140] Invocation finished in 3h48m2.948256754s with status FAILED