[12:00:57.742] New invocation is queued and will start shortly
[12:00:58.881] Starting the invocation (attempt 1)
[12:00:58.911] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/bc0d423a163c84de9a02d4c0757fb25038bf8bc4"
[12:00:58.911] Popped gitiles commit info from properties and tags
[12:00:58.911] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[12:00:58.911] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[12:00:58.912] Buildbucket request:
{
"requestId": "8935590712551640640",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "bc0d423a163c84de9a02d4c0757fb25038bf8bc4",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8935590712551640640"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[12:00:59.510] Scheduled build:
{
"id": "8770160650564468033",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 30308,
"createdBy": "project:chromium",
"createTime": "2023-09-12T12:00:59.007566924Z",
"updateTime": "2023-09-12T12:00:59.007566924Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "bc0d423a163c84de9a02d4c0757fb25038bf8bc4",
"ref": "refs/heads/main"
}
}
}
[12:00:59.510] Task URL: https://cr-buildbucket.appspot.com/build/8770160650564468033
[12:00:59.510] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:2:0) after 1m34s
[12:01:00.492] Received PubSub notification, asking Buildbucket for the build status
[12:01:00.603] Build status: SCHEDULED
[12:02:33.569] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:2:0)
[12:02:33.599] Build status: SCHEDULED
[12:02:33.599] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:4:0) after 6m49s
[12:04:37.283] Received PubSub notification, asking Buildbucket for the build status
[12:04:37.306] Build status: STARTED
[12:09:22.687] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:4:0)
[12:09:22.708] Build status: STARTED
[12:09:22.708] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:6:0) after 5m22s
[12:14:44.862] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:6:0)
[12:14:44.879] Build status: STARTED
[12:14:44.879] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:7:0) after 9m3s
[12:23:47.995] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:7:0)
[12:23:48.045] Build status: STARTED
[12:23:48.045] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:8:0) after 1m5s
[12:24:53.141] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:8:0)
[12:24:53.179] Build status: STARTED
[12:24:53.179] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:9:0) after 8m45s
[12:33:38.293] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:9:0)
[12:33:38.309] Build status: STARTED
[12:33:38.309] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:10:0) after 8m53s
[12:42:31.429] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:10:0)
[12:42:31.451] Build status: STARTED
[12:42:31.451] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:11:0) after 1m2s
[12:43:33.702] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:11:0)
[12:43:33.724] Build status: STARTED
[12:43:33.724] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:12:0) after 2m30s
[12:46:03.879] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:12:0)
[12:46:03.906] Build status: STARTED
[12:46:03.906] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:13:0) after 9m51s
[12:55:55.408] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:13:0)
[12:55:55.424] Build status: STARTED
[12:55:55.424] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:14:0) after 5m33s
[13:01:28.682] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:14:0)
[13:01:28.724] Build status: STARTED
[13:01:28.724] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:15:0) after 2m52s
[13:04:20.939] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:15:0)
[13:04:20.958] Build status: STARTED
[13:04:20.958] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:16:0) after 6m49s
[13:11:10.135] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:16:0)
[13:11:10.155] Build status: STARTED
[13:11:10.155] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:17:0) after 2m20s
[13:13:30.551] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:17:0)
[13:13:30.568] Build status: STARTED
[13:13:30.568] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:18:0) after 1m44s
[13:15:14.701] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:18:0)
[13:15:14.723] Build status: STARTED
[13:15:14.723] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:19:0) after 4m0s
[13:19:14.846] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:19:0)
[13:19:14.872] Build status: STARTED
[13:19:14.872] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:20:0) after 4m14s
[13:23:28.962] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:20:0)
[13:23:28.990] Build status: STARTED
[13:23:28.990] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:21:0) after 9m43s
[13:33:12.309] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:21:0)
[13:33:12.335] Build status: STARTED
[13:33:12.335] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:22:0) after 4m47s
[13:37:59.385] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:22:0)
[13:37:59.422] Build status: STARTED
[13:37:59.422] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:23:0) after 1m25s
[13:39:24.447] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:23:0)
[13:39:24.468] Build status: STARTED
[13:39:24.468] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:24:0) after 6m5s
[13:45:29.878] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:24:0)
[13:45:29.901] Build status: STARTED
[13:45:29.901] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:25:0) after 2m5s
[13:47:34.898] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:25:0)
[13:47:34.914] Build status: STARTED
[13:47:34.914] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:26:0) after 8m41s
[13:56:16.152] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:26:0)
[13:56:16.178] Build status: STARTED
[13:56:16.178] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:27:0) after 7m52s
[14:04:08.195] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:27:0)
[14:04:08.212] Build status: STARTED
[14:04:08.212] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:28:0) after 3m21s
[14:07:29.234] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:28:0)
[14:07:29.260] Build status: STARTED
[14:07:29.260] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:29:0) after 4m25s
[14:11:54.281] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:29:0)
[14:11:54.300] Build status: STARTED
[14:11:54.300] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:30:0) after 9m38s
[14:21:32.395] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:30:0)
[14:21:32.448] Build status: STARTED
[14:21:32.448] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:31:0) after 5m43s
[14:27:15.485] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:31:0)
[14:27:15.504] Build status: STARTED
[14:27:15.504] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:32:0) after 3m20s
[14:30:35.681] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:32:0)
[14:30:35.717] Build status: STARTED
[14:30:35.717] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:33:0) after 9m9s
[14:39:44.855] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:33:0)
[14:39:44.874] Build status: STARTED
[14:39:44.874] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:34:0) after 6m5s
[14:45:50.066] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:34:0)
[14:45:50.082] Build status: STARTED
[14:45:50.082] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:35:0) after 8m40s
[14:54:30.331] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:35:0)
[14:54:30.350] Build status: STARTED
[14:54:30.350] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:36:0) after 8m22s
[15:02:52.379] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:36:0)
[15:02:52.427] Build status: STARTED
[15:02:52.427] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:37:0) after 7m43s
[15:10:35.492] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:37:0)
[15:10:35.513] Build status: STARTED
[15:10:35.513] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:38:0) after 5m48s
[15:16:23.740] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:38:0)
[15:16:23.759] Build status: STARTED
[15:16:23.759] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:39:0) after 1m8s
[15:17:31.745] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:39:0)
[15:17:31.816] Build status: STARTED
[15:17:31.816] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:40:0) after 2m59s
[15:20:30.944] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:40:0)
[15:20:30.961] Build status: STARTED
[15:20:30.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:41:0) after 6m11s
[15:26:42.093] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:41:0)
[15:26:42.148] Build status: STARTED
[15:26:42.148] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:42:0) after 2m21s
[15:29:03.371] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:42:0)
[15:29:03.390] Build status: STARTED
[15:29:03.390] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:43:0) after 7m16s
[15:36:19.511] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:43:0)
[15:36:19.556] Build status: STARTED
[15:36:19.556] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:44:0) after 6m24s
[15:42:44.016] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:44:0)
[15:42:44.034] Build status: STARTED
[15:42:44.034] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:45:0) after 9m1s
[15:51:45.053] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:45:0)
[15:51:45.071] Build status: STARTED
[15:51:45.071] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:46:0) after 2m52s
[15:54:37.111] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:46:0)
[15:54:37.128] Build status: STARTED
[15:54:37.128] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:47:0) after 3m19s
[15:57:56.148] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:47:0)
[15:57:56.169] Build status: STARTED
[15:57:56.169] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:48:0) after 2m38s
[16:00:34.152] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:48:0)
[16:00:34.179] Build status: STARTED
[16:00:34.179] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:49:0) after 7m17s
[16:07:51.179] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:49:0)
[16:07:51.195] Build status: STARTED
[16:07:51.195] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:50:0) after 7m14s
[16:15:05.703] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:50:0)
[16:15:05.758] Build status: STARTED
[16:15:05.758] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:51:0) after 9m22s
[16:24:27.779] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:51:0)
[16:24:27.913] Build status: STARTED
[16:24:27.913] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:52:0) after 5m9s
[16:29:37.004] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:52:0)
[16:29:37.020] Build status: STARTED
[16:29:37.020] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:53:0) after 3m53s
[16:33:30.060] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:53:0)
[16:33:30.077] Build status: STARTED
[16:33:30.077] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:54:0) after 6m48s
[16:40:18.113] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:54:0)
[16:40:18.134] Build status: STARTED
[16:40:18.134] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:55:0) after 9m7s
[16:49:25.122] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:55:0)
[16:49:25.154] Build status: STARTED
[16:49:25.154] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:56:0) after 2m59s
[16:52:24.172] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:56:0)
[16:52:24.220] Build status: STARTED
[16:52:24.220] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:57:0) after 4m31s
[16:56:55.261] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:57:0)
[16:56:55.279] Build status: STARTED
[16:56:55.279] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:58:0) after 5m49s
[17:02:44.296] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:58:0)
[17:02:44.313] Build status: STARTED
[17:02:44.313] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:59:0) after 3m24s
[17:06:08.345] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:59:0)
[17:06:08.404] Build status: STARTED
[17:06:08.404] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:60:0) after 7m47s
[17:13:55.442] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:60:0)
[17:13:55.470] Build status: STARTED
[17:13:55.470] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:61:0) after 3m48s
[17:17:43.566] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:61:0)
[17:17:43.592] Build status: STARTED
[17:17:43.592] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:62:0) after 7m28s
[17:25:11.616] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:62:0)
[17:25:11.634] Build status: STARTED
[17:25:11.634] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:63:0) after 8m57s
[17:34:08.665] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:63:0)
[17:34:08.754] Build status: STARTED
[17:34:08.754] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:64:0) after 3m0s
[17:37:08.805] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:64:0)
[17:37:08.831] Build status: STARTED
[17:37:08.831] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:65:0) after 8m31s
[17:45:39.850] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:65:0)
[17:45:39.899] Build status: STARTED
[17:45:39.899] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:66:0) after 3m9s
[17:48:48.918] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:66:0)
[17:48:48.934] Build status: STARTED
[17:48:48.934] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935590712551640640:67:0) after 8m57s
[17:55:53.686] Received PubSub notification, asking Buildbucket for the build status
[17:55:53.705] Build:
{
"id": "8770160650564468033",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 30308,
"createdBy": "project:chromium",
"createTime": "2023-09-12T12:00:59.007566924Z",
"startTime": "2023-09-12T12:04:36.705952Z",
"endTime": "2023-09-12T17:55:53.412058729Z",
"updateTime": "2023-09-12T17:55:53.412058729Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "bc0d423a163c84de9a02d4c0757fb25038bf8bc4",
"ref": "refs/heads/main"
}
}
}
[17:55:53.705] Invocation finished in 5h54m55.976265818s with status FAILED