[17:03:42.358] New invocation is queued and will start shortly
[17:03:43.502] Starting the invocation (attempt 1)
[17:03:43.559] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/b707d0e63c7679d645af219afaaa85d9501ad594"
[17:03:43.559] Popped gitiles commit info from properties and tags
[17:03:43.559] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[17:03:43.560] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[17:03:43.566] Buildbucket request:
{
"requestId": "8940463901754310928",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b707d0e63c7679d645af219afaaa85d9501ad594",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8940463901754310928"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[17:03:44.072] Scheduled build:
{
"id": "8775033839744841073",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 30018,
"createdBy": "project:chromium",
"createTime": "2023-07-20T17:03:43.647950235Z",
"updateTime": "2023-07-20T17:03:43.647950235Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b707d0e63c7679d645af219afaaa85d9501ad594",
"ref": "refs/heads/main"
}
}
}
[17:03:44.072] Task URL: https://cr-buildbucket.appspot.com/build/8775033839744841073
[17:03:44.073] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:2:0) after 1m37s
[17:05:21.111] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:2:0)
[17:05:21.137] Build status: SCHEDULED
[17:05:21.138] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:3:0) after 8m30s
[17:07:21.864] Received PubSub notification, asking Buildbucket for the build status
[17:07:21.908] Build status: STARTED
[17:13:51.255] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:3:0)
[17:13:51.285] Build status: STARTED
[17:13:51.285] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:5:0) after 6m12s
[17:20:03.442] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:5:0)
[17:20:03.465] Build status: STARTED
[17:20:03.465] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:6:0) after 3m53s
[17:23:56.792] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:6:0)
[17:23:56.811] Build status: STARTED
[17:23:56.811] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:7:0) after 9m1s
[17:32:57.937] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:7:0)
[17:32:57.956] Build status: STARTED
[17:32:57.956] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:8:0) after 7m5s
[17:40:03.037] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:8:0)
[17:40:03.070] Build status: STARTED
[17:40:03.070] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:9:0) after 4m23s
[17:44:26.134] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:9:0)
[17:44:26.155] Build status: STARTED
[17:44:26.155] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:10:0) after 1m12s
[17:45:38.789] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:10:0)
[17:45:38.859] Build status: STARTED
[17:45:38.859] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:11:0) after 8m35s
[17:54:14.036] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:11:0)
[17:54:14.057] Build status: STARTED
[17:54:14.057] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:12:0) after 8m28s
[18:02:42.181] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:12:0)
[18:02:42.204] Build status: STARTED
[18:02:42.204] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:13:0) after 4m24s
[18:07:06.222] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:13:0)
[18:07:06.246] Build status: STARTED
[18:07:06.246] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:14:0) after 5m59s
[18:13:05.437] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:14:0)
[18:13:05.508] Build status: STARTED
[18:13:05.508] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:15:0) after 9m7s
[18:22:12.531] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:15:0)
[18:22:12.663] Build status: STARTED
[18:22:12.663] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:16:0) after 7m33s
[18:29:45.686] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:16:0)
[18:29:45.702] Build status: STARTED
[18:29:45.702] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:17:0) after 3m30s
[18:33:15.917] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:17:0)
[18:33:15.934] Build status: STARTED
[18:33:15.934] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:18:0) after 2m34s
[18:35:49.967] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:18:0)
[18:35:49.991] Build status: STARTED
[18:35:49.991] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:19:0) after 4m34s
[18:40:24.139] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:19:0)
[18:40:24.159] Build status: STARTED
[18:40:24.159] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:20:0) after 9m10s
[18:49:34.788] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:20:0)
[18:49:34.806] Build status: STARTED
[18:49:34.806] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:21:0) after 9m24s
[18:58:58.845] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:21:0)
[18:58:58.862] Build status: STARTED
[18:58:58.862] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:22:0) after 4m53s
[19:03:51.884] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:22:0)
[19:03:51.909] Build status: STARTED
[19:03:51.909] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:23:0) after 6m41s
[19:10:33.119] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:23:0)
[19:10:33.225] Build status: STARTED
[19:10:33.225] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:24:0) after 4m53s
[19:15:26.500] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:24:0)
[19:15:26.516] Build status: STARTED
[19:15:26.516] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:25:0) after 7m40s
[19:23:06.543] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:25:0)
[19:23:06.639] Build status: STARTED
[19:23:06.639] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:26:0) after 3m7s
[19:26:13.660] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:26:0)
[19:26:13.681] Build status: STARTED
[19:26:13.681] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:27:0) after 1m46s
[19:27:59.676] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:27:0)
[19:27:59.695] Build status: STARTED
[19:27:59.695] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:28:0) after 2m31s
[19:30:31.260] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:28:0)
[19:30:31.329] Build status: STARTED
[19:30:31.329] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:29:0) after 8m46s
[19:39:17.456] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:29:0)
[19:39:17.471] Build status: STARTED
[19:39:17.471] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:30:0) after 9m49s
[19:49:06.628] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:30:0)
[19:49:06.648] Build status: STARTED
[19:49:06.648] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:31:0) after 8m33s
[19:57:39.717] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:31:0)
[19:57:39.773] Build status: STARTED
[19:57:39.773] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:32:0) after 3m51s
[20:01:30.796] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:32:0)
[20:01:30.815] Build status: STARTED
[20:01:30.815] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:33:0) after 9m50s
[20:11:20.834] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:33:0)
[20:11:20.850] Build status: STARTED
[20:11:20.850] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:34:0) after 2m31s
[20:13:51.889] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:34:0)
[20:13:51.910] Build status: STARTED
[20:13:51.910] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:35:0) after 1m48s
[20:15:39.986] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:35:0)
[20:15:40.009] Build status: STARTED
[20:15:40.009] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:36:0) after 5m56s
[20:21:36.045] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:36:0)
[20:21:36.067] Build status: STARTED
[20:21:36.067] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:37:0) after 6m10s
[20:27:46.089] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:37:0)
[20:27:46.128] Build status: STARTED
[20:27:46.129] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:38:0) after 1m11s
[20:28:57.163] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:38:0)
[20:28:57.227] Build status: STARTED
[20:28:57.227] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:39:0) after 1m55s
[20:30:52.288] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:39:0)
[20:30:52.313] Build status: STARTED
[20:30:52.313] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:40:0) after 9m43s
[20:40:35.341] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:40:0)
[20:40:35.363] Build status: STARTED
[20:40:35.363] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:41:0) after 1m35s
[20:42:10.336] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:41:0)
[20:42:10.362] Build status: STARTED
[20:42:10.362] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:42:0) after 9m46s
[20:51:56.382] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:42:0)
[20:51:56.484] Build status: STARTED
[20:51:56.484] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:43:0) after 5m57s
[20:57:53.587] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:43:0)
[20:57:53.605] Build status: STARTED
[20:57:53.605] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:44:0) after 5m44s
[21:03:37.720] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:44:0)
[21:03:37.748] Build status: STARTED
[21:03:37.749] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:45:0) after 5m3s
[21:08:40.734] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:45:0)
[21:08:40.753] Build status: STARTED
[21:08:40.753] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:46:0) after 2m44s
[21:11:24.779] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:46:0)
[21:11:24.796] Build status: STARTED
[21:11:24.796] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:47:0) after 1m33s
[21:12:57.858] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:47:0)
[21:12:57.881] Build status: STARTED
[21:12:57.881] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:48:0) after 1m7s
[21:14:04.957] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:48:0)
[21:14:04.976] Build status: STARTED
[21:14:04.976] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:49:0) after 8m55s
[21:23:00.011] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:49:0)
[21:23:00.041] Build status: STARTED
[21:23:00.041] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:50:0) after 4m46s
[21:27:46.097] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:50:0)
[21:27:46.128] Build status: STARTED
[21:27:46.128] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:51:0) after 4m36s
[21:32:22.173] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:51:0)
[21:32:22.194] Build status: STARTED
[21:32:22.194] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:52:0) after 3m45s
[21:36:07.214] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:52:0)
[21:36:07.232] Build status: STARTED
[21:36:07.232] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:53:0) after 4m48s
[21:40:55.555] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:53:0)
[21:40:55.574] Build status: STARTED
[21:40:55.574] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:54:0) after 2m5s
[21:43:00.718] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:54:0)
[21:43:00.735] Build status: STARTED
[21:43:00.735] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:55:0) after 4m25s
[21:47:25.770] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:55:0)
[21:47:25.787] Build status: STARTED
[21:47:25.787] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:56:0) after 7m34s
[21:54:59.899] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:56:0)
[21:54:59.981] Build status: STARTED
[21:54:59.981] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:57:0) after 7m20s
[22:02:20.004] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:57:0)
[22:02:20.034] Build status: STARTED
[22:02:20.034] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:58:0) after 4m6s
[22:06:26.456] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:58:0)
[22:06:26.473] Build status: STARTED
[22:06:26.473] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:59:0) after 7m19s
[22:13:45.494] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:59:0)
[22:13:45.510] Build status: STARTED
[22:13:45.510] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:60:0) after 4m34s
[22:18:19.659] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:60:0)
[22:18:19.755] Build status: STARTED
[22:18:19.755] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:61:0) after 7m47s
[22:26:07.284] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:61:0)
[22:26:07.302] Build status: STARTED
[22:26:07.302] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:62:0) after 5m57s
[22:32:05.035] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:62:0)
[22:32:05.063] Build status: STARTED
[22:32:05.063] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:63:0) after 7m12s
[22:39:17.194] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:63:0)
[22:39:17.236] Build status: STARTED
[22:39:17.236] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:64:0) after 7m52s
[22:47:09.378] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:64:0)
[22:47:09.448] Build status: STARTED
[22:47:09.448] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940463901754310928:65:0) after 3m22s
[22:49:42.111] Received PubSub notification, asking Buildbucket for the build status
[22:49:42.128] Build:
{
"id": "8775033839744841073",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 30018,
"createdBy": "project:chromium",
"createTime": "2023-07-20T17:03:43.647950235Z",
"startTime": "2023-07-20T17:07:20.520502Z",
"endTime": "2023-07-20T22:49:41.143231535Z",
"updateTime": "2023-07-20T22:49:41.143231535Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b707d0e63c7679d645af219afaaa85d9501ad594",
"ref": "refs/heads/main"
}
}
}
[22:49:42.128] Invocation finished in 5h45m59.78188982s with status FAILED