[06:53:17.023] New invocation is queued and will start shortly
[06:53:18.191] Starting the invocation (attempt 1)
[06:53:18.220] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/a101e3d07a498bfc361b03e411a90f20d78d66cf"
[06:53:18.220] Popped gitiles commit info from properties and tags
[06:53:18.220] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[06:53:18.220] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[06:53:18.220] Buildbucket request:
{
"requestId": "8956537969250894096",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a101e3d07a498bfc361b03e411a90f20d78d66cf",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8956537969250894096"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[06:53:18.703] Scheduled build:
{
"id": "8791107907268394609",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 28815,
"createdBy": "project:chromium",
"createTime": "2023-01-24T06:53:18.290244728Z",
"updateTime": "2023-01-24T06:53:18.290244728Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a101e3d07a498bfc361b03e411a90f20d78d66cf",
"ref": "refs/heads/main"
}
}
}
[06:53:18.703] Task URL: https://cr-buildbucket.appspot.com/build/8791107907268394609
[06:53:18.703] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:2:0) after 8m29s
[06:56:01.380] Received PubSub notification, asking Buildbucket for the build status
[06:56:01.417] Build status: STARTED
[07:01:47.978] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:2:0)
[07:01:48.016] Build status: STARTED
[07:01:48.016] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:4:0) after 8m54s
[07:10:42.167] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:4:0)
[07:10:42.187] Build status: STARTED
[07:10:42.187] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:5:0) after 5m53s
[07:16:35.418] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:5:0)
[07:16:35.449] Build status: STARTED
[07:16:35.449] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:6:0) after 9m22s
[07:25:57.643] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:6:0)
[07:25:57.668] Build status: STARTED
[07:25:57.668] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:7:0) after 7m7s
[07:33:04.878] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:7:0)
[07:33:05.067] Build status: STARTED
[07:33:05.067] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:8:0) after 8m6s
[07:41:11.061] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:8:0)
[07:41:11.086] Build status: STARTED
[07:41:11.086] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:9:0) after 3m59s
[07:45:10.097] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:9:0)
[07:45:10.122] Build status: STARTED
[07:45:10.122] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:10:0) after 3m4s
[07:48:14.327] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:10:0)
[07:48:14.356] Build status: STARTED
[07:48:14.356] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:11:0) after 6m47s
[07:55:01.390] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:11:0)
[07:55:01.414] Build status: STARTED
[07:55:01.414] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:12:0) after 9m36s
[08:04:37.473] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:12:0)
[08:04:37.510] Build status: STARTED
[08:04:37.510] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:13:0) after 5m45s
[08:10:22.549] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:13:0)
[08:10:22.593] Build status: STARTED
[08:10:22.593] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:14:0) after 8m13s
[08:18:35.875] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:14:0)
[08:18:35.895] Build status: STARTED
[08:18:35.895] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:15:0) after 5m10s
[08:23:45.921] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:15:0)
[08:23:45.946] Build status: STARTED
[08:23:45.946] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:16:0) after 1m55s
[08:25:40.933] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:16:0)
[08:25:40.951] Build status: STARTED
[08:25:40.951] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:17:0) after 3m24s
[08:29:04.980] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:17:0)
[08:29:05.024] Build status: STARTED
[08:29:05.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:18:0) after 3m55s
[08:33:00.149] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:18:0)
[08:33:00.177] Build status: STARTED
[08:33:00.177] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:19:0) after 6m41s
[08:39:41.403] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:19:0)
[08:39:41.422] Build status: STARTED
[08:39:41.422] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:20:0) after 6m40s
[08:46:21.437] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:20:0)
[08:46:21.465] Build status: STARTED
[08:46:21.465] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:21:0) after 5m24s
[08:51:45.736] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:21:0)
[08:51:45.767] Build status: STARTED
[08:51:45.768] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:22:0) after 2m38s
[08:54:24.040] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:22:0)
[08:54:24.088] Build status: STARTED
[08:54:24.088] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:23:0) after 4m5s
[08:58:29.109] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:23:0)
[08:58:29.137] Build status: STARTED
[08:58:29.137] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:24:0) after 8m45s
[09:07:14.291] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:24:0)
[09:07:14.312] Build status: STARTED
[09:07:14.312] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:25:0) after 3m10s
[09:10:24.336] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:25:0)
[09:10:24.394] Build status: STARTED
[09:10:24.394] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:26:0) after 1m53s
[09:12:17.518] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:26:0)
[09:12:17.540] Build status: STARTED
[09:12:17.541] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:27:0) after 8m35s
[09:20:52.620] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:27:0)
[09:20:52.642] Build status: STARTED
[09:20:52.642] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:28:0) after 2m2s
[09:22:54.915] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:28:0)
[09:22:54.935] Build status: STARTED
[09:22:54.935] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:29:0) after 8m4s
[09:30:59.078] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:29:0)
[09:30:59.197] Build status: STARTED
[09:30:59.197] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:30:0) after 5m1s
[09:36:00.310] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:30:0)
[09:36:00.332] Build status: STARTED
[09:36:00.332] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:31:0) after 2m59s
[09:38:59.404] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:31:0)
[09:38:59.437] Build status: STARTED
[09:38:59.437] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:32:0) after 8m0s
[09:46:59.506] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:32:0)
[09:46:59.535] Build status: STARTED
[09:46:59.535] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:33:0) after 1m34s
[09:48:33.569] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:33:0)
[09:48:33.597] Build status: STARTED
[09:48:33.597] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:34:0) after 7m50s
[09:56:23.718] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:34:0)
[09:56:23.754] Build status: STARTED
[09:56:23.754] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:35:0) after 5m41s
[10:02:04.749] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:35:0)
[10:02:04.774] Build status: STARTED
[10:02:04.774] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:36:0) after 5m42s
[10:07:46.794] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:36:0)
[10:07:46.813] Build status: STARTED
[10:07:46.813] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:37:0) after 5m48s
[10:13:34.859] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:37:0)
[10:13:34.942] Build status: STARTED
[10:13:34.942] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:38:0) after 1m3s
[10:14:37.964] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:38:0)
[10:14:37.985] Build status: STARTED
[10:14:37.985] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:39:0) after 7m45s
[10:22:23.118] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:39:0)
[10:22:23.137] Build status: STARTED
[10:22:23.137] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:40:0) after 9m18s
[10:31:41.422] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:40:0)
[10:31:41.447] Build status: STARTED
[10:31:41.447] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:41:0) after 8m0s
[10:39:41.802] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:41:0)
[10:39:41.822] Build status: STARTED
[10:39:41.822] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:42:0) after 4m0s
[10:43:42.033] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:42:0)
[10:43:42.058] Build status: STARTED
[10:43:42.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:43:0) after 1m39s
[10:45:21.090] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:43:0)
[10:45:21.115] Build status: STARTED
[10:45:21.115] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:44:0) after 3m6s
[10:48:27.108] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:44:0)
[10:48:27.134] Build status: STARTED
[10:48:27.134] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:45:0) after 1m16s
[10:49:43.153] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:45:0)
[10:49:43.185] Build status: STARTED
[10:49:43.185] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:46:0) after 9m12s
[10:58:55.403] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:46:0)
[10:58:55.427] Build status: STARTED
[10:58:55.427] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:47:0) after 6m25s
[11:05:20.451] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:47:0)
[11:05:20.475] Build status: STARTED
[11:05:20.475] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:48:0) after 8m46s
[11:14:06.525] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:48:0)
[11:14:06.546] Build status: STARTED
[11:14:06.546] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:49:0) after 8m42s
[11:22:48.569] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:49:0)
[11:22:48.591] Build status: STARTED
[11:22:48.591] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:50:0) after 2m30s
[11:25:18.699] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:50:0)
[11:25:18.748] Build status: STARTED
[11:25:18.748] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:51:0) after 1m43s
[11:27:01.779] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:51:0)
[11:27:01.803] Build status: STARTED
[11:27:01.803] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:52:0) after 7m26s
[11:34:28.078] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:52:0)
[11:34:28.102] Build status: STARTED
[11:34:28.102] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:53:0) after 7m3s
[11:41:31.157] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:53:0)
[11:41:31.183] Build status: STARTED
[11:41:31.183] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:54:0) after 8m46s
[11:50:17.291] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:54:0)
[11:50:17.319] Build status: STARTED
[11:50:17.319] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:55:0) after 1m38s
[11:51:55.451] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:55:0)
[11:51:55.476] Build status: STARTED
[11:51:55.476] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:56:0) after 5m12s
[11:57:07.700] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:56:0)
[11:57:07.782] Build status: STARTED
[11:57:07.782] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:57:0) after 7m50s
[12:04:58.445] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:57:0)
[12:04:58.469] Build status: STARTED
[12:04:58.469] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:58:0) after 4m36s
[12:09:34.596] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:58:0)
[12:09:34.619] Build status: STARTED
[12:09:34.619] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:59:0) after 8m15s
[12:17:49.678] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:59:0)
[12:17:49.723] Build status: STARTED
[12:17:49.723] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:60:0) after 3m17s
[12:21:06.752] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:60:0)
[12:21:06.775] Build status: STARTED
[12:21:06.775] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:61:0) after 3m6s
[12:24:12.845] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:61:0)
[12:24:12.868] Build status: STARTED
[12:24:12.868] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:62:0) after 7m0s
[12:31:12.894] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:62:0)
[12:31:12.917] Build status: STARTED
[12:31:12.917] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:63:0) after 9m41s
[12:40:54.079] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:63:0)
[12:40:54.169] Build status: STARTED
[12:40:54.169] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:64:0) after 4m37s
[12:45:31.186] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:64:0)
[12:45:31.212] Build status: STARTED
[12:45:31.212] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956537969250894096:65:0) after 4m29s
[12:50:00.216] Received PubSub notification, asking Buildbucket for the build status
[12:50:00.239] Build:
{
"id": "8791107907268394609",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 28815,
"createdBy": "project:chromium",
"createTime": "2023-01-24T06:53:18.290244728Z",
"startTime": "2023-01-24T06:55:59.628465Z",
"endTime": "2023-01-24T12:49:59.941721573Z",
"updateTime": "2023-01-24T12:49:59.941721573Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a101e3d07a498bfc361b03e411a90f20d78d66cf",
"ref": "refs/heads/main"
}
}
}
[12:50:00.239] Invocation finished in 5h56m43.222951396s with status FAILED