[15:01:44.789] New invocation is queued and will start shortly
[15:01:45.958] Starting the invocation (attempt 1)
[15:01:46.012] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/69b4989251efa8b54f0513a1e0725cc14b9d5db0"
[15:01:46.012] Popped gitiles commit info from properties and tags
[15:01:46.012] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[15:01:46.013] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[15:01:46.013] Buildbucket request:
{
"requestId": "8995645127327463568",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "69b4989251efa8b54f0513a1e0725cc14b9d5db0",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8995645127327463568"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[15:01:46.883] Scheduled build:
{
"id": "8830215065109031873",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23574,
"createdBy": "project:chromium",
"createTime": "2021-11-18T15:01:46.269103845Z",
"updateTime": "2021-11-18T15:01:46.269103845Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "69b4989251efa8b54f0513a1e0725cc14b9d5db0",
"ref": "refs/heads/main"
}
}
}
[15:01:46.883] Task URL: https://cr-buildbucket.appspot.com/build/8830215065109031873
[15:01:46.883] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:2:0) after 4m42s
[15:04:18.663] Received PubSub notification, asking Buildbucket for the build status
[15:04:18.694] Build status: STARTED
[15:06:28.907] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:2:0)
[15:06:29.040] Build status: STARTED
[15:06:29.040] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:4:0) after 5m8s
[15:11:37.164] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:4:0)
[15:11:37.261] Build status: STARTED
[15:11:37.261] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:5:0) after 6m9s
[15:17:46.452] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:5:0)
[15:17:46.479] Build status: STARTED
[15:17:46.479] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:6:0) after 3m26s
[15:21:12.499] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:6:0)
[15:21:12.534] Build status: STARTED
[15:21:12.534] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:7:0) after 3m30s
[15:24:42.564] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:7:0)
[15:24:42.597] Build status: STARTED
[15:24:42.597] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:8:0) after 4m51s
[15:29:33.596] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:8:0)
[15:29:33.636] Build status: STARTED
[15:29:33.636] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:9:0) after 5m46s
[15:35:19.700] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:9:0)
[15:35:19.764] Build status: STARTED
[15:35:19.764] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:10:0) after 2m21s
[15:37:40.779] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:10:0)
[15:37:40.808] Build status: STARTED
[15:37:40.808] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:11:0) after 8m39s
[15:46:19.841] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:11:0)
[15:46:19.908] Build status: STARTED
[15:46:19.908] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:12:0) after 3m24s
[15:49:43.932] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:12:0)
[15:49:43.971] Build status: STARTED
[15:49:43.971] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:13:0) after 6m16s
[15:56:00.050] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:13:0)
[15:56:00.082] Build status: STARTED
[15:56:00.082] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:14:0) after 4m31s
[16:00:31.393] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:14:0)
[16:00:31.428] Build status: STARTED
[16:00:31.428] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:15:0) after 9m14s
[16:09:45.437] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:15:0)
[16:09:45.533] Build status: STARTED
[16:09:45.533] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:16:0) after 9m51s
[16:19:37.516] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:16:0)
[16:19:37.554] Build status: STARTED
[16:19:37.554] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:17:0) after 8m1s
[16:27:38.576] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:17:0)
[16:27:38.656] Build status: STARTED
[16:27:38.656] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:18:0) after 9m0s
[16:36:38.721] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:18:0)
[16:36:38.785] Build status: STARTED
[16:36:38.785] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:19:0) after 4m18s
[16:40:56.836] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:19:0)
[16:40:56.868] Build status: STARTED
[16:40:56.868] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:20:0) after 3m45s
[16:44:41.895] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:20:0)
[16:44:41.930] Build status: STARTED
[16:44:41.930] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:21:0) after 6m47s
[16:51:29.238] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:21:0)
[16:51:29.279] Build status: STARTED
[16:51:29.279] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:22:0) after 4m44s
[16:56:13.421] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:22:0)
[16:56:13.458] Build status: STARTED
[16:56:13.458] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:23:0) after 5m37s
[17:01:50.585] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:23:0)
[17:01:50.694] Build status: STARTED
[17:01:50.694] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:24:0) after 1m29s
[17:03:19.719] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:24:0)
[17:03:19.796] Build status: STARTED
[17:03:19.796] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:25:0) after 3m50s
[17:07:09.998] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:25:0)
[17:07:10.032] Build status: STARTED
[17:07:10.032] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:26:0) after 2m35s
[17:09:45.275] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:26:0)
[17:09:45.308] Build status: STARTED
[17:09:45.308] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:27:0) after 7m21s
[17:17:06.308] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:27:0)
[17:17:06.336] Build status: STARTED
[17:17:06.336] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:28:0) after 8m11s
[17:25:17.580] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:28:0)
[17:25:17.667] Build status: STARTED
[17:25:17.667] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:29:0) after 7m19s
[17:32:37.158] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:29:0)
[17:32:37.189] Build status: STARTED
[17:32:37.189] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:30:0) after 4m3s
[17:36:40.414] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:30:0)
[17:36:40.477] Build status: STARTED
[17:36:40.477] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:31:0) after 2m55s
[17:39:35.592] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:31:0)
[17:39:35.623] Build status: STARTED
[17:39:35.623] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:32:0) after 4m4s
[17:43:39.650] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:32:0)
[17:43:39.686] Build status: STARTED
[17:43:39.686] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:33:0) after 6m32s
[17:50:11.832] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:33:0)
[17:50:11.868] Build status: STARTED
[17:50:11.868] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:34:0) after 2m24s
[17:52:36.033] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:34:0)
[17:52:36.071] Build status: STARTED
[17:52:36.071] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:35:0) after 5m13s
[17:57:49.098] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:35:0)
[17:57:49.131] Build status: STARTED
[17:57:49.131] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:36:0) after 9m6s
[18:06:55.277] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:36:0)
[18:06:55.316] Build status: STARTED
[18:06:55.316] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:37:0) after 5m29s
[18:12:24.434] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:37:0)
[18:12:24.467] Build status: STARTED
[18:12:24.467] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:38:0) after 6m11s
[18:18:35.804] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:38:0)
[18:18:35.841] Build status: STARTED
[18:18:35.841] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:39:0) after 7m10s
[18:25:45.868] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:39:0)
[18:25:45.910] Build status: STARTED
[18:25:45.910] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:40:0) after 4m11s
[18:29:56.933] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:40:0)
[18:29:56.961] Build status: STARTED
[18:29:56.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:41:0) after 6m37s
[18:36:34.175] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:41:0)
[18:36:34.214] Build status: STARTED
[18:36:34.214] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:42:0) after 1m44s
[18:38:18.273] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:42:0)
[18:38:18.308] Build status: STARTED
[18:38:18.308] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:43:0) after 1m12s
[18:39:30.349] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:43:0)
[18:39:30.388] Build status: STARTED
[18:39:30.388] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:44:0) after 9m22s
[18:48:52.509] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:44:0)
[18:48:52.547] Build status: STARTED
[18:48:52.548] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:45:0) after 5m59s
[18:54:51.571] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:45:0)
[18:54:51.610] Build status: STARTED
[18:54:51.610] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:46:0) after 3m29s
[18:58:20.827] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:46:0)
[18:58:20.857] Build status: STARTED
[18:58:20.857] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:47:0) after 5m49s
[19:04:09.921] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:47:0)
[19:04:09.954] Build status: STARTED
[19:04:09.954] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:48:0) after 9m1s
[19:13:11.032] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:48:0)
[19:13:11.070] Build status: STARTED
[19:13:11.070] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:49:0) after 9m31s
[19:22:42.092] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:49:0)
[19:22:42.122] Build status: STARTED
[19:22:42.122] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:50:0) after 5m13s
[19:27:55.245] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:50:0)
[19:27:55.331] Build status: STARTED
[19:27:55.331] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:51:0) after 6m22s
[19:34:17.374] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:51:0)
[19:34:17.408] Build status: STARTED
[19:34:17.408] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:52:0) after 3m18s
[19:37:35.470] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:52:0)
[19:37:35.508] Build status: STARTED
[19:37:35.508] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:53:0) after 8m33s
[19:46:08.803] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:53:0)
[19:46:08.844] Build status: STARTED
[19:46:08.844] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:54:0) after 1m7s
[19:47:16.202] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:54:0)
[19:47:16.238] Build status: STARTED
[19:47:16.238] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:55:0) after 9m29s
[19:56:45.433] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:55:0)
[19:56:45.481] Build status: STARTED
[19:56:45.481] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:56:0) after 1m31s
[19:58:16.540] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:56:0)
[19:58:16.573] Build status: STARTED
[19:58:16.573] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:57:0) after 6m55s
[20:05:11.769] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:57:0)
[20:05:11.829] Build status: STARTED
[20:05:11.829] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:58:0) after 9m22s
[20:14:34.017] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:58:0)
[20:14:34.051] Build status: STARTED
[20:14:34.051] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995645127327463568:59:0) after 8m22s
[20:22:04.219] Received PubSub notification, asking Buildbucket for the build status
[20:22:04.273] Build:
{
"id": "8830215065109031873",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23574,
"createdBy": "project:chromium",
"createTime": "2021-11-18T15:01:46.269103845Z",
"startTime": "2021-11-18T15:04:17.406258Z",
"endTime": "2021-11-18T20:22:03.687080135Z",
"updateTime": "2021-11-18T20:22:03.687080135Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "69b4989251efa8b54f0513a1e0725cc14b9d5db0",
"ref": "refs/heads/main"
}
}
}
[20:22:04.273] Invocation finished in 5h20m19.503457494s with status FAILED