[07:16:17.206] New invocation is queued and will start shortly
[07:16:18.288] Starting the invocation (attempt 1)
[07:16:18.324] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/172b3474fbbbe1d2053e838d700fd04379fb5cb8"
[07:16:18.324] Popped gitiles commit info from properties and tags
[07:16:18.324] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[07:16:18.324] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[07:16:18.324] Buildbucket request:
{
"requestId": "8946842646627623712",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "172b3474fbbbe1d2053e838d700fd04379fb5cb8",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8946842646627623712"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[07:16:18.756] Scheduled build:
{
"id": "8781412584724961153",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29384,
"createdBy": "project:chromium",
"createTime": "2023-05-11T07:16:18.389051464Z",
"updateTime": "2023-05-11T07:16:18.389051464Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "172b3474fbbbe1d2053e838d700fd04379fb5cb8",
"ref": "refs/heads/main"
}
}
}
[07:16:18.756] Task URL: https://cr-buildbucket.appspot.com/build/8781412584724961153
[07:16:18.756] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:2:0) after 8m20s
[07:18:55.261] Received PubSub notification, asking Buildbucket for the build status
[07:18:55.280] Build status: STARTED
[07:24:38.893] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:2:0)
[07:24:38.911] Build status: STARTED
[07:24:38.911] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:4:0) after 7m11s
[07:31:50.028] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:4:0)
[07:31:50.068] Build status: STARTED
[07:31:50.068] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:5:0) after 6m48s
[07:38:38.147] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:5:0)
[07:38:38.196] Build status: STARTED
[07:38:38.196] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:6:0) after 2m29s
[07:41:07.329] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:6:0)
[07:41:07.354] Build status: STARTED
[07:41:07.354] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:7:0) after 8m24s
[07:49:31.375] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:7:0)
[07:49:31.400] Build status: STARTED
[07:49:31.400] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:8:0) after 1m43s
[07:51:14.417] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:8:0)
[07:51:14.437] Build status: STARTED
[07:51:14.437] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:9:0) after 3m3s
[07:54:17.458] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:9:0)
[07:54:17.501] Build status: STARTED
[07:54:17.501] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:10:0) after 4m27s
[07:58:44.471] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:10:0)
[07:58:44.509] Build status: STARTED
[07:58:44.509] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:11:0) after 1m27s
[08:00:11.529] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:11:0)
[08:00:11.558] Build status: STARTED
[08:00:11.558] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:12:0) after 8m23s
[08:08:34.580] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:12:0)
[08:08:34.608] Build status: STARTED
[08:08:34.608] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:13:0) after 1m49s
[08:10:23.640] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:13:0)
[08:10:23.809] Build status: STARTED
[08:10:23.809] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:14:0) after 5m44s
[08:16:07.828] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:14:0)
[08:16:07.848] Build status: STARTED
[08:16:07.848] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:15:0) after 7m40s
[08:23:48.016] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:15:0)
[08:23:48.034] Build status: STARTED
[08:23:48.034] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:16:0) after 5m52s
[08:29:40.057] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:16:0)
[08:29:40.134] Build status: STARTED
[08:29:40.134] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:17:0) after 1m9s
[08:30:49.106] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:17:0)
[08:30:49.153] Build status: STARTED
[08:30:49.153] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:18:0) after 6m52s
[08:37:41.178] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:18:0)
[08:37:41.199] Build status: STARTED
[08:37:41.199] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:19:0) after 2m6s
[08:39:47.326] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:19:0)
[08:39:47.344] Build status: STARTED
[08:39:47.344] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:20:0) after 8m4s
[08:47:51.364] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:20:0)
[08:47:51.381] Build status: STARTED
[08:47:51.381] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:21:0) after 2m14s
[08:50:05.535] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:21:0)
[08:50:05.582] Build status: STARTED
[08:50:05.583] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:22:0) after 5m8s
[08:55:13.747] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:22:0)
[08:55:13.764] Build status: STARTED
[08:55:13.764] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:23:0) after 3m23s
[08:58:36.799] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:23:0)
[08:58:36.820] Build status: STARTED
[08:58:36.820] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:24:0) after 4m44s
[09:03:20.833] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:24:0)
[09:03:20.851] Build status: STARTED
[09:03:20.851] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:25:0) after 5m31s
[09:08:51.952] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:25:0)
[09:08:51.970] Build status: STARTED
[09:08:51.970] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:26:0) after 7m39s
[09:16:30.995] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:26:0)
[09:16:31.020] Build status: STARTED
[09:16:31.020] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:27:0) after 3m38s
[09:20:09.041] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:27:0)
[09:20:09.062] Build status: STARTED
[09:20:09.062] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:28:0) after 2m39s
[09:22:48.082] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:28:0)
[09:22:48.098] Build status: STARTED
[09:22:48.098] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:29:0) after 3m56s
[09:26:44.401] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:29:0)
[09:26:44.434] Build status: STARTED
[09:26:44.434] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:30:0) after 5m3s
[09:31:47.462] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:30:0)
[09:31:47.488] Build status: STARTED
[09:31:47.488] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:31:0) after 6m24s
[09:38:11.584] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:31:0)
[09:38:11.604] Build status: STARTED
[09:38:11.604] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:32:0) after 9m53s
[09:48:04.671] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:32:0)
[09:48:04.690] Build status: STARTED
[09:48:04.690] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:33:0) after 8m42s
[09:56:46.741] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:33:0)
[09:56:46.763] Build status: STARTED
[09:56:46.763] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:34:0) after 3m12s
[09:59:58.916] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:34:0)
[09:59:58.932] Build status: STARTED
[09:59:58.932] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:35:0) after 3m45s
[10:03:44.041] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:35:0)
[10:03:44.120] Build status: STARTED
[10:03:44.120] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:36:0) after 4m12s
[10:07:56.137] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:36:0)
[10:07:56.168] Build status: STARTED
[10:07:56.168] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:37:0) after 8m35s
[10:16:31.195] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:37:0)
[10:16:31.231] Build status: STARTED
[10:16:31.231] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:38:0) after 6m40s
[10:23:11.445] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:38:0)
[10:23:11.465] Build status: STARTED
[10:23:11.465] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:39:0) after 9m4s
[10:32:15.447] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:39:0)
[10:32:15.488] Build status: STARTED
[10:32:15.488] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:40:0) after 7m54s
[10:40:09.534] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:40:0)
[10:40:09.555] Build status: STARTED
[10:40:09.555] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:41:0) after 1m22s
[10:41:31.579] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:41:0)
[10:41:31.598] Build status: STARTED
[10:41:31.598] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:42:0) after 9m40s
[10:51:11.615] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:42:0)
[10:51:11.636] Build status: STARTED
[10:51:11.636] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:43:0) after 1m29s
[10:52:40.641] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:43:0)
[10:52:40.678] Build status: STARTED
[10:52:40.678] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:44:0) after 5m53s
[10:58:33.769] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:44:0)
[10:58:33.793] Build status: STARTED
[10:58:33.793] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:45:0) after 2m13s
[11:00:46.936] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:45:0)
[11:00:46.957] Build status: STARTED
[11:00:46.957] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:46:0) after 5m51s
[11:06:37.979] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:46:0)
[11:06:38.050] Build status: STARTED
[11:06:38.051] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:47:0) after 1m59s
[11:08:37.376] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:47:0)
[11:08:37.396] Build status: STARTED
[11:08:37.396] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:48:0) after 6m13s
[11:14:50.589] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:48:0)
[11:14:50.620] Build status: STARTED
[11:14:50.620] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:49:0) after 8m9s
[11:22:59.649] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:49:0)
[11:22:59.671] Build status: STARTED
[11:22:59.671] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:50:0) after 4m2s
[11:27:01.700] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:50:0)
[11:27:01.722] Build status: STARTED
[11:27:01.722] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:51:0) after 2m39s
[11:29:40.814] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:51:0)
[11:29:40.835] Build status: STARTED
[11:29:40.835] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:52:0) after 2m5s
[11:31:45.956] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:52:0)
[11:31:45.976] Build status: STARTED
[11:31:45.976] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:53:0) after 2m1s
[11:33:47.537] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:53:0)
[11:33:47.559] Build status: STARTED
[11:33:47.559] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:54:0) after 6m16s
[11:40:03.669] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:54:0)
[11:40:03.822] Build status: STARTED
[11:40:03.822] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:55:0) after 3m2s
[11:43:05.844] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:55:0)
[11:43:05.885] Build status: STARTED
[11:43:05.885] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:56:0) after 1m27s
[11:44:33.006] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:56:0)
[11:44:33.119] Build status: STARTED
[11:44:33.120] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:57:0) after 5m3s
[11:49:36.136] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:57:0)
[11:49:36.159] Build status: STARTED
[11:49:36.159] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:58:0) after 5m14s
[11:54:50.383] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:58:0)
[11:54:50.400] Build status: STARTED
[11:54:50.400] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:59:0) after 9m32s
[12:04:22.484] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:59:0)
[12:04:22.545] Build status: STARTED
[12:04:22.545] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:60:0) after 5m32s
[12:09:54.730] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:60:0)
[12:09:54.750] Build status: STARTED
[12:09:54.750] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:61:0) after 5m35s
[12:15:29.770] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:61:0)
[12:15:29.794] Build status: STARTED
[12:15:29.794] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:62:0) after 1m28s
[12:16:57.904] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:62:0)
[12:16:57.926] Build status: STARTED
[12:16:57.926] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:63:0) after 7m49s
[12:24:47.043] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:63:0)
[12:24:47.071] Build status: STARTED
[12:24:47.071] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946842646627623712:64:0) after 8m53s
[12:26:50.191] Received PubSub notification, asking Buildbucket for the build status
[12:26:50.213] Build:
{
"id": "8781412584724961153",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29384,
"createdBy": "project:chromium",
"createTime": "2023-05-11T07:16:18.389051464Z",
"startTime": "2023-05-11T07:18:54.718419Z",
"endTime": "2023-05-11T12:26:49.936516468Z",
"updateTime": "2023-05-11T12:26:49.936516468Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "172b3474fbbbe1d2053e838d700fd04379fb5cb8",
"ref": "refs/heads/main"
}
}
}
[12:26:50.213] Invocation finished in 5h10m33.021844754s with status FAILED