[07:08:44.431] New invocation is queued and will start shortly
[07:08:45.473] Starting the invocation (attempt 1)
[07:08:45.520] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/ff875a31a2ce88ef6e595cb666a5225e7b5492cd"
[07:08:45.520] Popped gitiles commit info from properties and tags
[07:08:45.520] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[07:08:45.520] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[07:08:45.520] Buildbucket request:
{
"requestId": "9000567122471942400",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ff875a31a2ce88ef6e595cb666a5225e7b5492cd",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9000567122471942400"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[07:08:46.037] Scheduled build:
{
"id": "8835137060582469121",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23240,
"createdBy": "project:chromium",
"createTime": "2021-09-25T07:08:45.601385463Z",
"updateTime": "2021-09-25T07:08:45.856469229Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ff875a31a2ce88ef6e595cb666a5225e7b5492cd",
"ref": "refs/heads/main"
}
}
}
[07:08:46.037] Task URL: https://cr-buildbucket.appspot.com/build/8835137060582469121
[07:08:46.037] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:2:0) after 4m14s
[07:11:15.828] Received PubSub notification, asking Buildbucket for the build status
[07:11:15.860] Build status: STARTED
[07:13:00.059] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:2:0)
[07:13:00.088] Build status: STARTED
[07:13:00.088] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:4:0) after 7m10s
[07:20:10.430] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:4:0)
[07:20:10.476] Build status: STARTED
[07:20:10.476] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:5:0) after 3m46s
[07:23:56.615] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:5:0)
[07:23:56.647] Build status: STARTED
[07:23:56.647] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:6:0) after 8m15s
[07:32:11.864] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:6:0)
[07:32:11.898] Build status: STARTED
[07:32:11.898] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:7:0) after 8m0s
[07:40:11.955] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:7:0)
[07:40:12.019] Build status: STARTED
[07:40:12.019] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:8:0) after 6m1s
[07:46:13.035] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:8:0)
[07:46:13.076] Build status: STARTED
[07:46:13.076] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:9:0) after 1m28s
[07:47:41.093] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:9:0)
[07:47:41.132] Build status: STARTED
[07:47:41.132] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:10:0) after 7m21s
[07:55:02.161] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:10:0)
[07:55:02.194] Build status: STARTED
[07:55:02.194] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:11:0) after 2m12s
[07:57:14.374] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:11:0)
[07:57:14.403] Build status: STARTED
[07:57:14.403] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:12:0) after 8m27s
[08:05:41.565] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:12:0)
[08:05:41.600] Build status: STARTED
[08:05:41.600] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:13:0) after 5m59s
[08:11:40.618] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:13:0)
[08:11:40.675] Build status: STARTED
[08:11:40.675] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:14:0) after 4m7s
[08:15:47.660] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:14:0)
[08:15:47.691] Build status: STARTED
[08:15:47.691] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:15:0) after 4m29s
[08:20:16.707] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:15:0)
[08:20:16.740] Build status: STARTED
[08:20:16.740] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:16:0) after 2m18s
[08:22:34.756] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:16:0)
[08:22:34.792] Build status: STARTED
[08:22:34.792] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:17:0) after 6m18s
[08:28:52.819] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:17:0)
[08:28:52.847] Build status: STARTED
[08:28:52.847] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:18:0) after 2m30s
[08:31:22.873] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:18:0)
[08:31:22.904] Build status: STARTED
[08:31:22.904] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:19:0) after 4m12s
[08:35:34.922] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:19:0)
[08:35:34.978] Build status: STARTED
[08:35:34.978] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:20:0) after 2m1s
[08:37:36.116] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:20:0)
[08:37:36.146] Build status: STARTED
[08:37:36.146] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:21:0) after 8m43s
[08:46:19.363] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:21:0)
[08:46:19.398] Build status: STARTED
[08:46:19.398] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:22:0) after 3m31s
[08:49:50.414] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:22:0)
[08:49:50.439] Build status: STARTED
[08:49:50.439] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:23:0) after 1m30s
[08:51:20.455] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:23:0)
[08:51:20.522] Build status: STARTED
[08:51:20.522] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:24:0) after 4m26s
[08:55:46.540] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:24:0)
[08:55:46.598] Build status: STARTED
[08:55:46.598] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:25:0) after 1m8s
[08:56:54.642] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:25:0)
[08:56:54.681] Build status: STARTED
[08:56:54.681] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:26:0) after 2m22s
[08:59:16.700] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:26:0)
[08:59:16.739] Build status: STARTED
[08:59:16.739] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:27:0) after 5m49s
[09:05:05.978] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:27:0)
[09:05:06.006] Build status: STARTED
[09:05:06.006] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:28:0) after 2m18s
[09:07:24.025] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:28:0)
[09:07:24.055] Build status: STARTED
[09:07:24.055] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:29:0) after 9m5s
[09:16:29.201] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:29:0)
[09:16:29.232] Build status: STARTED
[09:16:29.232] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:30:0) after 3m9s
[09:19:38.323] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:30:0)
[09:19:38.354] Build status: STARTED
[09:19:38.354] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:31:0) after 6m48s
[09:26:26.372] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:31:0)
[09:26:26.403] Build status: STARTED
[09:26:26.403] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:32:0) after 5m40s
[09:32:06.423] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:32:0)
[09:32:06.454] Build status: STARTED
[09:32:06.454] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:33:0) after 3m31s
[09:35:37.475] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:33:0)
[09:35:37.572] Build status: STARTED
[09:35:37.572] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:34:0) after 9m19s
[09:44:56.594] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:34:0)
[09:44:56.638] Build status: STARTED
[09:44:56.638] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:35:0) after 7m40s
[09:52:36.655] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:35:0)
[09:52:36.718] Build status: STARTED
[09:52:36.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:36:0) after 5m9s
[09:57:46.267] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:36:0)
[09:57:46.302] Build status: STARTED
[09:57:46.302] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:37:0) after 3m25s
[10:01:11.971] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:37:0)
[10:01:12.000] Build status: STARTED
[10:01:12.000] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:38:0) after 6m15s
[10:07:27.015] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:38:0)
[10:07:27.069] Build status: STARTED
[10:07:27.069] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:39:0) after 3m28s
[10:10:55.088] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:39:0)
[10:10:55.118] Build status: STARTED
[10:10:55.118] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:40:0) after 7m37s
[10:18:32.138] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:40:0)
[10:18:32.168] Build status: STARTED
[10:18:32.168] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:41:0) after 4m8s
[10:22:40.186] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:41:0)
[10:22:40.237] Build status: STARTED
[10:22:40.237] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:42:0) after 6m37s
[10:29:17.518] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:42:0)
[10:29:17.549] Build status: STARTED
[10:29:17.549] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:43:0) after 4m5s
[10:33:22.665] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:43:0)
[10:33:22.705] Build status: STARTED
[10:33:22.705] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:44:0) after 8m17s
[10:41:40.230] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:44:0)
[10:41:40.288] Build status: STARTED
[10:41:40.288] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:45:0) after 5m4s
[10:46:44.305] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:45:0)
[10:46:44.337] Build status: STARTED
[10:46:44.337] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:46:0) after 2m50s
[10:49:34.353] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:46:0)
[10:49:34.384] Build status: STARTED
[10:49:34.384] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:47:0) after 5m17s
[10:54:51.406] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:47:0)
[10:54:51.436] Build status: STARTED
[10:54:51.436] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:48:0) after 7m11s
[11:02:02.615] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:48:0)
[11:02:02.654] Build status: STARTED
[11:02:02.654] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:49:0) after 5m7s
[11:07:10.049] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:49:0)
[11:07:10.127] Build status: STARTED
[11:07:10.127] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:50:0) after 7m46s
[11:14:57.251] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:50:0)
[11:14:57.284] Build status: STARTED
[11:14:57.284] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:51:0) after 8m5s
[11:23:02.833] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:51:0)
[11:23:02.891] Build status: STARTED
[11:23:02.891] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:52:0) after 2m2s
[11:25:04.969] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:52:0)
[11:25:04.998] Build status: STARTED
[11:25:04.998] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:53:0) after 2m30s
[11:27:35.653] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:53:0)
[11:27:35.684] Build status: STARTED
[11:27:35.684] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:54:0) after 8m16s
[11:35:51.700] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:54:0)
[11:35:51.729] Build status: STARTED
[11:35:51.729] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:55:0) after 7m46s
[11:43:37.758] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:55:0)
[11:43:37.805] Build status: STARTED
[11:43:37.805] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:56:0) after 3m9s
[11:46:46.823] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:56:0)
[11:46:46.871] Build status: STARTED
[11:46:46.871] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:57:0) after 5m15s
[11:52:01.893] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:57:0)
[11:52:01.930] Build status: STARTED
[11:52:01.930] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:58:0) after 3m0s
[11:55:01.974] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:58:0)
[11:55:02.056] Build status: STARTED
[11:55:02.056] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:59:0) after 6m58s
[12:02:00.193] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:59:0)
[12:02:00.249] Build status: STARTED
[12:02:00.249] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:60:0) after 8m23s
[12:10:23.268] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:60:0)
[12:10:23.297] Build status: STARTED
[12:10:23.297] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:61:0) after 9m1s
[12:19:24.315] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:61:0)
[12:19:24.341] Build status: STARTED
[12:19:24.341] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:62:0) after 9m51s
[12:29:15.718] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:62:0)
[12:29:15.749] Build status: STARTED
[12:29:15.749] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:63:0) after 2m8s
[12:31:23.877] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:63:0)
[12:31:23.903] Build status: STARTED
[12:31:23.903] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000567122471942400:64:0) after 7m50s
[12:39:11.192] Received PubSub notification, asking Buildbucket for the build status
[12:39:11.273] Build:
{
"id": "8835137060582469121",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23240,
"createdBy": "project:chromium",
"createTime": "2021-09-25T07:08:45.601385463Z",
"startTime": "2021-09-25T07:11:15.162439Z",
"endTime": "2021-09-25T12:39:10.741693633Z",
"updateTime": "2021-09-25T12:39:10.742171753Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ff875a31a2ce88ef6e595cb666a5225e7b5492cd",
"ref": "refs/heads/main"
}
}
}
[12:39:11.273] Invocation finished in 5h30m26.856594117s with status FAILED