[11:27:22.381] New invocation is queued and will start shortly
[11:27:23.443] Starting the invocation (attempt 1)
[11:27:23.511] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/26db08c3cff2328af8c142db05bc5d7d9ee42e3d"
[11:27:23.511] Popped gitiles commit info from properties and tags
[11:27:23.511] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[11:27:23.511] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[11:27:23.511] Buildbucket request:
{
"requestId": "8939850883232476832",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "26db08c3cff2328af8c142db05bc5d7d9ee42e3d",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8939850883232476832"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[11:27:24.354] Scheduled build:
{
"id": "8774420821133927921",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 30070,
"createdBy": "project:chromium",
"createTime": "2023-07-27T11:27:23.752338061Z",
"updateTime": "2023-07-27T11:27:23.752338061Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "26db08c3cff2328af8c142db05bc5d7d9ee42e3d",
"ref": "refs/heads/main"
}
}
}
[11:27:24.354] Task URL: https://cr-buildbucket.appspot.com/build/8774420821133927921
[11:27:24.354] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:2:0) after 3m40s
[11:27:25.414] Received PubSub notification, asking Buildbucket for the build status
[11:27:25.450] Build status: SCHEDULED
[11:31:02.344] Received PubSub notification, asking Buildbucket for the build status
[11:31:02.365] Build status: STARTED
[11:31:04.432] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:2:0)
[11:31:04.447] Build status: STARTED
[11:31:04.447] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:5:0) after 7m48s
[11:38:52.538] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:5:0)
[11:38:52.569] Build status: STARTED
[11:38:52.569] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:6:0) after 1m43s
[11:40:35.566] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:6:0)
[11:40:35.600] Build status: STARTED
[11:40:35.600] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:7:0) after 1m46s
[11:42:21.717] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:7:0)
[11:42:21.742] Build status: STARTED
[11:42:21.742] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:8:0) after 6m17s
[11:48:38.871] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:8:0)
[11:48:38.887] Build status: STARTED
[11:48:38.887] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:9:0) after 4m16s
[11:52:54.997] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:9:0)
[11:52:55.024] Build status: STARTED
[11:52:55.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:10:0) after 6m55s
[11:59:50.049] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:10:0)
[11:59:50.069] Build status: STARTED
[11:59:50.069] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:11:0) after 4m54s
[12:04:44.085] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:11:0)
[12:04:44.101] Build status: STARTED
[12:04:44.101] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:12:0) after 8m35s
[12:13:19.222] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:12:0)
[12:13:19.242] Build status: STARTED
[12:13:19.242] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:13:0) after 1m19s
[12:14:38.517] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:13:0)
[12:14:38.538] Build status: STARTED
[12:14:38.538] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:14:0) after 3m43s
[12:18:21.917] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:14:0)
[12:18:21.937] Build status: STARTED
[12:18:21.937] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:15:0) after 8m45s
[12:27:07.053] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:15:0)
[12:27:07.148] Build status: STARTED
[12:27:07.148] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:16:0) after 8m15s
[12:35:22.358] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:16:0)
[12:35:22.378] Build status: STARTED
[12:35:22.378] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:17:0) after 2m29s
[12:37:51.497] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:17:0)
[12:37:51.516] Build status: STARTED
[12:37:51.516] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:18:0) after 8m48s
[12:46:39.771] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:18:0)
[12:46:39.789] Build status: STARTED
[12:46:39.789] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:19:0) after 4m25s
[12:51:04.912] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:19:0)
[12:51:05.020] Build status: STARTED
[12:51:05.021] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:20:0) after 6m40s
[12:57:44.996] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:20:0)
[12:57:45.015] Build status: STARTED
[12:57:45.015] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:21:0) after 6m9s
[13:03:54.470] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:21:0)
[13:03:54.487] Build status: STARTED
[13:03:54.487] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:22:0) after 9m29s
[13:13:23.533] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:22:0)
[13:13:23.556] Build status: STARTED
[13:13:23.556] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:23:0) after 9m16s
[13:22:39.802] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:23:0)
[13:22:39.818] Build status: STARTED
[13:22:39.818] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:24:0) after 6m1s
[13:28:40.831] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:24:0)
[13:28:40.862] Build status: STARTED
[13:28:40.862] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:25:0) after 9m25s
[13:38:05.943] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:25:0)
[13:38:05.961] Build status: STARTED
[13:38:05.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:26:0) after 3m44s
[13:41:50.016] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:26:0)
[13:41:50.034] Build status: STARTED
[13:41:50.035] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:27:0) after 7m20s
[13:49:10.465] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:27:0)
[13:49:10.519] Build status: STARTED
[13:49:10.520] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:28:0) after 2m2s
[13:51:12.547] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:28:0)
[13:51:12.576] Build status: STARTED
[13:51:12.576] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:29:0) after 5m54s
[13:57:06.659] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:29:0)
[13:57:06.676] Build status: STARTED
[13:57:06.676] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:30:0) after 5m9s
[14:02:15.771] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:30:0)
[14:02:15.831] Build status: STARTED
[14:02:15.831] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:31:0) after 1m18s
[14:03:34.115] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:31:0)
[14:03:34.137] Build status: STARTED
[14:03:34.137] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:32:0) after 6m58s
[14:10:32.162] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:32:0)
[14:10:32.180] Build status: STARTED
[14:10:32.180] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:33:0) after 2m49s
[14:13:21.359] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:33:0)
[14:13:21.375] Build status: STARTED
[14:13:21.375] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:34:0) after 5m3s
[14:18:24.361] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:34:0)
[14:18:24.402] Build status: STARTED
[14:18:24.402] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:35:0) after 5m33s
[14:23:57.403] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:35:0)
[14:23:57.433] Build status: STARTED
[14:23:57.433] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:36:0) after 2m12s
[14:26:09.697] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:36:0)
[14:26:09.718] Build status: STARTED
[14:26:09.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:37:0) after 3m28s
[14:29:37.762] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:37:0)
[14:29:37.785] Build status: STARTED
[14:29:37.785] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:38:0) after 6m4s
[14:35:41.884] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:38:0)
[14:35:41.905] Build status: STARTED
[14:35:41.905] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:39:0) after 3m35s
[14:39:17.357] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:39:0)
[14:39:17.386] Build status: STARTED
[14:39:17.386] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:40:0) after 4m12s
[14:43:29.525] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:40:0)
[14:43:29.543] Build status: STARTED
[14:43:29.543] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:41:0) after 1m17s
[14:44:46.662] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:41:0)
[14:44:46.687] Build status: STARTED
[14:44:46.687] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:42:0) after 4m12s
[14:48:59.065] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:42:0)
[14:48:59.087] Build status: STARTED
[14:48:59.087] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:43:0) after 5m25s
[14:54:24.343] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:43:0)
[14:54:24.372] Build status: STARTED
[14:54:24.372] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:44:0) after 8m2s
[15:02:26.393] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:44:0)
[15:02:26.425] Build status: STARTED
[15:02:26.425] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:45:0) after 6m51s
[15:09:17.723] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:45:0)
[15:09:17.740] Build status: STARTED
[15:09:17.740] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:46:0) after 3m22s
[15:12:39.845] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:46:0)
[15:12:39.864] Build status: STARTED
[15:12:39.864] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:47:0) after 1m3s
[15:13:43.040] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:47:0)
[15:13:43.060] Build status: STARTED
[15:13:43.060] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:48:0) after 2m22s
[15:16:05.147] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:48:0)
[15:16:05.167] Build status: STARTED
[15:16:05.167] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:49:0) after 6m0s
[15:22:05.311] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:49:0)
[15:22:05.334] Build status: STARTED
[15:22:05.334] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:50:0) after 1m42s
[15:23:47.482] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:50:0)
[15:23:47.510] Build status: STARTED
[15:23:47.510] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:51:0) after 9m4s
[15:32:51.641] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:51:0)
[15:32:51.748] Build status: STARTED
[15:32:51.748] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:52:0) after 9m21s
[15:42:12.845] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:52:0)
[15:42:12.873] Build status: STARTED
[15:42:12.873] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:53:0) after 1m30s
[15:43:43.057] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:53:0)
[15:43:43.082] Build status: STARTED
[15:43:43.082] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:54:0) after 8m25s
[15:52:08.106] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:54:0)
[15:52:08.125] Build status: STARTED
[15:52:08.125] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:55:0) after 9m34s
[16:01:42.251] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:55:0)
[16:01:42.273] Build status: STARTED
[16:01:42.273] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:56:0) after 7m20s
[16:09:02.511] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:56:0)
[16:09:02.536] Build status: STARTED
[16:09:02.536] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:57:0) after 9m59s
[16:19:01.641] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:57:0)
[16:19:01.666] Build status: STARTED
[16:19:01.666] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:58:0) after 6m20s
[16:25:21.966] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:58:0)
[16:25:21.991] Build status: STARTED
[16:25:21.991] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:59:0) after 7m6s
[16:32:28.025] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:59:0)
[16:32:28.132] Build status: STARTED
[16:32:28.132] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:60:0) after 8m23s
[16:40:51.150] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:60:0)
[16:40:51.171] Build status: STARTED
[16:40:51.171] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:61:0) after 2m48s
[16:43:39.290] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:61:0)
[16:43:39.312] Build status: STARTED
[16:43:39.312] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:62:0) after 7m8s
[16:50:47.482] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:62:0)
[16:50:47.508] Build status: STARTED
[16:50:47.508] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:63:0) after 9m27s
[17:00:14.732] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:63:0)
[17:00:14.753] Build status: STARTED
[17:00:14.753] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:64:0) after 2m27s
[17:02:41.932] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:64:0)
[17:02:41.957] Build status: STARTED
[17:02:41.957] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8939850883232476832:65:0) after 8m11s
[17:09:52.935] Received PubSub notification, asking Buildbucket for the build status
[17:09:52.965] Build:
{
"id": "8774420821133927921",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 30070,
"createdBy": "project:chromium",
"createTime": "2023-07-27T11:27:23.752338061Z",
"startTime": "2023-07-27T11:31:01.812650491Z",
"endTime": "2023-07-27T17:09:52.671841523Z",
"updateTime": "2023-07-27T17:09:52.671841523Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "26db08c3cff2328af8c142db05bc5d7d9ee42e3d",
"ref": "refs/heads/main"
}
}
}
[17:09:52.965] Invocation finished in 5h42m30.598483053s with status FAILED