[15:06:30.349] New invocation is queued and will start shortly
[15:06:31.422] Starting the invocation (attempt 1)
[15:06:31.455] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/248422165435b43fc81d745a71e6a5bd558564a5"
[15:06:31.455] Popped gitiles commit info from properties and tags
[15:06:31.455] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[15:06:31.455] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[15:06:31.455] Buildbucket request:
{
"requestId": "9001714824640759872",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "248422165435b43fc81d745a71e6a5bd558564a5",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9001714824640759872"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[15:06:32.075] Scheduled build:
{
"id": "8836284762759449553",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23082,
"createdBy": "project:chromium",
"createTime": "2021-09-12T15:06:31.512729789Z",
"updateTime": "2021-09-12T15:06:31.787293842Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "248422165435b43fc81d745a71e6a5bd558564a5",
"ref": "refs/heads/main"
}
}
}
[15:06:32.075] Task URL: https://cr-buildbucket.appspot.com/build/8836284762759449553
[15:06:32.076] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:2:0) after 9m20s
[15:08:55.599] Received PubSub notification, asking Buildbucket for the build status
[15:08:55.645] Build status: STARTED
[15:15:52.296] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:2:0)
[15:15:52.323] Build status: STARTED
[15:15:52.323] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:4:0) after 1m6s
[15:16:58.624] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:4:0)
[15:16:58.649] Build status: STARTED
[15:16:58.649] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:5:0) after 1m5s
[15:18:03.693] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:5:0)
[15:18:03.774] Build status: STARTED
[15:18:03.774] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:6:0) after 9m48s
[15:27:51.849] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:6:0)
[15:27:51.883] Build status: STARTED
[15:27:51.883] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:7:0) after 4m47s
[15:32:38.901] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:7:0)
[15:32:38.942] Build status: STARTED
[15:32:38.942] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:8:0) after 5m9s
[15:37:47.962] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:8:0)
[15:37:47.998] Build status: STARTED
[15:37:47.998] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:9:0) after 7m23s
[15:45:11.016] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:9:0)
[15:45:11.049] Build status: STARTED
[15:45:11.049] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:10:0) after 2m19s
[15:47:30.065] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:10:0)
[15:47:30.103] Build status: STARTED
[15:47:30.103] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:11:0) after 4m29s
[15:51:59.359] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:11:0)
[15:51:59.462] Build status: STARTED
[15:51:59.462] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:12:0) after 4m46s
[15:56:45.490] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:12:0)
[15:56:45.575] Build status: STARTED
[15:56:45.575] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:13:0) after 4m25s
[16:01:10.630] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:13:0)
[16:01:10.658] Build status: STARTED
[16:01:10.658] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:14:0) after 6m10s
[16:07:20.724] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:14:0)
[16:07:20.774] Build status: STARTED
[16:07:20.774] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:15:0) after 8m50s
[16:16:11.208] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:15:0)
[16:16:11.242] Build status: STARTED
[16:16:11.242] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:16:0) after 9m58s
[16:26:09.316] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:16:0)
[16:26:09.367] Build status: STARTED
[16:26:09.367] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:17:0) after 6m6s
[16:32:15.699] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:17:0)
[16:32:15.733] Build status: STARTED
[16:32:15.733] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:18:0) after 5m8s
[16:37:24.312] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:18:0)
[16:37:24.341] Build status: STARTED
[16:37:24.341] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:19:0) after 5m19s
[16:42:43.695] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:19:0)
[16:42:43.724] Build status: STARTED
[16:42:43.724] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:20:0) after 9m2s
[16:51:45.757] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:20:0)
[16:51:45.822] Build status: STARTED
[16:51:45.822] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:21:0) after 3m38s
[16:55:23.875] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:21:0)
[16:55:23.908] Build status: STARTED
[16:55:23.908] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:22:0) after 7m7s
[17:02:30.992] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:22:0)
[17:02:31.025] Build status: STARTED
[17:02:31.025] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:23:0) after 7m46s
[17:10:17.043] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:23:0)
[17:10:17.076] Build status: STARTED
[17:10:17.076] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:24:0) after 2m13s
[17:12:30.269] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:24:0)
[17:12:30.314] Build status: STARTED
[17:12:30.314] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:25:0) after 9m37s
[17:22:07.378] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:25:0)
[17:22:07.414] Build status: STARTED
[17:22:07.414] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:26:0) after 3m25s
[17:25:32.656] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:26:0)
[17:25:32.695] Build status: STARTED
[17:25:32.695] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:27:0) after 7m44s
[17:33:16.960] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:27:0)
[17:33:17.002] Build status: STARTED
[17:33:17.002] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:28:0) after 8m41s
[17:41:58.313] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:28:0)
[17:41:58.343] Build status: STARTED
[17:41:58.343] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:29:0) after 4m0s
[17:45:58.481] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:29:0)
[17:45:58.512] Build status: STARTED
[17:45:58.512] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:30:0) after 2m46s
[17:48:44.656] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:30:0)
[17:48:44.687] Build status: STARTED
[17:48:44.687] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:31:0) after 4m46s
[17:53:30.876] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:31:0)
[17:53:30.908] Build status: STARTED
[17:53:30.908] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:32:0) after 5m10s
[17:58:41.065] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:32:0)
[17:58:41.100] Build status: STARTED
[17:58:41.100] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:33:0) after 1m31s
[18:00:12.134] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:33:0)
[18:00:12.170] Build status: STARTED
[18:00:12.170] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:34:0) after 9m32s
[18:09:44.190] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:34:0)
[18:09:44.228] Build status: STARTED
[18:09:44.228] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:35:0) after 3m24s
[18:13:08.245] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:35:0)
[18:13:08.280] Build status: STARTED
[18:13:08.280] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:36:0) after 7m41s
[18:20:49.662] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:36:0)
[18:20:49.691] Build status: STARTED
[18:20:49.691] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:37:0) after 6m37s
[18:27:26.711] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:37:0)
[18:27:26.738] Build status: STARTED
[18:27:26.738] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:38:0) after 7m8s
[18:34:34.759] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:38:0)
[18:34:34.865] Build status: STARTED
[18:34:34.865] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:39:0) after 2m22s
[18:36:56.897] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:39:0)
[18:36:56.935] Build status: STARTED
[18:36:56.935] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:40:0) after 2m8s
[18:39:05.168] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:40:0)
[18:39:05.210] Build status: STARTED
[18:39:05.210] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:41:0) after 2m11s
[18:41:16.316] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:41:0)
[18:41:16.352] Build status: STARTED
[18:41:16.352] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:42:0) after 7m25s
[18:48:41.384] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:42:0)
[18:48:41.433] Build status: STARTED
[18:48:41.433] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:43:0) after 7m5s
[18:55:47.091] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:43:0)
[18:55:47.131] Build status: STARTED
[18:55:47.131] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:44:0) after 5m8s
[19:00:55.188] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:44:0)
[19:00:55.228] Build status: STARTED
[19:00:55.228] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:45:0) after 8m0s
[19:08:55.671] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:45:0)
[19:08:55.705] Build status: STARTED
[19:08:55.705] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:46:0) after 8m57s
[19:17:52.755] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:46:0)
[19:17:52.781] Build status: STARTED
[19:17:52.781] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:47:0) after 3m50s
[19:21:42.802] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:47:0)
[19:21:42.892] Build status: STARTED
[19:21:42.892] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:48:0) after 7m43s
[19:29:25.912] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:48:0)
[19:29:25.941] Build status: STARTED
[19:29:25.941] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:49:0) after 9m16s
[19:38:42.115] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:49:0)
[19:38:42.146] Build status: STARTED
[19:38:42.146] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:50:0) after 7m55s
[19:46:37.196] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:50:0)
[19:46:37.297] Build status: STARTED
[19:46:37.297] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:51:0) after 3m32s
[19:50:09.319] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:51:0)
[19:50:09.354] Build status: STARTED
[19:50:09.354] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:52:0) after 6m59s
[19:57:08.456] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:52:0)
[19:57:08.487] Build status: STARTED
[19:57:08.487] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:53:0) after 5m55s
[20:03:03.536] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:53:0)
[20:03:03.599] Build status: STARTED
[20:03:03.599] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:54:0) after 4m28s
[20:07:31.636] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:54:0)
[20:07:31.786] Build status: STARTED
[20:07:31.786] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:55:0) after 3m36s
[20:11:07.905] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:55:0)
[20:11:08.080] Build status: STARTED
[20:11:08.080] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001714824640759872:56:0) after 8m0s
[20:13:17.639] Received PubSub notification, asking Buildbucket for the build status
[20:13:17.672] Build:
{
"id": "8836284762759449553",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23082,
"createdBy": "project:chromium",
"createTime": "2021-09-12T15:06:31.512729789Z",
"startTime": "2021-09-12T15:08:55.060006Z",
"endTime": "2021-09-12T20:13:17.348384700Z",
"updateTime": "2021-09-12T20:13:17.348717471Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "248422165435b43fc81d745a71e6a5bd558564a5",
"ref": "refs/heads/main"
}
}
}
[20:13:17.672] Invocation finished in 5h6m47.338187754s with status FAILED