[21:02:16.294] New invocation is queued and will start shortly
[21:02:17.369] Starting the invocation (attempt 1)
[21:02:17.453] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/b5a47416db8084a64c7a199d859e02c3e4a92c2a"
[21:02:17.453] Popped gitiles commit info from properties and tags
[21:02:17.453] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[21:02:17.453] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[21:02:17.453] Buildbucket request:
{
"requestId": "9000967666066412400",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b5a47416db8084a64c7a199d859e02c3e4a92c2a",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9000967666066412400"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[21:02:17.977] Scheduled build:
{
"id": "8835537604113007441",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23221,
"createdBy": "project:chromium",
"createTime": "2021-09-20T21:02:17.523440862Z",
"updateTime": "2021-09-20T21:02:17.791253169Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b5a47416db8084a64c7a199d859e02c3e4a92c2a",
"ref": "refs/heads/main"
}
}
}
[21:02:17.977] Task URL: https://cr-buildbucket.appspot.com/build/8835537604113007441
[21:02:17.977] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:2:0) after 7m3s
[21:02:51.865] Received PubSub notification, asking Buildbucket for the build status
[21:02:51.899] Build status: STARTED
[21:09:21.481] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:2:0)
[21:09:21.507] Build status: STARTED
[21:09:21.508] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:4:0) after 1m5s
[21:10:26.640] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:4:0)
[21:10:26.679] Build status: STARTED
[21:10:26.679] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:5:0) after 4m51s
[21:15:17.927] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:5:0)
[21:15:17.958] Build status: STARTED
[21:15:17.958] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:6:0) after 2m55s
[21:18:13.113] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:6:0)
[21:18:13.148] Build status: STARTED
[21:18:13.148] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:7:0) after 7m0s
[21:25:13.385] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:7:0)
[21:25:13.414] Build status: STARTED
[21:25:13.414] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:8:0) after 4m17s
[21:29:30.514] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:8:0)
[21:29:30.543] Build status: STARTED
[21:29:30.543] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:9:0) after 4m24s
[21:33:54.665] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:9:0)
[21:33:54.703] Build status: STARTED
[21:33:54.703] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:10:0) after 1m58s
[21:35:52.826] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:10:0)
[21:35:52.901] Build status: STARTED
[21:35:52.901] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:11:0) after 7m47s
[21:43:39.970] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:11:0)
[21:43:40.006] Build status: STARTED
[21:43:40.006] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:12:0) after 6m36s
[21:50:16.437] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:12:0)
[21:50:16.472] Build status: STARTED
[21:50:16.472] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:13:0) after 1m37s
[21:51:53.453] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:13:0)
[21:51:53.484] Build status: STARTED
[21:51:53.484] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:14:0) after 3m31s
[21:55:24.541] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:14:0)
[21:55:24.576] Build status: STARTED
[21:55:24.576] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:15:0) after 8m9s
[22:03:33.654] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:15:0)
[22:03:33.689] Build status: STARTED
[22:03:33.689] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:16:0) after 6m34s
[22:10:07.712] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:16:0)
[22:10:07.793] Build status: STARTED
[22:10:07.793] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:17:0) after 8m4s
[22:18:12.063] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:17:0)
[22:18:12.133] Build status: STARTED
[22:18:12.133] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:18:0) after 4m27s
[22:22:39.320] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:18:0)
[22:22:39.486] Build status: STARTED
[22:22:39.486] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:19:0) after 4m28s
[22:27:07.720] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:19:0)
[22:27:07.749] Build status: STARTED
[22:27:07.749] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:20:0) after 6m37s
[22:33:44.771] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:20:0)
[22:33:44.910] Build status: STARTED
[22:33:44.910] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:21:0) after 3m8s
[22:36:52.942] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:21:0)
[22:36:52.980] Build status: STARTED
[22:36:52.980] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:22:0) after 5m54s
[22:42:47.026] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:22:0)
[22:42:47.055] Build status: STARTED
[22:42:47.055] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:23:0) after 8m53s
[22:51:40.295] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:23:0)
[22:51:40.396] Build status: STARTED
[22:51:40.396] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:24:0) after 5m34s
[22:57:14.454] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:24:0)
[22:57:14.488] Build status: STARTED
[22:57:14.488] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:25:0) after 6m28s
[23:03:42.509] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:25:0)
[23:03:42.555] Build status: STARTED
[23:03:42.555] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:26:0) after 4m43s
[23:08:25.744] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:26:0)
[23:08:25.781] Build status: STARTED
[23:08:25.781] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:27:0) after 6m52s
[23:15:17.800] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:27:0)
[23:15:17.844] Build status: STARTED
[23:15:17.844] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:28:0) after 4m41s
[23:19:58.860] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:28:0)
[23:19:58.906] Build status: STARTED
[23:19:58.906] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:29:0) after 8m6s
[23:28:04.906] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:29:0)
[23:28:04.936] Build status: STARTED
[23:28:04.936] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:30:0) after 9m32s
[23:37:37.054] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:30:0)
[23:37:37.085] Build status: STARTED
[23:37:37.085] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:31:0) after 1m18s
[23:38:55.075] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:31:0)
[23:38:55.108] Build status: STARTED
[23:38:55.108] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:32:0) after 1m50s
[23:40:45.299] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:32:0)
[23:40:45.335] Build status: STARTED
[23:40:45.335] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:33:0) after 9m35s
[23:50:20.397] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:33:0)
[23:50:20.457] Build status: STARTED
[23:50:20.457] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:34:0) after 2m46s
[23:53:06.475] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:34:0)
[23:53:06.527] Build status: STARTED
[23:53:06.527] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:35:0) after 1m39s
[23:54:45.642] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:35:0)
[23:54:45.676] Build status: STARTED
[23:54:45.676] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:36:0) after 3m19s
[23:58:04.801] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:36:0)
[23:58:04.832] Build status: STARTED
[23:58:04.832] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:37:0) after 6m28s
[00:04:32.834] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:37:0)
[00:04:32.879] Build status: STARTED
[00:04:32.879] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:38:0) after 6m52s
[00:11:25.226] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:38:0)
[00:11:25.258] Build status: STARTED
[00:11:25.258] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:39:0) after 4m4s
[00:15:29.289] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:39:0)
[00:15:29.322] Build status: STARTED
[00:15:29.322] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:40:0) after 8m10s
[00:23:39.383] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:40:0)
[00:23:39.412] Build status: STARTED
[00:23:39.412] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:41:0) after 5m25s
[00:29:04.760] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:41:0)
[00:29:04.792] Build status: STARTED
[00:29:04.792] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:42:0) after 9m1s
[00:38:06.037] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:42:0)
[00:38:06.084] Build status: STARTED
[00:38:06.084] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:43:0) after 7m20s
[00:45:26.171] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:43:0)
[00:45:26.209] Build status: STARTED
[00:45:26.209] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:44:0) after 8m21s
[00:53:47.232] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:44:0)
[00:53:47.282] Build status: STARTED
[00:53:47.282] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:45:0) after 6m49s
[01:00:36.311] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:45:0)
[01:00:36.364] Build status: STARTED
[01:00:36.364] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:46:0) after 5m32s
[01:06:08.609] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:46:0)
[01:06:08.651] Build status: STARTED
[01:06:08.651] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:47:0) after 2m48s
[01:08:56.676] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:47:0)
[01:08:56.702] Build status: STARTED
[01:08:56.702] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:48:0) after 3m49s
[01:12:45.725] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:48:0)
[01:12:45.760] Build status: STARTED
[01:12:45.761] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:49:0) after 3m1s
[01:15:46.912] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:49:0)
[01:15:46.943] Build status: STARTED
[01:15:46.943] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:50:0) after 8m11s
[01:23:58.155] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:50:0)
[01:23:58.194] Build status: STARTED
[01:23:58.194] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:51:0) after 1m38s
[01:25:36.232] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:51:0)
[01:25:36.319] Build status: STARTED
[01:25:36.319] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:52:0) after 3m16s
[01:28:52.463] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:52:0)
[01:28:52.503] Build status: STARTED
[01:28:52.503] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:53:0) after 1m7s
[01:29:59.613] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:53:0)
[01:29:59.643] Build status: STARTED
[01:29:59.643] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:54:0) after 7m5s
[01:37:04.809] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:54:0)
[01:37:04.839] Build status: STARTED
[01:37:04.839] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:55:0) after 1m23s
[01:38:27.956] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:55:0)
[01:38:27.996] Build status: STARTED
[01:38:27.996] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:56:0) after 3m8s
[01:41:36.128] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:56:0)
[01:41:36.158] Build status: STARTED
[01:41:36.158] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:57:0) after 8m12s
[01:49:48.184] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:57:0)
[01:49:48.214] Build status: STARTED
[01:49:48.214] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:58:0) after 4m8s
[01:53:56.232] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:58:0)
[01:53:56.275] Build status: STARTED
[01:53:56.275] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:59:0) after 8m58s
[02:02:54.397] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:59:0)
[02:02:54.613] Build status: STARTED
[02:02:54.613] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:60:0) after 5m12s
[02:08:06.731] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:60:0)
[02:08:06.775] Build status: STARTED
[02:08:06.775] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:61:0) after 1m35s
[02:09:41.876] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:61:0)
[02:09:41.912] Build status: STARTED
[02:09:41.912] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:62:0) after 1m20s
[02:11:01.930] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:62:0)
[02:11:01.961] Build status: STARTED
[02:11:01.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:63:0) after 1m32s
[02:12:33.986] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:63:0)
[02:12:34.056] Build status: STARTED
[02:12:34.056] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:64:0) after 3m54s
[02:16:28.333] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:64:0)
[02:16:28.363] Build status: STARTED
[02:16:28.363] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:65:0) after 9m55s
[02:26:23.388] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:65:0)
[02:26:23.425] Build status: STARTED
[02:26:23.425] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:66:0) after 6m38s
[02:33:01.451] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:66:0)
[02:33:01.491] Build status: STARTED
[02:33:01.491] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000967666066412400:67:0) after 7m49s
[02:36:32.949] Received PubSub notification, asking Buildbucket for the build status
[02:36:32.985] Build:
{
"id": "8835537604113007441",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23221,
"createdBy": "project:chromium",
"createTime": "2021-09-20T21:02:17.523440862Z",
"startTime": "2021-09-20T21:02:50.817622Z",
"endTime": "2021-09-21T02:36:32.396726994Z",
"updateTime": "2021-09-21T02:36:32.397083116Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b5a47416db8084a64c7a199d859e02c3e4a92c2a",
"ref": "refs/heads/main"
}
}
}
[02:36:32.985] Invocation finished in 5h34m16.707834999s with status FAILED