[18:39:54.082] New invocation is queued and will start shortly
[18:39:55.156] Starting the invocation (attempt 1)
[18:39:55.184] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/bee3e3805796ccbd37b80e6aa4615cc3ec6a6eda"
[18:39:55.184] Popped gitiles commit info from properties and tags
[18:39:55.184] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[18:39:55.184] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[18:39:55.185] Buildbucket request:
{
"requestId": "8952416649230494816",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "bee3e3805796ccbd37b80e6aa4615cc3ec6a6eda",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8952416649230494816"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[18:39:55.674] Scheduled build:
{
"id": "8786986587265704865",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29056,
"createdBy": "project:chromium",
"createTime": "2023-03-10T18:39:55.326667862Z",
"updateTime": "2023-03-10T18:39:55.326667862Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "bee3e3805796ccbd37b80e6aa4615cc3ec6a6eda",
"ref": "refs/heads/main"
}
},
"canary": true
}
[18:39:55.674] Task URL: https://cr-buildbucket.appspot.com/build/8786986587265704865
[18:39:55.674] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:2:0) after 2m24s
[18:42:17.130] Received PubSub notification, asking Buildbucket for the build status
[18:42:17.164] Build status: STARTED
[18:42:19.697] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:2:0)
[18:42:19.749] Build status: STARTED
[18:42:19.749] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:4:0) after 9m43s
[18:52:02.739] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:4:0)
[18:52:02.776] Build status: STARTED
[18:52:02.776] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:5:0) after 6m9s
[18:58:11.810] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:5:0)
[18:58:11.884] Build status: STARTED
[18:58:11.884] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:6:0) after 5m35s
[19:03:46.906] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:6:0)
[19:03:46.967] Build status: STARTED
[19:03:46.967] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:7:0) after 3m43s
[19:07:30.128] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:7:0)
[19:07:30.149] Build status: STARTED
[19:07:30.149] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:8:0) after 9m29s
[19:16:59.170] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:8:0)
[19:16:59.250] Build status: STARTED
[19:16:59.250] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:9:0) after 7m53s
[19:24:52.558] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:9:0)
[19:24:52.582] Build status: STARTED
[19:24:52.582] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:10:0) after 9m13s
[19:34:05.663] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:10:0)
[19:34:05.684] Build status: STARTED
[19:34:05.684] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:11:0) after 2m36s
[19:36:41.808] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:11:0)
[19:36:41.835] Build status: STARTED
[19:36:41.835] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:12:0) after 5m2s
[19:41:44.109] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:12:0)
[19:41:44.128] Build status: STARTED
[19:41:44.128] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:13:0) after 8m17s
[19:50:01.186] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:13:0)
[19:50:01.222] Build status: STARTED
[19:50:01.222] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:14:0) after 7m22s
[19:57:23.292] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:14:0)
[19:57:23.318] Build status: STARTED
[19:57:23.318] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:15:0) after 9m31s
[20:06:54.442] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:15:0)
[20:06:54.530] Build status: STARTED
[20:06:54.530] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:16:0) after 4m31s
[20:11:25.642] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:16:0)
[20:11:25.664] Build status: STARTED
[20:11:25.664] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:17:0) after 2m21s
[20:13:46.680] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:17:0)
[20:13:46.707] Build status: STARTED
[20:13:46.707] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:18:0) after 8m47s
[20:22:33.750] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:18:0)
[20:22:33.770] Build status: STARTED
[20:22:33.770] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:19:0) after 3m59s
[20:26:33.065] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:19:0)
[20:26:33.087] Build status: STARTED
[20:26:33.087] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:20:0) after 6m59s
[20:33:32.384] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:20:0)
[20:33:32.444] Build status: STARTED
[20:33:32.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:21:0) after 5m22s
[20:38:54.468] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:21:0)
[20:38:54.582] Build status: STARTED
[20:38:54.582] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:22:0) after 1m3s
[20:39:57.709] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:22:0)
[20:39:57.804] Build status: STARTED
[20:39:57.805] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:23:0) after 9m8s
[20:49:05.857] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:23:0)
[20:49:05.877] Build status: STARTED
[20:49:05.877] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:24:0) after 1m57s
[20:51:03.082] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:24:0)
[20:51:03.103] Build status: STARTED
[20:51:03.103] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:25:0) after 1m36s
[20:52:39.504] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:25:0)
[20:52:39.528] Build status: STARTED
[20:52:39.528] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:26:0) after 9m40s
[21:02:19.601] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:26:0)
[21:02:19.627] Build status: STARTED
[21:02:19.627] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:27:0) after 4m25s
[21:06:45.039] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:27:0)
[21:06:45.064] Build status: STARTED
[21:06:45.064] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:28:0) after 7m7s
[21:13:52.244] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:28:0)
[21:13:52.339] Build status: STARTED
[21:13:52.340] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:29:0) after 6m24s
[21:20:16.416] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:29:0)
[21:20:16.438] Build status: STARTED
[21:20:16.438] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:30:0) after 5m10s
[21:25:26.833] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:30:0)
[21:25:26.872] Build status: STARTED
[21:25:26.872] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:31:0) after 9m1s
[21:34:27.894] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:31:0)
[21:34:27.939] Build status: STARTED
[21:34:27.939] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:32:0) after 5m33s
[21:40:00.977] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:32:0)
[21:40:01.023] Build status: STARTED
[21:40:01.023] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:33:0) after 8m7s
[21:48:08.156] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:33:0)
[21:48:08.174] Build status: STARTED
[21:48:08.175] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:34:0) after 1m34s
[21:49:42.204] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:34:0)
[21:49:42.230] Build status: STARTED
[21:49:42.230] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:35:0) after 1m39s
[21:51:21.297] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:35:0)
[21:51:21.316] Build status: STARTED
[21:51:21.316] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:36:0) after 4m21s
[21:55:42.415] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:36:0)
[21:55:42.441] Build status: STARTED
[21:55:42.441] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:37:0) after 2m47s
[21:58:29.711] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:37:0)
[21:58:29.733] Build status: STARTED
[21:58:29.733] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:38:0) after 8m27s
[22:06:57.060] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:38:0)
[22:06:57.093] Build status: STARTED
[22:06:57.093] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:39:0) after 8m7s
[22:15:04.114] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:39:0)
[22:15:04.147] Build status: STARTED
[22:15:04.147] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:40:0) after 4m5s
[22:19:09.267] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:40:0)
[22:19:09.291] Build status: STARTED
[22:19:09.291] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:41:0) after 4m39s
[22:23:48.388] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:41:0)
[22:23:48.433] Build status: STARTED
[22:23:48.433] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:42:0) after 4m31s
[22:28:19.746] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:42:0)
[22:28:19.770] Build status: STARTED
[22:28:19.770] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:43:0) after 7m40s
[22:35:59.876] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:43:0)
[22:35:59.904] Build status: STARTED
[22:35:59.904] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:44:0) after 9m9s
[22:45:09.075] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:44:0)
[22:45:09.092] Build status: STARTED
[22:45:09.092] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:45:0) after 8m34s
[22:53:43.412] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:45:0)
[22:53:43.433] Build status: STARTED
[22:53:43.433] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:46:0) after 5m10s
[22:58:53.542] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:46:0)
[22:58:53.661] Build status: STARTED
[22:58:53.661] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:47:0) after 9m58s
[23:08:52.133] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:47:0)
[23:08:52.155] Build status: STARTED
[23:08:52.155] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:48:0) after 5m57s
[23:14:49.354] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:48:0)
[23:14:49.378] Build status: STARTED
[23:14:49.378] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:49:0) after 8m34s
[23:23:23.577] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:49:0)
[23:23:23.599] Build status: STARTED
[23:23:23.599] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:50:0) after 7m49s
[23:31:12.678] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:50:0)
[23:31:12.704] Build status: STARTED
[23:31:12.704] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:51:0) after 4m36s
[23:35:49.088] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:51:0)
[23:35:49.107] Build status: STARTED
[23:35:49.107] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:52:0) after 5m16s
[23:41:05.255] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:52:0)
[23:41:05.274] Build status: STARTED
[23:41:05.274] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:53:0) after 7m54s
[23:48:59.295] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:53:0)
[23:48:59.317] Build status: STARTED
[23:48:59.317] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952416649230494816:54:0) after 7m14s
[23:52:14.551] Received PubSub notification, asking Buildbucket for the build status
[23:52:14.569] Build:
{
"id": "8786986587265704865",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29056,
"createdBy": "project:chromium",
"createTime": "2023-03-10T18:39:55.326667862Z",
"startTime": "2023-03-10T18:42:16.408751Z",
"endTime": "2023-03-10T23:52:14.289165657Z",
"updateTime": "2023-03-10T23:52:14.289165657Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "bee3e3805796ccbd37b80e6aa4615cc3ec6a6eda",
"ref": "refs/heads/main"
}
},
"canary": true
}
[23:52:14.569] Invocation finished in 5h12m20.500164955s with status FAILED