[15:29:12.223] New invocation is queued and will start shortly
[15:29:13.419] Starting the invocation (attempt 1)
[15:29:13.454] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/0d04aab7e505f807737e131f032fe2d7c632dbc2"
[15:29:13.454] Popped gitiles commit info from properties and tags
[15:29:13.454] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[15:29:13.454] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[15:29:13.454] Buildbucket request:
{
"requestId": "8997183548291775424",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0d04aab7e505f807737e131f032fe2d7c632dbc2",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8997183548291775424"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[15:29:14.029] Scheduled build:
{
"id": "8831753486240505489",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23494,
"createdBy": "project:chromium",
"createTime": "2021-11-01T15:29:13.549349330Z",
"updateTime": "2021-11-01T15:29:13.549349330Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0d04aab7e505f807737e131f032fe2d7c632dbc2",
"ref": "refs/heads/main"
}
}
}
[15:29:14.029] Task URL: https://cr-buildbucket.appspot.com/build/8831753486240505489
[15:29:14.029] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:2:0) after 4m35s
[15:31:40.644] Received PubSub notification, asking Buildbucket for the build status
[15:31:40.689] Build status: STARTED
[15:33:49.110] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:2:0)
[15:33:49.143] Build status: STARTED
[15:33:49.143] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:4:0) after 2m34s
[15:36:23.247] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:4:0)
[15:36:23.277] Build status: STARTED
[15:36:23.277] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:5:0) after 3m11s
[15:39:34.403] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:5:0)
[15:39:34.434] Build status: STARTED
[15:39:34.434] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:6:0) after 2m4s
[15:41:38.451] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:6:0)
[15:41:38.481] Build status: STARTED
[15:41:38.481] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:7:0) after 2m6s
[15:43:44.669] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:7:0)
[15:43:44.767] Build status: STARTED
[15:43:44.767] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:8:0) after 5m0s
[15:48:45.002] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:8:0)
[15:48:45.040] Build status: STARTED
[15:48:45.040] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:9:0) after 6m11s
[15:54:56.360] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:9:0)
[15:54:56.393] Build status: STARTED
[15:54:56.393] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:10:0) after 6m33s
[16:01:29.404] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:10:0)
[16:01:29.480] Build status: STARTED
[16:01:29.480] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:11:0) after 3m5s
[16:04:34.501] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:11:0)
[16:04:34.531] Build status: STARTED
[16:04:34.531] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:12:0) after 4m17s
[16:08:51.512] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:12:0)
[16:08:51.551] Build status: STARTED
[16:08:51.551] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:13:0) after 1m58s
[16:10:49.919] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:13:0)
[16:10:49.950] Build status: STARTED
[16:10:49.950] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:14:0) after 3m41s
[16:14:30.994] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:14:0)
[16:14:31.067] Build status: STARTED
[16:14:31.067] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:15:0) after 3m35s
[16:18:06.277] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:15:0)
[16:18:06.309] Build status: STARTED
[16:18:06.309] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:16:0) after 9m30s
[16:27:36.312] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:16:0)
[16:27:36.339] Build status: STARTED
[16:27:36.339] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:17:0) after 6m7s
[16:33:43.506] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:17:0)
[16:33:43.671] Build status: STARTED
[16:33:43.671] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:18:0) after 4m32s
[16:38:16.117] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:18:0)
[16:38:16.158] Build status: STARTED
[16:38:16.158] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:19:0) after 4m17s
[16:42:33.182] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:19:0)
[16:42:33.213] Build status: STARTED
[16:42:33.213] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:20:0) after 6m56s
[16:49:29.347] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:20:0)
[16:49:29.381] Build status: STARTED
[16:49:29.382] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:21:0) after 2m48s
[16:52:17.964] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:21:0)
[16:52:18.001] Build status: STARTED
[16:52:18.001] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:22:0) after 6m21s
[16:58:39.052] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:22:0)
[16:58:39.087] Build status: STARTED
[16:58:39.087] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:23:0) after 7m54s
[17:06:33.112] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:23:0)
[17:06:33.140] Build status: STARTED
[17:06:33.140] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:24:0) after 3m24s
[17:09:57.313] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:24:0)
[17:09:57.348] Build status: STARTED
[17:09:57.348] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:25:0) after 3m36s
[17:13:33.375] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:25:0)
[17:13:33.404] Build status: STARTED
[17:13:33.404] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:26:0) after 3m57s
[17:17:30.436] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:26:0)
[17:17:30.480] Build status: STARTED
[17:17:30.480] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:27:0) after 1m39s
[17:19:09.680] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:27:0)
[17:19:09.708] Build status: STARTED
[17:19:09.708] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:28:0) after 5m1s
[17:24:10.904] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:28:0)
[17:24:10.932] Build status: STARTED
[17:24:10.932] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:29:0) after 2m58s
[17:27:09.092] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:29:0)
[17:27:09.117] Build status: STARTED
[17:27:09.117] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:30:0) after 9m5s
[17:36:14.143] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:30:0)
[17:36:14.169] Build status: STARTED
[17:36:14.169] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:31:0) after 9m43s
[17:45:57.456] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:31:0)
[17:45:57.485] Build status: STARTED
[17:45:57.485] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:32:0) after 4m42s
[17:50:39.603] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:32:0)
[17:50:39.639] Build status: STARTED
[17:50:39.639] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:33:0) after 4m20s
[17:54:59.951] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:33:0)
[17:54:59.978] Build status: STARTED
[17:54:59.978] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:34:0) after 5m7s
[18:00:07.154] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:34:0)
[18:00:07.185] Build status: STARTED
[18:00:07.185] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:35:0) after 3m43s
[18:03:50.232] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:35:0)
[18:03:50.267] Build status: STARTED
[18:03:50.267] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:36:0) after 2m25s
[18:06:15.412] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:36:0)
[18:06:15.456] Build status: STARTED
[18:06:15.456] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:37:0) after 3m9s
[18:09:24.547] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:37:0)
[18:09:24.581] Build status: STARTED
[18:09:24.581] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:38:0) after 3m59s
[18:13:23.613] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:38:0)
[18:13:23.800] Build status: STARTED
[18:13:23.800] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:39:0) after 4m58s
[18:18:21.865] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:39:0)
[18:18:21.914] Build status: STARTED
[18:18:21.914] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:40:0) after 1m28s
[18:19:50.023] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:40:0)
[18:19:50.104] Build status: STARTED
[18:19:50.104] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:41:0) after 6m31s
[18:26:21.140] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:41:0)
[18:26:21.169] Build status: STARTED
[18:26:21.169] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:42:0) after 1m53s
[18:28:14.224] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:42:0)
[18:28:14.280] Build status: STARTED
[18:28:14.280] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:43:0) after 5m32s
[18:33:46.304] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:43:0)
[18:33:56.004] Build status: STARTED
[18:33:56.004] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:44:0) after 9m58s
[18:43:54.113] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:44:0)
[18:43:54.147] Build status: STARTED
[18:43:54.147] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:45:0) after 7m26s
[18:51:20.136] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:45:0)
[18:51:20.167] Build status: STARTED
[18:51:20.167] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:46:0) after 3m5s
[18:54:25.185] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:46:0)
[18:54:25.214] Build status: STARTED
[18:54:25.214] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:47:0) after 8m23s
[19:02:48.399] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:47:0)
[19:02:48.584] Build status: STARTED
[19:02:48.584] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:48:0) after 9m59s
[19:12:47.781] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:48:0)
[19:12:47.813] Build status: STARTED
[19:12:47.813] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:49:0) after 9m37s
[19:22:24.852] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:49:0)
[19:22:24.896] Build status: STARTED
[19:22:24.896] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:50:0) after 1m1s
[19:23:25.918] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:50:0)
[19:23:25.950] Build status: STARTED
[19:23:25.950] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:51:0) after 3m20s
[19:26:45.976] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:51:0)
[19:26:46.011] Build status: STARTED
[19:26:46.011] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:52:0) after 1m6s
[19:27:52.315] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:52:0)
[19:27:52.392] Build status: STARTED
[19:27:52.392] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:53:0) after 9m21s
[19:37:13.503] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:53:0)
[19:37:13.536] Build status: STARTED
[19:37:13.536] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:54:0) after 4m31s
[19:41:44.771] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:54:0)
[19:41:44.806] Build status: STARTED
[19:41:44.806] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:55:0) after 6m23s
[19:48:07.831] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:55:0)
[19:48:07.909] Build status: STARTED
[19:48:07.909] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:56:0) after 6m34s
[19:54:41.928] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:56:0)
[19:54:41.957] Build status: STARTED
[19:54:41.957] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:57:0) after 7m42s
[20:02:24.078] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:57:0)
[20:02:24.110] Build status: STARTED
[20:02:24.110] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:58:0) after 5m52s
[20:08:16.129] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:58:0)
[20:08:16.172] Build status: STARTED
[20:08:16.172] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:59:0) after 9m52s
[20:18:08.408] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:59:0)
[20:18:08.447] Build status: STARTED
[20:18:08.447] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:60:0) after 4m10s
[20:22:18.627] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:60:0)
[20:22:18.669] Build status: STARTED
[20:22:18.669] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:61:0) after 9m59s
[20:32:17.695] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:61:0)
[20:32:17.724] Build status: STARTED
[20:32:17.724] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:62:0) after 9m49s
[20:42:06.848] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:62:0)
[20:42:06.884] Build status: STARTED
[20:42:06.884] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:63:0) after 7m53s
[20:49:59.906] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:63:0)
[20:49:59.940] Build status: STARTED
[20:49:59.940] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997183548291775424:64:0) after 7m27s
[20:52:50.346] Received PubSub notification, asking Buildbucket for the build status
[20:52:50.373] Build:
{
"id": "8831753486240505489",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23494,
"createdBy": "project:chromium",
"createTime": "2021-11-01T15:29:13.549349330Z",
"startTime": "2021-11-01T15:31:40.195243Z",
"endTime": "2021-11-01T20:52:49.812227371Z",
"updateTime": "2021-11-01T20:52:49.812227371Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0d04aab7e505f807737e131f032fe2d7c632dbc2",
"ref": "refs/heads/main"
}
}
}
[20:52:50.373] Invocation finished in 5h23m38.16466947s with status FAILED