[01:52:06.293] New invocation is queued and will start shortly
[01:52:07.395] Starting the invocation (attempt 1)
[01:52:07.428] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/29702b8b93b0857cbb77d6193d2eb41f143613ab"
[01:52:07.428] Popped gitiles commit info from properties and tags
[01:52:07.428] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[01:52:07.428] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[01:52:07.428] Buildbucket request:
{
"requestId": "9004935697852580816",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "29702b8b93b0857cbb77d6193d2eb41f143613ab",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9004935697852580816"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[01:52:08.097] Scheduled build:
{
"id": "8839505635904390209",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22898,
"createdBy": "project:chromium",
"createTime": "2021-08-08T01:52:07.517628150Z",
"updateTime": "2021-08-08T01:52:07.817181881Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "29702b8b93b0857cbb77d6193d2eb41f143613ab",
"ref": "refs/heads/main"
}
}
}
[01:52:08.097] Task URL: https://cr-buildbucket.appspot.com/build/8839505635904390209
[01:52:08.097] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:2:0) after 5m13s
[01:54:45.786] Received PubSub notification, asking Buildbucket for the build status
[01:54:45.813] Build status: STARTED
[01:57:21.126] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:2:0)
[01:57:21.157] Build status: STARTED
[01:57:21.157] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:4:0) after 6m34s
[02:03:55.305] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:4:0)
[02:03:55.335] Build status: STARTED
[02:03:55.335] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:5:0) after 9m9s
[02:13:04.353] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:5:0)
[02:13:04.381] Build status: STARTED
[02:13:04.381] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:6:0) after 3m31s
[02:16:35.398] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:6:0)
[02:16:35.422] Build status: STARTED
[02:16:35.422] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:7:0) after 4m23s
[02:20:59.250] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:7:0)
[02:20:59.281] Build status: STARTED
[02:20:59.281] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:8:0) after 9m11s
[02:30:10.516] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:8:0)
[02:30:10.596] Build status: STARTED
[02:30:10.596] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:9:0) after 1m54s
[02:32:05.083] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:9:0)
[02:32:05.115] Build status: STARTED
[02:32:05.115] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:10:0) after 3m39s
[02:35:44.543] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:10:0)
[02:35:44.568] Build status: STARTED
[02:35:44.568] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:11:0) after 8m58s
[02:44:43.164] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:11:0)
[02:44:43.191] Build status: STARTED
[02:44:43.191] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:12:0) after 7m34s
[02:52:17.211] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:12:0)
[02:52:17.242] Build status: STARTED
[02:52:17.242] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:13:0) after 6m42s
[02:58:59.257] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:13:0)
[02:58:59.285] Build status: STARTED
[02:58:59.285] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:14:0) after 2m3s
[03:01:02.304] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:14:0)
[03:01:02.332] Build status: STARTED
[03:01:02.332] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:15:0) after 2m31s
[03:03:33.401] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:15:0)
[03:03:33.441] Build status: STARTED
[03:03:33.441] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:16:0) after 7m3s
[03:10:36.583] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:16:0)
[03:10:36.619] Build status: STARTED
[03:10:36.619] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:17:0) after 4m59s
[03:15:35.746] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:17:0)
[03:15:35.781] Build status: STARTED
[03:15:35.781] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:18:0) after 8m11s
[03:23:47.064] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:18:0)
[03:23:47.087] Build status: STARTED
[03:23:47.087] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:19:0) after 8m24s
[03:32:11.103] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:19:0)
[03:32:11.133] Build status: STARTED
[03:32:11.133] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:20:0) after 9m33s
[03:41:44.320] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:20:0)
[03:41:44.349] Build status: STARTED
[03:41:44.349] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:21:0) after 6m2s
[03:47:46.528] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:21:0)
[03:47:46.556] Build status: STARTED
[03:47:46.556] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:22:0) after 1m30s
[03:49:16.838] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:22:0)
[03:49:16.878] Build status: STARTED
[03:49:16.878] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:23:0) after 1m27s
[03:50:44.400] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:23:0)
[03:50:44.433] Build status: STARTED
[03:50:44.433] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:24:0) after 8m18s
[03:59:02.719] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:24:0)
[03:59:02.772] Build status: STARTED
[03:59:02.772] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:25:0) after 1m20s
[04:00:22.823] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:25:0)
[04:00:22.861] Build status: STARTED
[04:00:22.861] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:26:0) after 1m59s
[04:02:22.648] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:26:0)
[04:02:22.678] Build status: STARTED
[04:02:22.678] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:27:0) after 5m59s
[04:08:21.705] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:27:0)
[04:08:21.743] Build status: STARTED
[04:08:21.743] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:28:0) after 9m49s
[04:18:10.761] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:28:0)
[04:18:10.808] Build status: STARTED
[04:18:10.808] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:29:0) after 2m52s
[04:21:03.571] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:29:0)
[04:21:03.599] Build status: STARTED
[04:21:03.599] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:30:0) after 9m19s
[04:30:22.819] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:30:0)
[04:30:22.844] Build status: STARTED
[04:30:22.844] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:31:0) after 9m47s
[04:40:10.309] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:31:0)
[04:40:10.340] Build status: STARTED
[04:40:10.340] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:32:0) after 1m31s
[04:41:41.580] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:32:0)
[04:41:41.615] Build status: STARTED
[04:41:41.615] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:33:0) after 1m33s
[04:43:15.049] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:33:0)
[04:43:15.088] Build status: STARTED
[04:43:15.088] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:34:0) after 3m48s
[04:47:03.107] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:34:0)
[04:47:03.137] Build status: STARTED
[04:47:03.137] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:35:0) after 6m30s
[04:53:33.162] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:35:0)
[04:53:33.195] Build status: STARTED
[04:53:33.195] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:36:0) after 3m22s
[04:56:55.777] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:36:0)
[04:56:55.808] Build status: STARTED
[04:56:55.808] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:37:0) after 7m35s
[05:04:30.830] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:37:0)
[05:04:30.864] Build status: STARTED
[05:04:30.864] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:38:0) after 8m19s
[05:12:50.047] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:38:0)
[05:12:50.078] Build status: STARTED
[05:12:50.078] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:39:0) after 2m46s
[05:15:36.096] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:39:0)
[05:15:36.141] Build status: STARTED
[05:15:36.141] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:40:0) after 6m21s
[05:21:57.160] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:40:0)
[05:21:57.194] Build status: STARTED
[05:21:57.194] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:41:0) after 1m41s
[05:23:38.366] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:41:0)
[05:23:38.393] Build status: STARTED
[05:23:38.393] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:42:0) after 4m5s
[05:27:43.464] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:42:0)
[05:27:43.489] Build status: STARTED
[05:27:43.489] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:43:0) after 2m9s
[05:29:52.897] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:43:0)
[05:29:52.927] Build status: STARTED
[05:29:52.927] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:44:0) after 2m48s
[05:32:40.945] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:44:0)
[05:32:40.984] Build status: STARTED
[05:32:40.984] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:45:0) after 7m20s
[05:40:01.192] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:45:0)
[05:40:01.224] Build status: STARTED
[05:40:01.224] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:46:0) after 8m29s
[05:48:30.257] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:46:0)
[05:48:30.290] Build status: STARTED
[05:48:30.290] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:47:0) after 7m55s
[05:56:25.309] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:47:0)
[05:56:25.342] Build status: STARTED
[05:56:25.342] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:48:0) after 3m39s
[06:00:04.373] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:48:0)
[06:00:04.409] Build status: STARTED
[06:00:04.409] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:49:0) after 6m52s
[06:06:56.502] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:49:0)
[06:06:56.541] Build status: STARTED
[06:06:56.541] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:50:0) after 6m5s
[06:13:01.564] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:50:0)
[06:13:01.588] Build status: STARTED
[06:13:01.588] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:51:0) after 8m48s
[06:21:49.658] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:51:0)
[06:21:49.688] Build status: STARTED
[06:21:49.688] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:52:0) after 1m14s
[06:23:03.708] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:52:0)
[06:23:03.742] Build status: STARTED
[06:23:03.742] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:53:0) after 5m46s
[06:28:50.016] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:53:0)
[06:28:50.046] Build status: STARTED
[06:28:50.046] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:54:0) after 2m14s
[06:31:04.153] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:54:0)
[06:31:04.187] Build status: STARTED
[06:31:04.187] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:55:0) after 3m35s
[06:34:39.608] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:55:0)
[06:34:39.639] Build status: STARTED
[06:34:39.639] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:56:0) after 3m16s
[06:37:55.656] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:56:0)
[06:37:55.685] Build status: STARTED
[06:37:55.685] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:57:0) after 4m31s
[06:42:26.920] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:57:0)
[06:42:26.991] Build status: STARTED
[06:42:26.991] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:58:0) after 1m4s
[06:43:31.014] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:58:0)
[06:43:31.060] Build status: STARTED
[06:43:31.060] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:59:0) after 4m39s
[06:48:10.287] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:59:0)
[06:48:10.325] Build status: STARTED
[06:48:10.325] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:60:0) after 8m41s
[06:56:51.702] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:60:0)
[06:56:51.732] Build status: STARTED
[06:56:51.732] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:61:0) after 4m43s
[07:01:34.758] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:61:0)
[07:01:34.787] Build status: STARTED
[07:01:34.787] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004935697852580816:62:0) after 9m39s
[07:01:43.315] Received PubSub notification, asking Buildbucket for the build status
[07:01:43.348] Build:
{
"id": "8839505635904390209",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22898,
"createdBy": "project:chromium",
"createTime": "2021-08-08T01:52:07.517628150Z",
"startTime": "2021-08-08T01:54:45.126268Z",
"endTime": "2021-08-08T07:01:42.889523659Z",
"updateTime": "2021-08-08T07:01:42.889875533Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "29702b8b93b0857cbb77d6193d2eb41f143613ab",
"ref": "refs/heads/main"
}
}
}
[07:01:43.348] Invocation finished in 5h9m37.071907669s with status FAILED