[10:13:16.166] New invocation is queued and will start shortly
[10:13:17.239] Starting the invocation (attempt 1)
[10:13:17.271] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/e1916f66147471f03c7188d9ddffc624a2bf1ff5"
[10:13:17.272] Popped gitiles commit info from properties and tags
[10:13:17.272] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[10:13:17.272] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[10:13:17.272] Buildbucket request:
{
"requestId": "8955166432741312592",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e1916f66147471f03c7188d9ddffc624a2bf1ff5",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8955166432741312592"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[10:13:17.751] Scheduled build:
{
"id": "8789736370797788145",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 28919,
"createdBy": "project:chromium",
"createTime": "2023-02-08T10:13:17.396114273Z",
"updateTime": "2023-02-08T10:13:17.396114273Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e1916f66147471f03c7188d9ddffc624a2bf1ff5",
"ref": "refs/heads/main"
}
}
}
[10:13:17.751] Task URL: https://cr-buildbucket.appspot.com/build/8789736370797788145
[10:13:17.751] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:2:0) after 3m8s
[10:15:46.897] Received PubSub notification, asking Buildbucket for the build status
[10:15:46.917] Build status: STARTED
[10:16:25.930] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:2:0)
[10:16:25.954] Build status: STARTED
[10:16:25.954] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:4:0) after 7m2s
[10:23:28.170] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:4:0)
[10:23:28.216] Build status: STARTED
[10:23:28.216] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:5:0) after 8m8s
[10:31:36.666] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:5:0)
[10:31:36.686] Build status: STARTED
[10:31:36.686] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:6:0) after 4m32s
[10:36:08.705] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:6:0)
[10:36:08.724] Build status: STARTED
[10:36:08.724] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:7:0) after 8m4s
[10:44:12.742] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:7:0)
[10:44:12.765] Build status: STARTED
[10:44:12.765] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:8:0) after 5m18s
[10:49:30.889] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:8:0)
[10:49:30.927] Build status: STARTED
[10:49:30.927] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:9:0) after 3m59s
[10:53:29.944] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:9:0)
[10:53:29.966] Build status: STARTED
[10:53:29.966] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:10:0) after 3m33s
[10:57:03.153] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:10:0)
[10:57:03.188] Build status: STARTED
[10:57:03.188] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:11:0) after 4m22s
[11:01:25.265] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:11:0)
[11:01:25.288] Build status: STARTED
[11:01:25.288] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:12:0) after 6m7s
[11:07:32.318] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:12:0)
[11:07:32.335] Build status: STARTED
[11:07:32.335] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:13:0) after 2m33s
[11:10:05.547] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:13:0)
[11:10:05.568] Build status: STARTED
[11:10:05.569] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:14:0) after 9m0s
[11:19:05.592] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:14:0)
[11:19:05.611] Build status: STARTED
[11:19:05.611] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:15:0) after 8m20s
[11:27:25.734] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:15:0)
[11:27:25.756] Build status: STARTED
[11:27:25.756] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:16:0) after 4m29s
[11:31:54.773] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:16:0)
[11:31:54.794] Build status: STARTED
[11:31:54.794] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:17:0) after 5m4s
[11:36:58.821] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:17:0)
[11:36:58.843] Build status: STARTED
[11:36:58.843] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:18:0) after 4m15s
[11:41:13.874] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:18:0)
[11:41:13.914] Build status: STARTED
[11:41:13.914] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:19:0) after 9m11s
[11:50:25.036] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:19:0)
[11:50:25.065] Build status: STARTED
[11:50:25.065] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:20:0) after 3m4s
[11:53:29.089] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:20:0)
[11:53:29.111] Build status: STARTED
[11:53:29.111] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:21:0) after 7m53s
[12:01:22.376] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:21:0)
[12:01:22.401] Build status: STARTED
[12:01:22.401] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:22:0) after 3m12s
[12:04:34.569] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:22:0)
[12:04:34.591] Build status: STARTED
[12:04:34.591] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:23:0) after 9m38s
[12:14:12.608] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:23:0)
[12:14:12.629] Build status: STARTED
[12:14:12.629] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:24:0) after 5m34s
[12:19:46.657] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:24:0)
[12:19:46.686] Build status: STARTED
[12:19:46.686] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:25:0) after 7m6s
[12:26:53.127] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:25:0)
[12:26:53.149] Build status: STARTED
[12:26:53.149] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:26:0) after 9m11s
[12:36:04.165] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:26:0)
[12:36:04.184] Build status: STARTED
[12:36:04.184] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:27:0) after 7m17s
[12:43:21.205] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:27:0)
[12:43:21.226] Build status: STARTED
[12:43:21.226] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:28:0) after 9m42s
[12:53:03.243] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:28:0)
[12:53:03.264] Build status: STARTED
[12:53:03.264] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:29:0) after 7m21s
[13:00:24.328] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:29:0)
[13:00:24.350] Build status: STARTED
[13:00:24.350] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:30:0) after 7m33s
[13:07:57.368] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:30:0)
[13:07:57.501] Build status: STARTED
[13:07:57.501] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:31:0) after 9m0s
[13:16:57.521] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:31:0)
[13:16:57.593] Build status: STARTED
[13:16:57.593] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:32:0) after 6m35s
[13:23:32.610] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:32:0)
[13:23:32.665] Build status: STARTED
[13:23:32.665] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:33:0) after 3m2s
[13:26:35.200] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:33:0)
[13:26:35.226] Build status: STARTED
[13:26:35.226] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:34:0) after 4m42s
[13:31:17.325] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:34:0)
[13:31:17.353] Build status: STARTED
[13:31:17.353] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:35:0) after 2m37s
[13:33:54.378] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:35:0)
[13:33:54.399] Build status: STARTED
[13:33:54.399] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:36:0) after 8m42s
[13:42:36.480] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:36:0)
[13:42:36.552] Build status: STARTED
[13:42:36.552] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:37:0) after 5m4s
[13:47:40.700] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:37:0)
[13:47:40.721] Build status: STARTED
[13:47:40.721] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:38:0) after 5m33s
[13:53:14.120] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:38:0)
[13:53:14.139] Build status: STARTED
[13:53:14.139] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:39:0) after 6m22s
[13:59:36.157] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:39:0)
[13:59:36.180] Build status: STARTED
[13:59:36.180] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:40:0) after 3m46s
[14:03:22.301] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:40:0)
[14:03:22.322] Build status: STARTED
[14:03:22.322] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:41:0) after 6m5s
[14:09:27.541] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:41:0)
[14:09:27.559] Build status: STARTED
[14:09:27.559] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:42:0) after 4m57s
[14:14:24.806] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:42:0)
[14:14:24.844] Build status: STARTED
[14:14:24.844] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:43:0) after 6m54s
[14:21:18.869] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:43:0)
[14:21:18.889] Build status: STARTED
[14:21:18.889] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:44:0) after 3m11s
[14:24:29.993] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:44:0)
[14:24:30.015] Build status: STARTED
[14:24:30.015] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:45:0) after 7m36s
[14:32:06.035] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:45:0)
[14:32:06.108] Build status: STARTED
[14:32:06.108] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:46:0) after 6m33s
[14:38:39.216] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:46:0)
[14:38:39.237] Build status: STARTED
[14:38:39.237] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:47:0) after 5m58s
[14:44:37.541] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:47:0)
[14:44:37.568] Build status: STARTED
[14:44:37.568] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:48:0) after 3m8s
[14:47:45.775] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:48:0)
[14:47:45.801] Build status: STARTED
[14:47:45.802] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:49:0) after 5m12s
[14:52:57.984] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:49:0)
[14:52:58.007] Build status: STARTED
[14:52:58.007] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:50:0) after 9m56s
[15:02:54.026] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:50:0)
[15:02:54.048] Build status: STARTED
[15:02:54.048] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:51:0) after 9m13s
[15:12:07.157] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:51:0)
[15:12:07.178] Build status: STARTED
[15:12:07.178] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:52:0) after 3m55s
[15:16:02.326] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:52:0)
[15:16:02.348] Build status: STARTED
[15:16:02.348] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:53:0) after 1m15s
[15:17:17.331] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:53:0)
[15:17:17.401] Build status: STARTED
[15:17:17.401] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:54:0) after 1m38s
[15:18:55.520] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:54:0)
[15:18:55.549] Build status: STARTED
[15:18:55.549] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:55:0) after 1m4s
[15:19:59.748] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:55:0)
[15:19:59.857] Build status: STARTED
[15:19:59.857] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955166432741312592:56:0) after 8m0s
[15:24:37.785] Received PubSub notification, asking Buildbucket for the build status
[15:24:37.895] Build:
{
"id": "8789736370797788145",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 28919,
"createdBy": "project:chromium",
"createTime": "2023-02-08T10:13:17.396114273Z",
"startTime": "2023-02-08T10:15:46.376532Z",
"endTime": "2023-02-08T15:24:37.362108291Z",
"updateTime": "2023-02-08T15:24:37.362108291Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e1916f66147471f03c7188d9ddffc624a2bf1ff5",
"ref": "refs/heads/main"
}
}
}
[15:24:37.895] Invocation finished in 5h11m21.736553109s with status FAILED