[09:16:02.072] New invocation is queued and will start shortly
[09:16:03.141] Starting the invocation (attempt 1)
[09:16:03.173] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/fb8c37e707328796fd89143b09365711bf7ffd71"
[09:16:03.173] Popped gitiles commit info from properties and tags
[09:16:03.173] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[09:16:03.174] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[09:16:03.174] Buildbucket request:
{
"requestId": "8936960043403490176",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fb8c37e707328796fd89143b09365711bf7ffd71",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8936960043403490176"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[09:16:03.763] Scheduled build:
{
"id": "8771529981528489745",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 30201,
"createdBy": "project:chromium",
"createTime": "2023-08-28T09:16:03.236392656Z",
"updateTime": "2023-08-28T09:16:03.236392656Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fb8c37e707328796fd89143b09365711bf7ffd71",
"ref": "refs/heads/main"
}
}
}
[09:16:03.763] Task URL: https://cr-buildbucket.appspot.com/build/8771529981528489745
[09:16:03.763] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:2:0) after 2m14s
[09:16:04.807] Received PubSub notification, asking Buildbucket for the build status
[09:16:04.826] Build status: SCHEDULED
[09:18:17.781] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:2:0)
[09:18:17.796] Build status: SCHEDULED
[09:18:17.796] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:4:0) after 5m24s
[09:19:35.162] Received PubSub notification, asking Buildbucket for the build status
[09:19:35.190] Build status: STARTED
[09:23:41.821] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:4:0)
[09:23:41.838] Build status: STARTED
[09:23:41.838] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:6:0) after 6m57s
[09:30:38.948] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:6:0)
[09:30:38.965] Build status: STARTED
[09:30:38.965] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:7:0) after 8m47s
[09:39:25.989] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:7:0)
[09:39:26.009] Build status: STARTED
[09:39:26.009] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:8:0) after 5m28s
[09:44:54.122] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:8:0)
[09:44:54.142] Build status: STARTED
[09:44:54.142] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:9:0) after 9m51s
[09:54:45.170] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:9:0)
[09:54:45.293] Build status: STARTED
[09:54:45.293] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:10:0) after 4m5s
[09:58:50.403] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:10:0)
[09:58:50.442] Build status: STARTED
[09:58:50.442] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:11:0) after 9m13s
[10:08:03.560] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:11:0)
[10:08:03.593] Build status: STARTED
[10:08:03.593] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:12:0) after 1m18s
[10:09:21.664] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:12:0)
[10:09:21.711] Build status: STARTED
[10:09:21.711] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:13:0) after 6m42s
[10:16:03.741] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:13:0)
[10:16:03.777] Build status: STARTED
[10:16:03.777] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:14:0) after 1m38s
[10:17:41.805] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:14:0)
[10:17:41.888] Build status: STARTED
[10:17:41.888] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:15:0) after 6m55s
[10:24:37.012] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:15:0)
[10:24:37.031] Build status: STARTED
[10:24:37.032] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:16:0) after 9m4s
[10:33:41.126] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:16:0)
[10:33:41.147] Build status: STARTED
[10:33:41.147] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:17:0) after 4m55s
[10:38:36.617] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:17:0)
[10:38:36.668] Build status: STARTED
[10:38:36.668] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:18:0) after 6m19s
[10:44:55.697] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:18:0)
[10:44:55.712] Build status: STARTED
[10:44:55.712] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:19:0) after 7m59s
[10:52:54.716] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:19:0)
[10:52:54.735] Build status: STARTED
[10:52:54.735] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:20:0) after 6m33s
[10:59:27.894] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:20:0)
[10:59:27.966] Build status: STARTED
[10:59:27.966] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:21:0) after 1m55s
[11:01:23.135] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:21:0)
[11:01:23.277] Build status: STARTED
[11:01:23.278] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:22:0) after 8m9s
[11:09:32.450] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:22:0)
[11:09:32.551] Build status: STARTED
[11:09:32.551] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:23:0) after 4m32s
[11:14:04.576] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:23:0)
[11:14:04.595] Build status: STARTED
[11:14:04.595] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:24:0) after 9m58s
[11:24:02.625] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:24:0)
[11:24:02.647] Build status: STARTED
[11:24:02.647] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:25:0) after 8m49s
[11:32:51.763] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:25:0)
[11:32:51.786] Build status: STARTED
[11:32:51.786] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:26:0) after 2m35s
[11:35:26.805] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:26:0)
[11:35:26.858] Build status: STARTED
[11:35:26.858] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:27:0) after 8m51s
[11:44:17.953] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:27:0)
[11:44:17.970] Build status: STARTED
[11:44:17.970] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:28:0) after 5m36s
[11:49:54.103] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:28:0)
[11:49:54.246] Build status: STARTED
[11:49:54.246] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:29:0) after 3m10s
[11:53:04.370] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:29:0)
[11:53:04.392] Build status: STARTED
[11:53:04.393] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:30:0) after 7m2s
[12:00:06.407] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:30:0)
[12:00:06.436] Build status: STARTED
[12:00:06.436] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:31:0) after 9m19s
[12:09:25.544] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:31:0)
[12:09:25.560] Build status: STARTED
[12:09:25.560] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:32:0) after 6m54s
[12:16:19.656] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:32:0)
[12:16:19.725] Build status: STARTED
[12:16:19.725] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:33:0) after 8m13s
[12:24:32.752] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:33:0)
[12:24:32.775] Build status: STARTED
[12:24:32.775] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:34:0) after 3m10s
[12:27:42.844] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:34:0)
[12:27:42.861] Build status: STARTED
[12:27:42.861] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:35:0) after 7m54s
[12:35:36.906] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:35:0)
[12:35:36.922] Build status: STARTED
[12:35:36.922] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:36:0) after 5m38s
[12:41:14.955] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:36:0)
[12:41:14.985] Build status: STARTED
[12:41:14.985] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:37:0) after 4m38s
[12:45:53.323] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:37:0)
[12:45:53.352] Build status: STARTED
[12:45:53.352] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:38:0) after 6m24s
[12:52:17.489] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:38:0)
[12:52:17.508] Build status: STARTED
[12:52:17.508] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:39:0) after 2m21s
[12:54:38.649] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:39:0)
[12:54:38.675] Build status: STARTED
[12:54:38.675] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:40:0) after 8m16s
[13:02:54.683] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:40:0)
[13:02:54.707] Build status: STARTED
[13:02:54.707] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:41:0) after 4m4s
[13:06:58.856] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:41:0)
[13:06:58.889] Build status: STARTED
[13:06:58.892] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:42:0) after 2m54s
[13:09:52.911] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:42:0)
[13:09:52.941] Build status: STARTED
[13:09:52.941] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:43:0) after 1m13s
[13:11:05.973] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:43:0)
[13:11:05.992] Build status: STARTED
[13:11:05.992] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:44:0) after 4m29s
[13:15:35.170] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:44:0)
[13:15:35.202] Build status: STARTED
[13:15:35.202] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:45:0) after 3m47s
[13:19:22.221] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:45:0)
[13:19:22.260] Build status: STARTED
[13:19:22.260] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:46:0) after 8m22s
[13:27:44.344] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:46:0)
[13:27:44.381] Build status: STARTED
[13:27:44.381] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:47:0) after 9m17s
[13:37:01.412] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:47:0)
[13:37:01.430] Build status: STARTED
[13:37:01.430] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:48:0) after 7m18s
[13:44:19.471] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:48:0)
[13:44:19.490] Build status: STARTED
[13:44:19.490] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:49:0) after 5m28s
[13:49:47.628] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:49:0)
[13:49:47.673] Build status: STARTED
[13:49:47.673] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:50:0) after 6m18s
[13:56:05.713] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:50:0)
[13:56:05.734] Build status: STARTED
[13:56:05.734] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:51:0) after 9m51s
[14:05:56.996] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:51:0)
[14:05:57.022] Build status: STARTED
[14:05:57.022] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:52:0) after 1m52s
[14:07:49.045] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:52:0)
[14:07:49.065] Build status: STARTED
[14:07:49.065] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:53:0) after 3m5s
[14:10:54.330] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:53:0)
[14:10:54.389] Build status: STARTED
[14:10:54.390] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:54:0) after 9m13s
[14:20:07.560] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:54:0)
[14:20:07.578] Build status: STARTED
[14:20:07.579] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:55:0) after 6m7s
[14:26:14.839] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:55:0)
[14:26:14.858] Build status: STARTED
[14:26:14.858] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:56:0) after 5m10s
[14:31:25.171] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:56:0)
[14:31:25.190] Build status: STARTED
[14:31:25.190] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:57:0) after 7m44s
[14:39:09.316] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:57:0)
[14:39:09.378] Build status: STARTED
[14:39:09.378] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:58:0) after 6m56s
[14:46:05.385] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:58:0)
[14:46:05.405] Build status: STARTED
[14:46:05.405] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:59:0) after 7m1s
[14:53:06.445] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:59:0)
[14:53:06.464] Build status: STARTED
[14:53:06.464] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:60:0) after 8m23s
[15:01:29.592] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:60:0)
[15:01:29.617] Build status: STARTED
[15:01:29.617] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:61:0) after 2m38s
[15:04:07.642] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:61:0)
[15:04:07.664] Build status: STARTED
[15:04:07.664] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936960043403490176:62:0) after 4m38s
[15:05:03.897] Received PubSub notification, asking Buildbucket for the build status
[15:05:03.958] Build:
{
"id": "8771529981528489745",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 30201,
"createdBy": "project:chromium",
"createTime": "2023-08-28T09:16:03.236392656Z",
"startTime": "2023-08-28T09:19:34.568616Z",
"endTime": "2023-08-28T15:05:03.589753362Z",
"updateTime": "2023-08-28T15:05:03.589753362Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fb8c37e707328796fd89143b09365711bf7ffd71",
"ref": "refs/heads/main"
}
}
}
[15:05:03.958] Invocation finished in 5h49m1.893171534s with status FAILED