[08:11:06.616] New invocation is queued and will start shortly
[08:11:07.876] Starting the invocation (attempt 1)
[08:11:07.919] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/2eb0580472b8fe5011c331a8006d1b4e2b9de029"
[08:11:07.919] Popped gitiles commit info from properties and tags
[08:11:07.919] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[08:11:07.919] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[08:11:07.919] Buildbucket request:
{
"requestId": "9000925586377892832",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2eb0580472b8fe5011c331a8006d1b4e2b9de029",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9000925586377892832"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[08:11:08.545] Scheduled build:
{
"id": "8835495524246177793",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23223,
"createdBy": "project:chromium",
"createTime": "2021-09-21T08:11:08.012573897Z",
"updateTime": "2021-09-21T08:11:08.365927720Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2eb0580472b8fe5011c331a8006d1b4e2b9de029",
"ref": "refs/heads/main"
}
}
}
[08:11:08.545] Task URL: https://cr-buildbucket.appspot.com/build/8835495524246177793
[08:11:08.545] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:2:0) after 5m38s
[08:13:27.980] Received PubSub notification, asking Buildbucket for the build status
[08:13:28.042] Build status: STARTED
[08:16:46.714] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:2:0)
[08:16:46.744] Build status: STARTED
[08:16:46.744] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:4:0) after 5m6s
[08:21:52.777] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:4:0)
[08:21:52.806] Build status: STARTED
[08:21:52.806] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:5:0) after 1m23s
[08:23:15.859] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:5:0)
[08:23:15.892] Build status: STARTED
[08:23:15.892] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:6:0) after 9m51s
[08:33:07.024] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:6:0)
[08:33:07.061] Build status: STARTED
[08:33:07.061] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:7:0) after 2m44s
[08:35:51.045] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:7:0)
[08:35:51.085] Build status: STARTED
[08:35:51.085] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:8:0) after 8m26s
[08:44:17.196] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:8:0)
[08:44:17.243] Build status: STARTED
[08:44:17.243] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:9:0) after 4m45s
[08:49:02.270] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:9:0)
[08:49:02.423] Build status: STARTED
[08:49:02.423] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:10:0) after 4m25s
[08:53:27.448] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:10:0)
[08:53:27.494] Build status: STARTED
[08:53:27.494] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:11:0) after 2m19s
[08:55:46.528] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:11:0)
[08:55:46.602] Build status: STARTED
[08:55:46.602] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:12:0) after 8m55s
[09:04:42.040] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:12:0)
[09:04:42.275] Build status: STARTED
[09:04:42.275] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:13:0) after 5m33s
[09:10:15.353] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:13:0)
[09:10:15.405] Build status: STARTED
[09:10:15.405] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:14:0) after 7m51s
[09:18:06.508] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:14:0)
[09:18:06.556] Build status: STARTED
[09:18:06.556] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:15:0) after 8m53s
[09:26:59.584] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:15:0)
[09:26:59.619] Build status: STARTED
[09:26:59.619] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:16:0) after 4m22s
[09:31:21.645] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:16:0)
[09:31:21.695] Build status: STARTED
[09:31:21.695] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:17:0) after 4m24s
[09:35:45.718] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:17:0)
[09:35:45.960] Build status: STARTED
[09:35:45.960] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:18:0) after 6m1s
[09:41:46.997] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:18:0)
[09:41:47.031] Build status: STARTED
[09:41:47.031] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:19:0) after 8m21s
[09:50:08.118] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:19:0)
[09:50:08.148] Build status: STARTED
[09:50:08.148] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:20:0) after 6m1s
[09:56:09.185] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:20:0)
[09:56:09.259] Build status: STARTED
[09:56:09.259] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:21:0) after 2m39s
[09:58:48.495] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:21:0)
[09:58:48.568] Build status: STARTED
[09:58:48.568] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:22:0) after 8m25s
[10:07:13.636] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:22:0)
[10:07:13.774] Build status: STARTED
[10:07:13.774] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:23:0) after 3m10s
[10:10:23.780] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:23:0)
[10:10:23.809] Build status: STARTED
[10:10:23.809] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:24:0) after 1m15s
[10:11:38.837] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:24:0)
[10:11:38.878] Build status: STARTED
[10:11:38.878] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:25:0) after 8m54s
[10:20:32.908] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:25:0)
[10:20:33.035] Build status: STARTED
[10:20:33.035] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:26:0) after 8m16s
[10:28:49.120] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:26:0)
[10:28:49.160] Build status: STARTED
[10:28:49.160] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:27:0) after 8m29s
[10:37:18.298] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:27:0)
[10:37:18.464] Build status: STARTED
[10:37:18.464] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:28:0) after 4m5s
[10:41:23.468] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:28:0)
[10:41:23.505] Build status: STARTED
[10:41:23.505] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:29:0) after 7m11s
[10:48:34.530] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:29:0)
[10:48:34.564] Build status: STARTED
[10:48:34.564] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:30:0) after 4m46s
[10:53:21.017] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:30:0)
[10:53:21.053] Build status: STARTED
[10:53:21.053] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:31:0) after 9m19s
[11:02:40.405] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:31:0)
[11:02:40.457] Build status: STARTED
[11:02:40.457] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:32:0) after 4m0s
[11:06:40.584] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:32:0)
[11:06:40.614] Build status: STARTED
[11:06:40.614] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:33:0) after 7m54s
[11:14:34.776] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:33:0)
[11:14:34.833] Build status: STARTED
[11:14:34.833] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:34:0) after 3m59s
[11:18:33.937] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:34:0)
[11:18:33.967] Build status: STARTED
[11:18:33.967] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:35:0) after 4m33s
[11:23:07.027] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:35:0)
[11:23:07.057] Build status: STARTED
[11:23:07.057] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:36:0) after 8m33s
[11:31:40.091] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:36:0)
[11:31:40.137] Build status: STARTED
[11:31:40.137] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:37:0) after 5m18s
[11:36:58.130] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:37:0)
[11:36:58.176] Build status: STARTED
[11:36:58.176] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:38:0) after 5m14s
[11:42:12.230] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:38:0)
[11:42:12.271] Build status: STARTED
[11:42:12.271] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:39:0) after 8m1s
[11:50:13.388] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:39:0)
[11:50:13.621] Build status: STARTED
[11:50:13.621] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:40:0) after 4m45s
[11:54:58.650] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:40:0)
[11:54:58.695] Build status: STARTED
[11:54:58.695] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:41:0) after 3m1s
[11:57:59.758] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:41:0)
[11:57:59.785] Build status: STARTED
[11:57:59.785] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:42:0) after 5m35s
[12:03:34.946] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:42:0)
[12:03:35.064] Build status: STARTED
[12:03:35.064] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:43:0) after 2m25s
[12:06:00.090] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:43:0)
[12:06:00.123] Build status: STARTED
[12:06:00.123] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:44:0) after 6m35s
[12:12:35.246] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:44:0)
[12:12:35.296] Build status: STARTED
[12:12:35.296] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:45:0) after 2m56s
[12:15:31.442] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:45:0)
[12:15:31.550] Build status: STARTED
[12:15:31.550] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:46:0) after 7m54s
[12:23:25.599] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:46:0)
[12:23:25.645] Build status: STARTED
[12:23:25.645] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:47:0) after 3m35s
[12:27:00.748] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:47:0)
[12:27:00.808] Build status: STARTED
[12:27:00.808] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:48:0) after 9m13s
[12:36:13.828] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:48:0)
[12:36:13.874] Build status: STARTED
[12:36:13.874] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:49:0) after 8m9s
[12:44:22.901] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:49:0)
[12:44:22.956] Build status: STARTED
[12:44:22.956] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:50:0) after 5m30s
[12:49:53.009] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:50:0)
[12:49:53.042] Build status: STARTED
[12:49:53.042] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:51:0) after 7m40s
[12:57:33.130] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:51:0)
[12:57:33.171] Build status: STARTED
[12:57:33.171] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:52:0) after 5m21s
[13:02:54.235] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:52:0)
[13:02:54.289] Build status: STARTED
[13:02:54.289] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:53:0) after 6m57s
[13:09:51.294] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:53:0)
[13:09:51.329] Build status: STARTED
[13:09:51.329] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:54:0) after 6m55s
[13:16:46.350] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:54:0)
[13:16:46.386] Build status: STARTED
[13:16:46.386] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:55:0) after 2m48s
[13:19:34.425] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:55:0)
[13:19:34.472] Build status: STARTED
[13:19:34.472] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:56:0) after 9m1s
[13:28:35.511] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:56:0)
[13:28:35.584] Build status: STARTED
[13:28:35.585] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:57:0) after 8m5s
[13:36:40.920] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:57:0)
[13:36:40.952] Build status: STARTED
[13:36:40.952] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:58:0) after 8m44s
[13:45:24.975] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:58:0)
[13:45:25.016] Build status: STARTED
[13:45:25.016] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:59:0) after 8m19s
[13:53:44.431] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:59:0)
[13:53:44.463] Build status: STARTED
[13:53:44.463] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:60:0) after 1m13s
[13:54:57.533] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:60:0)
[13:54:57.566] Build status: STARTED
[13:54:57.566] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:61:0) after 8m9s
[14:03:06.824] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:61:0)
[14:03:06.883] Build status: STARTED
[14:03:06.883] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000925586377892832:62:0) after 4m44s
[14:06:20.582] Received PubSub notification, asking Buildbucket for the build status
[14:06:20.622] Build:
{
"id": "8835495524246177793",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23223,
"createdBy": "project:chromium",
"createTime": "2021-09-21T08:11:08.012573897Z",
"startTime": "2021-09-21T08:13:26.256843Z",
"endTime": "2021-09-21T14:06:19.963421993Z",
"updateTime": "2021-09-21T14:06:19.964062433Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2eb0580472b8fe5011c331a8006d1b4e2b9de029",
"ref": "refs/heads/main"
}
}
}
[14:06:20.622] Invocation finished in 5h55m14.026161374s with status FAILED