[14:36:07.454] New invocation is queued and will start shortly
[14:36:08.794] Starting the invocation (attempt 1)
[14:36:08.830] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/d2b44d0629661f1ada490b72332ec950abfa0fa2"
[14:36:08.830] Popped gitiles commit info from properties and tags
[14:36:08.830] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[14:36:08.830] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[14:36:08.830] Buildbucket request:
{
"requestId": "9000629572491916640",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d2b44d0629661f1ada490b72332ec950abfa0fa2",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9000629572491916640"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[14:36:09.427] Scheduled build:
{
"id": "8835199510286559393",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23237,
"createdBy": "project:chromium",
"createTime": "2021-09-24T14:36:08.922781362Z",
"updateTime": "2021-09-24T14:36:09.193818696Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d2b44d0629661f1ada490b72332ec950abfa0fa2",
"ref": "refs/heads/main"
}
}
}
[14:36:09.427] Task URL: https://cr-buildbucket.appspot.com/build/8835199510286559393
[14:36:09.427] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:2:0) after 9m32s
[14:38:36.402] Received PubSub notification, asking Buildbucket for the build status
[14:38:36.485] Build status: STARTED
[14:45:41.542] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:2:0)
[14:45:41.572] Build status: STARTED
[14:45:41.572] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:4:0) after 2m8s
[14:47:49.699] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:4:0)
[14:47:49.728] Build status: STARTED
[14:47:49.728] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:5:0) after 1m22s
[14:49:12.209] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:5:0)
[14:49:12.306] Build status: STARTED
[14:49:12.306] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:6:0) after 2m55s
[14:52:07.362] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:6:0)
[14:52:07.403] Build status: STARTED
[14:52:07.403] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:7:0) after 7m49s
[14:59:56.587] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:7:0)
[14:59:56.628] Build status: STARTED
[14:59:56.628] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:8:0) after 3m51s
[15:03:47.648] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:8:0)
[15:03:47.695] Build status: STARTED
[15:03:47.695] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:9:0) after 2m50s
[15:06:37.716] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:9:0)
[15:06:37.749] Build status: STARTED
[15:06:37.749] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:10:0) after 2m1s
[15:08:38.766] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:10:0)
[15:08:38.819] Build status: STARTED
[15:08:38.819] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:11:0) after 8m33s
[15:17:11.931] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:11:0)
[15:17:11.967] Build status: STARTED
[15:17:11.967] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:12:0) after 5m9s
[15:22:21.008] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:12:0)
[15:22:21.041] Build status: STARTED
[15:22:21.041] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:13:0) after 2m4s
[15:24:25.027] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:13:0)
[15:24:25.056] Build status: STARTED
[15:24:25.056] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:14:0) after 9m43s
[15:34:08.099] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:14:0)
[15:34:08.136] Build status: STARTED
[15:34:08.136] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:15:0) after 5m6s
[15:39:14.352] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:15:0)
[15:39:14.409] Build status: STARTED
[15:39:14.409] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:16:0) after 8m42s
[15:47:56.431] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:16:0)
[15:47:56.531] Build status: STARTED
[15:47:56.531] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:17:0) after 6m22s
[15:54:18.624] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:17:0)
[15:54:18.678] Build status: STARTED
[15:54:18.678] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:18:0) after 4m38s
[15:58:56.712] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:18:0)
[15:58:56.747] Build status: STARTED
[15:58:56.747] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:19:0) after 8m22s
[16:07:18.774] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:19:0)
[16:07:18.804] Build status: STARTED
[16:07:18.804] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:20:0) after 2m40s
[16:09:58.842] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:20:0)
[16:09:58.880] Build status: STARTED
[16:09:58.881] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:21:0) after 8m7s
[16:18:05.904] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:21:0)
[16:18:06.043] Build status: STARTED
[16:18:06.043] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:22:0) after 5m4s
[16:23:10.108] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:22:0)
[16:23:10.140] Build status: STARTED
[16:23:10.140] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:23:0) after 6m49s
[16:29:59.286] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:23:0)
[16:29:59.318] Build status: STARTED
[16:29:59.318] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:24:0) after 4m8s
[16:34:07.357] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:24:0)
[16:34:07.406] Build status: STARTED
[16:34:07.406] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:25:0) after 5m21s
[16:39:28.429] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:25:0)
[16:39:28.476] Build status: STARTED
[16:39:28.476] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:26:0) after 7m0s
[16:46:28.497] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:26:0)
[16:46:28.544] Build status: STARTED
[16:46:28.544] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:27:0) after 5m48s
[16:52:16.568] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:27:0)
[16:52:16.602] Build status: STARTED
[16:52:16.602] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:28:0) after 5m35s
[16:57:51.598] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:28:0)
[16:57:51.635] Build status: STARTED
[16:57:51.635] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:29:0) after 4m31s
[17:02:23.081] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:29:0)
[17:02:23.169] Build status: STARTED
[17:02:23.169] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:30:0) after 1m17s
[17:03:40.337] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:30:0)
[17:03:40.366] Build status: STARTED
[17:03:40.366] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:31:0) after 8m25s
[17:12:05.482] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:31:0)
[17:12:05.566] Build status: STARTED
[17:12:05.566] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:32:0) after 7m54s
[17:19:59.716] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:32:0)
[17:19:59.750] Build status: STARTED
[17:19:59.750] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:33:0) after 5m36s
[17:25:36.173] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:33:0)
[17:25:36.208] Build status: STARTED
[17:25:36.208] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:34:0) after 7m19s
[17:32:55.230] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:34:0)
[17:32:55.363] Build status: STARTED
[17:32:55.363] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:35:0) after 5m7s
[17:38:02.389] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:35:0)
[17:38:02.434] Build status: STARTED
[17:38:02.434] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:36:0) after 8m25s
[17:46:27.824] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:36:0)
[17:46:27.854] Build status: STARTED
[17:46:27.854] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:37:0) after 7m7s
[17:53:35.017] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:37:0)
[17:53:35.045] Build status: STARTED
[17:53:35.045] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:38:0) after 2m55s
[17:56:30.365] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:38:0)
[17:56:30.394] Build status: STARTED
[17:56:30.394] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:39:0) after 5m48s
[18:02:18.427] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:39:0)
[18:02:18.475] Build status: STARTED
[18:02:18.475] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:40:0) after 6m46s
[18:09:04.480] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:40:0)
[18:09:04.525] Build status: STARTED
[18:09:04.525] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:41:0) after 5m5s
[18:14:09.654] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:41:0)
[18:14:09.682] Build status: STARTED
[18:14:09.682] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:42:0) after 1m53s
[18:16:03.103] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:42:0)
[18:16:03.143] Build status: STARTED
[18:16:03.143] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:43:0) after 9m18s
[18:25:21.170] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:43:0)
[18:25:21.221] Build status: STARTED
[18:25:21.221] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:44:0) after 7m25s
[18:32:46.344] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:44:0)
[18:32:46.414] Build status: STARTED
[18:32:46.414] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:45:0) after 3m50s
[18:36:36.437] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:45:0)
[18:36:36.470] Build status: STARTED
[18:36:36.470] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:46:0) after 4m10s
[18:40:46.491] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:46:0)
[18:40:46.527] Build status: STARTED
[18:40:46.527] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:47:0) after 6m55s
[18:47:41.712] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:47:0)
[18:47:41.804] Build status: STARTED
[18:47:41.804] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:48:0) after 1m44s
[18:49:25.825] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:48:0)
[18:49:25.859] Build status: STARTED
[18:49:25.859] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:49:0) after 3m45s
[18:53:10.882] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:49:0)
[18:53:10.914] Build status: STARTED
[18:53:10.914] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:50:0) after 5m37s
[18:58:48.030] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:50:0)
[18:58:48.091] Build status: STARTED
[18:58:48.091] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:51:0) after 3m6s
[19:01:54.297] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:51:0)
[19:01:54.325] Build status: STARTED
[19:01:54.325] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:52:0) after 2m18s
[19:04:12.299] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:52:0)
[19:04:12.327] Build status: STARTED
[19:04:12.327] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:53:0) after 9m57s
[19:14:09.491] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:53:0)
[19:14:09.526] Build status: STARTED
[19:14:09.526] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:54:0) after 8m19s
[19:22:28.646] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:54:0)
[19:22:28.744] Build status: STARTED
[19:22:28.744] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:55:0) after 2m38s
[19:25:07.461] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:55:0)
[19:25:07.507] Build status: STARTED
[19:25:07.507] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:56:0) after 1m1s
[19:26:08.582] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:56:0)
[19:26:08.618] Build status: STARTED
[19:26:08.618] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:57:0) after 3m51s
[19:29:59.676] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:57:0)
[19:29:59.710] Build status: STARTED
[19:29:59.710] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:58:0) after 9m50s
[19:39:49.913] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:58:0)
[19:39:50.007] Build status: STARTED
[19:39:50.007] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:59:0) after 4m57s
[19:44:47.234] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:59:0)
[19:44:47.353] Build status: STARTED
[19:44:47.353] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:60:0) after 8m7s
[19:52:54.559] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:60:0)
[19:52:54.588] Build status: STARTED
[19:52:54.588] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:61:0) after 8m35s
[20:01:29.845] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:61:0)
[20:01:29.918] Build status: STARTED
[20:01:29.918] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:62:0) after 3m48s
[20:05:18.009] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:62:0)
[20:05:18.049] Build status: STARTED
[20:05:18.049] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000629572491916640:63:0) after 6m25s
[20:08:22.898] Received PubSub notification, asking Buildbucket for the build status
[20:08:22.937] Build:
{
"id": "8835199510286559393",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23237,
"createdBy": "project:chromium",
"createTime": "2021-09-24T14:36:08.922781362Z",
"startTime": "2021-09-24T14:38:35.701685Z",
"endTime": "2021-09-24T20:08:22.633618297Z",
"updateTime": "2021-09-24T20:08:22.633936543Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d2b44d0629661f1ada490b72332ec950abfa0fa2",
"ref": "refs/heads/main"
}
}
}
[20:08:22.937] Invocation finished in 5h32m15.502735168s with status FAILED