[10:51:24.177] New invocation is queued and will start shortly
[10:51:25.281] Starting the invocation (attempt 1)
[10:51:25.322] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/a6fb9cdde6a5a936a07bc40773be7f16d9173f34"
[10:51:25.322] Popped gitiles commit info from properties and tags
[10:51:25.322] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[10:51:25.322] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[10:51:25.322] Buildbucket request:
{
"requestId": "9002093262192241008",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a6fb9cdde6a5a936a07bc40773be7f16d9173f34",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9002093262192241008"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[10:51:29.845] Scheduled build:
{
"id": "8836663196272018737",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23063,
"createdBy": "project:chromium",
"createTime": "2021-09-08T10:51:29.191990287Z",
"updateTime": "2021-09-08T10:51:29.639844945Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a6fb9cdde6a5a936a07bc40773be7f16d9173f34",
"ref": "refs/heads/main"
}
}
}
[10:51:29.845] Task URL: https://cr-buildbucket.appspot.com/build/8836663196272018737
[10:51:29.845] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:2:0) after 8m5s
[10:53:53.876] Received PubSub notification, asking Buildbucket for the build status
[10:53:53.920] Build status: STARTED
[10:59:35.064] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:2:0)
[10:59:35.092] Build status: STARTED
[10:59:35.092] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:4:0) after 5m8s
[11:04:43.142] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:4:0)
[11:04:43.181] Build status: STARTED
[11:04:43.181] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:5:0) after 8m27s
[11:13:10.351] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:5:0)
[11:13:10.382] Build status: STARTED
[11:13:10.382] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:6:0) after 7m16s
[11:20:26.401] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:6:0)
[11:20:26.549] Build status: STARTED
[11:20:26.549] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:7:0) after 9m15s
[11:29:41.673] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:7:0)
[11:29:41.701] Build status: STARTED
[11:29:41.701] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:8:0) after 7m17s
[11:36:58.776] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:8:0)
[11:36:58.850] Build status: STARTED
[11:36:58.850] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:9:0) after 2m25s
[11:39:23.909] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:9:0)
[11:39:23.936] Build status: STARTED
[11:39:23.936] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:10:0) after 3m43s
[11:43:07.120] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:10:0)
[11:43:07.163] Build status: STARTED
[11:43:07.163] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:11:0) after 8m44s
[11:51:51.264] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:11:0)
[11:51:51.296] Build status: STARTED
[11:51:51.296] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:12:0) after 7m47s
[11:59:38.475] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:12:0)
[11:59:38.569] Build status: STARTED
[11:59:38.569] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:13:0) after 2m42s
[12:02:20.593] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:13:0)
[12:02:20.624] Build status: STARTED
[12:02:20.624] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:14:0) after 1m36s
[12:03:56.867] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:14:0)
[12:03:56.923] Build status: STARTED
[12:03:56.923] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:15:0) after 1m32s
[12:05:29.005] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:15:0)
[12:05:29.053] Build status: STARTED
[12:05:29.053] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:16:0) after 2m11s
[12:07:40.088] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:16:0)
[12:07:40.121] Build status: STARTED
[12:07:40.121] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:17:0) after 9m2s
[12:16:42.143] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:17:0)
[12:16:42.180] Build status: STARTED
[12:16:42.180] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:18:0) after 6m21s
[12:23:03.245] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:18:0)
[12:23:03.292] Build status: STARTED
[12:23:03.292] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:19:0) after 2m6s
[12:25:09.481] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:19:0)
[12:25:09.536] Build status: STARTED
[12:25:09.536] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:20:0) after 5m29s
[12:30:38.565] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:20:0)
[12:30:38.666] Build status: STARTED
[12:30:38.666] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:21:0) after 4m47s
[12:35:25.692] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:21:0)
[12:35:25.726] Build status: STARTED
[12:35:25.726] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:22:0) after 8m54s
[12:44:19.824] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:22:0)
[12:44:19.851] Build status: STARTED
[12:44:19.851] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:23:0) after 2m20s
[12:46:40.297] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:23:0)
[12:46:40.333] Build status: STARTED
[12:46:40.333] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:24:0) after 3m32s
[12:50:12.315] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:24:0)
[12:50:12.354] Build status: STARTED
[12:50:12.354] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:25:0) after 6m39s
[12:56:51.380] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:25:0)
[12:56:51.416] Build status: STARTED
[12:56:51.416] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:26:0) after 5m17s
[13:02:08.445] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:26:0)
[13:02:08.498] Build status: STARTED
[13:02:08.498] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:27:0) after 5m26s
[13:07:34.480] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:27:0)
[13:07:34.527] Build status: STARTED
[13:07:34.527] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:28:0) after 4m28s
[13:12:02.613] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:28:0)
[13:12:02.647] Build status: STARTED
[13:12:02.647] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:29:0) after 8m23s
[13:20:25.677] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:29:0)
[13:20:25.738] Build status: STARTED
[13:20:25.738] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:30:0) after 1m51s
[13:22:16.765] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:30:0)
[13:22:16.831] Build status: STARTED
[13:22:16.831] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:31:0) after 1m2s
[13:23:18.855] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:31:0)
[13:23:18.886] Build status: STARTED
[13:23:18.886] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:32:0) after 1m44s
[13:25:02.919] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:32:0)
[13:25:02.971] Build status: STARTED
[13:25:02.971] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:33:0) after 7m11s
[13:32:14.212] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:33:0)
[13:32:14.873] Build status: STARTED
[13:32:14.873] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:34:0) after 4m52s
[13:37:06.954] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:34:0)
[13:37:06.989] Build status: STARTED
[13:37:06.989] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:35:0) after 4m52s
[13:41:59.102] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:35:0)
[13:41:59.145] Build status: STARTED
[13:41:59.145] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:36:0) after 4m26s
[13:46:25.338] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:36:0)
[13:46:25.388] Build status: STARTED
[13:46:25.388] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:37:0) after 5m53s
[13:52:18.411] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:37:0)
[13:52:18.449] Build status: STARTED
[13:52:18.449] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:38:0) after 9m24s
[14:01:42.462] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:38:0)
[14:01:42.501] Build status: STARTED
[14:01:42.501] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:39:0) after 3m29s
[14:05:11.528] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:39:0)
[14:05:11.711] Build status: STARTED
[14:05:11.711] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:40:0) after 4m35s
[14:09:46.733] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:40:0)
[14:09:46.778] Build status: STARTED
[14:09:46.778] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:41:0) after 2m53s
[14:12:39.970] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:41:0)
[14:12:40.053] Build status: STARTED
[14:12:40.053] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:42:0) after 3m57s
[14:16:37.087] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:42:0)
[14:16:37.116] Build status: STARTED
[14:16:37.116] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:43:0) after 3m25s
[14:20:02.180] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:43:0)
[14:20:02.294] Build status: STARTED
[14:20:02.294] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:44:0) after 5m51s
[14:25:53.318] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:44:0)
[14:25:53.356] Build status: STARTED
[14:25:53.356] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:45:0) after 2m23s
[14:28:16.483] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:45:0)
[14:28:16.538] Build status: STARTED
[14:28:16.538] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:46:0) after 9m11s
[14:37:27.564] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:46:0)
[14:37:27.602] Build status: STARTED
[14:37:27.602] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:47:0) after 9m48s
[14:47:15.626] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:47:0)
[14:47:15.661] Build status: STARTED
[14:47:15.661] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:48:0) after 6m14s
[14:53:29.684] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:48:0)
[14:53:29.748] Build status: STARTED
[14:53:29.749] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:49:0) after 6m28s
[14:59:57.867] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:49:0)
[14:59:57.907] Build status: STARTED
[14:59:57.907] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:50:0) after 1m3s
[15:01:01.086] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:50:0)
[15:01:01.323] Build status: STARTED
[15:01:01.323] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:51:0) after 8m6s
[15:09:07.554] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:51:0)
[15:09:07.597] Build status: STARTED
[15:09:07.597] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:52:0) after 5m51s
[15:14:58.782] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:52:0)
[15:14:58.828] Build status: STARTED
[15:14:58.828] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:53:0) after 3m2s
[15:18:01.098] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:53:0)
[15:18:01.131] Build status: STARTED
[15:18:01.131] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:54:0) after 7m57s
[15:25:58.155] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:54:0)
[15:25:58.251] Build status: STARTED
[15:25:58.251] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:55:0) after 5m49s
[15:31:47.643] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:55:0)
[15:31:47.708] Build status: STARTED
[15:31:47.708] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:56:0) after 3m11s
[15:34:58.734] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:56:0)
[15:34:58.769] Build status: STARTED
[15:34:58.769] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:57:0) after 1m27s
[15:36:25.901] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:57:0)
[15:36:25.937] Build status: STARTED
[15:36:25.937] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:58:0) after 4m18s
[15:40:43.937] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:58:0)
[15:40:43.970] Build status: STARTED
[15:40:43.970] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:59:0) after 4m38s
[15:45:21.993] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:59:0)
[15:45:22.136] Build status: STARTED
[15:45:22.136] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:60:0) after 6m30s
[15:51:52.203] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:60:0)
[15:51:52.291] Build status: STARTED
[15:51:52.291] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:61:0) after 3m7s
[15:54:59.326] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:61:0)
[15:54:59.360] Build status: STARTED
[15:54:59.360] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:62:0) after 3m27s
[15:58:26.440] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:62:0)
[15:58:26.487] Build status: STARTED
[15:58:26.487] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:63:0) after 4m34s
[16:03:00.643] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:63:0)
[16:03:00.732] Build status: STARTED
[16:03:00.732] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:64:0) after 4m20s
[16:07:20.767] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:64:0)
[16:07:36.005] Build status: STARTED
[16:07:36.005] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002093262192241008:65:0) after 5m49s
[16:12:01.445] Received PubSub notification, asking Buildbucket for the build status
[16:12:01.479] Build:
{
"id": "8836663196272018737",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23063,
"createdBy": "project:chromium",
"createTime": "2021-09-08T10:51:29.191990287Z",
"startTime": "2021-09-08T10:53:53.039302Z",
"endTime": "2021-09-08T16:12:01.107459550Z",
"updateTime": "2021-09-08T16:12:01.107909085Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a6fb9cdde6a5a936a07bc40773be7f16d9173f34",
"ref": "refs/heads/main"
}
}
}
[16:12:01.479] Invocation finished in 5h20m37.317554909s with status FAILED