[14:20:09.377] New invocation is queued and will start shortly
[14:20:10.699] Starting the invocation (attempt 1)
[14:20:10.732] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/5b926cb6c50d5e5b6e6dbd83616167c0f32f19f3"
[14:20:10.732] Popped gitiles commit info from properties and tags
[14:20:10.732] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[14:20:10.732] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[14:20:10.732] Buildbucket request:
{
"requestId": "8951708215315593456",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5b926cb6c50d5e5b6e6dbd83616167c0f32f19f3",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8951708215315593456"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[14:20:11.562] Scheduled build:
{
"id": "8786278153079278065",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29092,
"createdBy": "project:chromium",
"createTime": "2023-03-18T14:20:10.814759866Z",
"updateTime": "2023-03-18T14:20:10.814759866Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5b926cb6c50d5e5b6e6dbd83616167c0f32f19f3",
"ref": "refs/heads/main"
}
}
}
[14:20:11.562] Task URL: https://cr-buildbucket.appspot.com/build/8786278153079278065
[14:20:11.562] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:2:0) after 7m10s
[14:22:38.266] Received PubSub notification, asking Buildbucket for the build status
[14:22:38.297] Build status: STARTED
[14:27:21.696] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:2:0)
[14:27:21.721] Build status: STARTED
[14:27:21.721] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:4:0) after 1m1s
[14:28:22.993] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:4:0)
[14:28:23.043] Build status: STARTED
[14:28:23.043] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:5:0) after 2m50s
[14:31:13.067] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:5:0)
[14:31:13.100] Build status: STARTED
[14:31:13.100] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:6:0) after 3m29s
[14:34:42.114] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:6:0)
[14:34:42.149] Build status: STARTED
[14:34:42.149] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:7:0) after 9m19s
[14:44:01.298] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:7:0)
[14:44:01.329] Build status: STARTED
[14:44:01.330] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:8:0) after 5m36s
[14:49:37.388] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:8:0)
[14:49:37.459] Build status: STARTED
[14:49:37.459] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:9:0) after 6m25s
[14:56:02.479] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:9:0)
[14:56:02.500] Build status: STARTED
[14:56:02.500] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:10:0) after 8m6s
[15:04:08.539] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:10:0)
[15:04:08.567] Build status: STARTED
[15:04:08.567] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:11:0) after 9m38s
[15:13:47.735] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:11:0)
[15:13:47.754] Build status: STARTED
[15:13:47.754] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:12:0) after 4m49s
[15:18:36.780] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:12:0)
[15:18:36.800] Build status: STARTED
[15:18:36.800] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:13:0) after 7m52s
[15:26:28.880] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:13:0)
[15:26:28.932] Build status: STARTED
[15:26:28.932] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:14:0) after 6m37s
[15:33:05.965] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:14:0)
[15:33:05.985] Build status: STARTED
[15:33:05.985] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:15:0) after 8m43s
[15:41:49.000] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:15:0)
[15:41:49.022] Build status: STARTED
[15:41:49.022] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:16:0) after 1m55s
[15:43:44.151] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:16:0)
[15:43:44.176] Build status: STARTED
[15:43:44.176] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:17:0) after 9m26s
[15:53:10.193] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:17:0)
[15:53:10.214] Build status: STARTED
[15:53:10.214] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:18:0) after 4m34s
[15:57:44.259] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:18:0)
[15:57:44.280] Build status: STARTED
[15:57:44.280] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:19:0) after 5m25s
[16:03:09.396] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:19:0)
[16:03:09.420] Build status: STARTED
[16:03:09.420] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:20:0) after 1m18s
[16:04:27.440] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:20:0)
[16:04:27.466] Build status: STARTED
[16:04:27.466] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:21:0) after 1m32s
[16:05:59.674] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:21:0)
[16:05:59.725] Build status: STARTED
[16:05:59.725] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:22:0) after 1m41s
[16:07:40.745] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:22:0)
[16:07:40.763] Build status: STARTED
[16:07:40.763] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:23:0) after 3m7s
[16:10:47.819] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:23:0)
[16:10:47.843] Build status: STARTED
[16:10:47.843] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:24:0) after 7m50s
[16:18:37.871] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:24:0)
[16:18:37.889] Build status: STARTED
[16:18:37.889] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:25:0) after 9m26s
[16:28:04.051] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:25:0)
[16:28:04.071] Build status: STARTED
[16:28:04.071] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:26:0) after 2m54s
[16:30:58.142] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:26:0)
[16:30:58.162] Build status: STARTED
[16:30:58.162] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:27:0) after 3m53s
[16:34:51.365] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:27:0)
[16:34:51.385] Build status: STARTED
[16:34:51.385] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:28:0) after 6m52s
[16:41:43.602] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:28:0)
[16:41:43.621] Build status: STARTED
[16:41:43.622] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:29:0) after 4m25s
[16:46:08.939] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:29:0)
[16:46:08.961] Build status: STARTED
[16:46:08.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:30:0) after 1m46s
[16:47:55.224] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:30:0)
[16:47:55.244] Build status: STARTED
[16:47:55.244] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:31:0) after 3m46s
[16:51:41.263] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:31:0)
[16:51:41.314] Build status: STARTED
[16:51:41.314] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:32:0) after 3m32s
[16:55:13.393] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:32:0)
[16:55:13.414] Build status: STARTED
[16:55:13.414] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:33:0) after 9m39s
[17:04:52.431] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:33:0)
[17:04:52.450] Build status: STARTED
[17:04:52.450] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:34:0) after 9m30s
[17:14:22.472] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:34:0)
[17:14:22.491] Build status: STARTED
[17:14:22.491] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:35:0) after 4m27s
[17:18:49.788] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:35:0)
[17:18:49.807] Build status: STARTED
[17:18:49.807] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:36:0) after 3m35s
[17:22:24.839] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:36:0)
[17:22:24.863] Build status: STARTED
[17:22:24.863] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:37:0) after 1m29s
[17:23:53.879] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:37:0)
[17:23:53.903] Build status: STARTED
[17:23:53.903] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:38:0) after 5m23s
[17:29:17.605] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:38:0)
[17:29:17.625] Build status: STARTED
[17:29:17.625] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:39:0) after 7m29s
[17:36:46.640] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:39:0)
[17:36:46.667] Build status: STARTED
[17:36:46.667] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:40:0) after 2m22s
[17:39:09.258] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:40:0)
[17:39:09.279] Build status: STARTED
[17:39:09.279] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:41:0) after 7m24s
[17:46:33.297] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:41:0)
[17:46:33.329] Build status: STARTED
[17:46:33.329] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:42:0) after 2m5s
[17:48:38.347] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:42:0)
[17:48:38.370] Build status: STARTED
[17:48:38.370] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:43:0) after 6m41s
[17:55:19.646] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:43:0)
[17:55:19.664] Build status: STARTED
[17:55:19.665] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:44:0) after 3m21s
[17:58:40.706] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:44:0)
[17:58:40.856] Build status: STARTED
[17:58:40.856] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:45:0) after 2m40s
[18:01:20.871] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:45:0)
[18:01:20.898] Build status: STARTED
[18:01:20.898] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:46:0) after 8m16s
[18:09:36.916] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:46:0)
[18:09:36.937] Build status: STARTED
[18:09:36.937] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:47:0) after 9m21s
[18:18:57.971] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:47:0)
[18:18:57.998] Build status: STARTED
[18:18:57.998] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:48:0) after 1m16s
[18:20:14.047] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:48:0)
[18:20:14.074] Build status: STARTED
[18:20:14.074] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:49:0) after 3m55s
[18:24:09.276] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:49:0)
[18:24:09.320] Build status: STARTED
[18:24:09.320] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:50:0) after 3m45s
[18:27:54.637] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:50:0)
[18:27:54.658] Build status: STARTED
[18:27:54.658] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:51:0) after 3m42s
[18:31:37.049] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:51:0)
[18:31:37.071] Build status: STARTED
[18:31:37.071] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:52:0) after 3m23s
[18:35:00.253] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:52:0)
[18:35:00.272] Build status: STARTED
[18:35:00.272] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:53:0) after 2m51s
[18:37:51.368] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:53:0)
[18:37:51.388] Build status: STARTED
[18:37:51.388] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:54:0) after 2m2s
[18:39:53.406] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:54:0)
[18:39:53.435] Build status: STARTED
[18:39:53.435] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:55:0) after 6m48s
[18:46:41.656] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:55:0)
[18:46:41.675] Build status: STARTED
[18:46:41.675] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:56:0) after 1m21s
[18:48:02.742] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:56:0)
[18:48:02.770] Build status: STARTED
[18:48:02.770] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:57:0) after 9m15s
[18:57:17.785] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:57:0)
[18:57:17.804] Build status: STARTED
[18:57:17.804] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:58:0) after 2m40s
[18:59:57.851] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:58:0)
[18:59:57.877] Build status: STARTED
[18:59:57.877] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:59:0) after 2m9s
[19:02:07.094] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:59:0)
[19:02:07.117] Build status: STARTED
[19:02:07.119] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:60:0) after 9m23s
[19:11:30.136] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:60:0)
[19:11:30.161] Build status: STARTED
[19:11:30.161] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:61:0) after 5m9s
[19:16:39.181] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:61:0)
[19:16:39.204] Build status: STARTED
[19:16:39.204] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:62:0) after 8m14s
[19:24:53.305] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:62:0)
[19:24:53.325] Build status: STARTED
[19:24:53.325] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:63:0) after 5m38s
[19:30:31.364] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:63:0)
[19:30:31.388] Build status: STARTED
[19:30:31.388] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951708215315593456:64:0) after 9m2s
[19:31:17.296] Received PubSub notification, asking Buildbucket for the build status
[19:31:17.322] Build:
{
"id": "8786278153079278065",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29092,
"createdBy": "project:chromium",
"createTime": "2023-03-18T14:20:10.814759866Z",
"startTime": "2023-03-18T14:22:37.733079Z",
"endTime": "2023-03-18T19:31:16.954384560Z",
"updateTime": "2023-03-18T19:31:16.954384560Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5b926cb6c50d5e5b6e6dbd83616167c0f32f19f3",
"ref": "refs/heads/main"
}
}
}
[19:31:17.322] Invocation finished in 5h11m8.023905955s with status FAILED