[18:43:59.675] New invocation is queued and will start shortly
[18:44:01.034] Starting the invocation (attempt 1)
[18:44:01.060] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/7676eb101096494df44d37276a2555255fccd1a8"
[18:44:01.060] Popped gitiles commit info from properties and tags
[18:44:01.060] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[18:44:01.060] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[18:44:01.060] Buildbucket request:
{
"requestId": "8947161767660635744",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7676eb101096494df44d37276a2555255fccd1a8",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8947161767660635744"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[18:44:01.472] Scheduled build:
{
"id": "8781731705481886465",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29368,
"createdBy": "project:chromium",
"createTime": "2023-05-07T18:44:01.119765770Z",
"updateTime": "2023-05-07T18:44:01.119765770Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7676eb101096494df44d37276a2555255fccd1a8",
"ref": "refs/heads/main"
}
}
}
[18:44:01.472] Task URL: https://cr-buildbucket.appspot.com/build/8781731705481886465
[18:44:01.472] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:2:0) after 7m22s
[18:46:48.842] Received PubSub notification, asking Buildbucket for the build status
[18:46:48.865] Build status: STARTED
[18:51:23.495] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:2:0)
[18:51:23.522] Build status: STARTED
[18:51:23.524] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:4:0) after 4m34s
[18:55:57.554] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:4:0)
[18:55:57.572] Build status: STARTED
[18:55:57.572] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:5:0) after 6m2s
[19:01:59.593] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:5:0)
[19:01:59.613] Build status: STARTED
[19:01:59.614] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:6:0) after 3m4s
[19:05:03.714] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:6:0)
[19:05:03.742] Build status: STARTED
[19:05:03.742] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:7:0) after 5m37s
[19:10:40.772] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:7:0)
[19:10:40.965] Build status: STARTED
[19:10:40.965] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:8:0) after 7m43s
[19:18:23.983] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:8:0)
[19:18:24.010] Build status: STARTED
[19:18:24.010] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:9:0) after 2m45s
[19:21:09.076] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:9:0)
[19:21:09.104] Build status: STARTED
[19:21:09.104] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:10:0) after 9m33s
[19:30:42.251] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:10:0)
[19:30:42.272] Build status: STARTED
[19:30:42.272] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:11:0) after 1m58s
[19:32:40.312] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:11:0)
[19:32:40.331] Build status: STARTED
[19:32:40.331] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:12:0) after 4m41s
[19:37:21.354] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:12:0)
[19:37:21.384] Build status: STARTED
[19:37:21.384] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:13:0) after 6m22s
[19:43:43.404] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:13:0)
[19:43:43.467] Build status: STARTED
[19:43:43.467] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:14:0) after 1m24s
[19:45:07.489] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:14:0)
[19:45:07.547] Build status: STARTED
[19:45:07.547] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:15:0) after 1m55s
[19:47:02.616] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:15:0)
[19:47:02.650] Build status: STARTED
[19:47:02.651] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:16:0) after 1m14s
[19:48:16.937] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:16:0)
[19:48:16.983] Build status: STARTED
[19:48:16.983] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:17:0) after 3m40s
[19:51:57.050] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:17:0)
[19:51:57.071] Build status: STARTED
[19:51:57.071] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:18:0) after 4m41s
[19:56:38.165] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:18:0)
[19:56:38.242] Build status: STARTED
[19:56:38.242] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:19:0) after 6m56s
[20:03:34.270] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:19:0)
[20:03:34.287] Build status: STARTED
[20:03:34.287] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:20:0) after 2m3s
[20:05:37.388] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:20:0)
[20:05:37.412] Build status: STARTED
[20:05:37.412] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:21:0) after 4m29s
[20:10:06.769] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:21:0)
[20:10:06.787] Build status: STARTED
[20:10:06.787] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:22:0) after 2m17s
[20:12:23.827] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:22:0)
[20:12:23.858] Build status: STARTED
[20:12:23.858] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:23:0) after 7m54s
[20:20:17.975] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:23:0)
[20:20:17.998] Build status: STARTED
[20:20:17.998] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:24:0) after 4m50s
[20:25:08.017] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:24:0)
[20:25:08.041] Build status: STARTED
[20:25:08.041] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:25:0) after 5m52s
[20:31:00.059] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:25:0)
[20:31:00.083] Build status: STARTED
[20:31:00.083] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:26:0) after 4m29s
[20:35:29.192] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:26:0)
[20:35:29.213] Build status: STARTED
[20:35:29.213] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:27:0) after 9m49s
[20:45:18.237] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:27:0)
[20:45:18.263] Build status: STARTED
[20:45:18.263] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:28:0) after 5m45s
[20:51:03.381] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:28:0)
[20:51:03.423] Build status: STARTED
[20:51:03.423] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:29:0) after 3m54s
[20:54:57.440] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:29:0)
[20:54:57.610] Build status: STARTED
[20:54:57.610] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:30:0) after 5m44s
[21:00:41.673] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:30:0)
[21:00:41.692] Build status: STARTED
[21:00:41.692] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:31:0) after 3m38s
[21:04:19.727] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:31:0)
[21:04:19.749] Build status: STARTED
[21:04:19.749] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:32:0) after 9m6s
[21:13:25.818] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:32:0)
[21:13:25.838] Build status: STARTED
[21:13:25.838] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:33:0) after 3m48s
[21:17:13.859] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:33:0)
[21:17:13.878] Build status: STARTED
[21:17:13.878] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:34:0) after 2m19s
[21:19:32.929] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:34:0)
[21:19:32.948] Build status: STARTED
[21:19:32.948] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:35:0) after 7m29s
[21:27:01.967] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:35:0)
[21:27:01.986] Build status: STARTED
[21:27:01.986] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:36:0) after 4m22s
[21:31:24.060] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:36:0)
[21:31:24.079] Build status: STARTED
[21:31:24.079] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:37:0) after 8m53s
[21:40:17.105] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:37:0)
[21:40:17.137] Build status: STARTED
[21:40:17.137] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:38:0) after 8m53s
[21:49:10.109] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:38:0)
[21:49:10.130] Build status: STARTED
[21:49:10.130] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:39:0) after 8m17s
[21:57:27.196] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:39:0)
[21:57:27.214] Build status: STARTED
[21:57:27.214] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:40:0) after 1m3s
[21:58:30.698] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:40:0)
[21:58:30.718] Build status: STARTED
[21:58:30.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:41:0) after 3m12s
[22:01:43.590] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:41:0)
[22:01:43.611] Build status: STARTED
[22:01:43.611] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:42:0) after 1m10s
[22:02:54.319] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:42:0)
[22:02:54.343] Build status: STARTED
[22:02:54.343] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:43:0) after 2m13s
[22:05:07.364] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:43:0)
[22:05:07.386] Build status: STARTED
[22:05:07.386] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:44:0) after 8m6s
[22:13:13.405] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:44:0)
[22:13:13.425] Build status: STARTED
[22:13:13.425] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:45:0) after 5m25s
[22:18:38.667] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:45:0)
[22:18:38.683] Build status: STARTED
[22:18:38.683] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:46:0) after 9m17s
[22:27:56.631] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:46:0)
[22:27:56.651] Build status: STARTED
[22:27:56.651] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:47:0) after 3m13s
[22:31:09.867] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:47:0)
[22:31:09.886] Build status: STARTED
[22:31:09.886] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:48:0) after 3m49s
[22:34:58.910] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:48:0)
[22:34:58.935] Build status: STARTED
[22:34:58.935] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:49:0) after 5m32s
[22:40:31.135] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:49:0)
[22:40:31.156] Build status: STARTED
[22:40:31.156] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:50:0) after 7m11s
[22:47:42.213] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:50:0)
[22:47:42.236] Build status: STARTED
[22:47:42.236] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:51:0) after 4m37s
[22:52:19.259] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:51:0)
[22:52:19.301] Build status: STARTED
[22:52:19.302] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:52:0) after 1m21s
[22:53:40.435] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:52:0)
[22:53:40.457] Build status: STARTED
[22:53:40.457] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:53:0) after 3m6s
[22:56:47.029] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:53:0)
[22:56:47.051] Build status: STARTED
[22:56:47.051] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:54:0) after 4m2s
[23:00:49.196] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:54:0)
[23:00:49.222] Build status: STARTED
[23:00:49.222] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:55:0) after 5m12s
[23:06:01.277] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:55:0)
[23:06:01.298] Build status: STARTED
[23:06:01.298] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:56:0) after 4m7s
[23:10:08.349] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:56:0)
[23:10:08.369] Build status: STARTED
[23:10:08.369] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:57:0) after 6m26s
[23:16:34.458] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:57:0)
[23:16:34.482] Build status: STARTED
[23:16:34.482] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:58:0) after 4m49s
[23:21:23.555] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:58:0)
[23:21:23.611] Build status: STARTED
[23:21:23.611] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:59:0) after 3m25s
[23:24:49.850] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:59:0)
[23:24:49.883] Build status: STARTED
[23:24:49.883] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:60:0) after 4m15s
[23:29:05.628] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:60:0)
[23:29:05.688] Build status: STARTED
[23:29:05.688] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:61:0) after 9m55s
[23:39:00.799] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:61:0)
[23:39:00.827] Build status: STARTED
[23:39:00.827] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:62:0) after 7m24s
[23:46:24.846] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:62:0)
[23:46:24.865] Build status: STARTED
[23:46:24.865] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:63:0) after 2m44s
[23:49:08.882] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:63:0)
[23:49:08.902] Build status: STARTED
[23:49:08.902] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:64:0) after 8m25s
[23:57:33.916] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:64:0)
[23:57:33.942] Build status: STARTED
[23:57:33.942] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:65:0) after 5m10s
[00:02:44.128] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:65:0)
[00:02:44.200] Build status: STARTED
[00:02:44.200] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947161767660635744:66:0) after 3m32s
[00:05:31.664] Received PubSub notification, asking Buildbucket for the build status
[00:05:31.713] Build:
{
"id": "8781731705481886465",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29368,
"createdBy": "project:chromium",
"createTime": "2023-05-07T18:44:01.119765770Z",
"startTime": "2023-05-07T18:46:48.290098Z",
"endTime": "2023-05-08T00:05:31.088042133Z",
"updateTime": "2023-05-08T00:05:31.088042133Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7676eb101096494df44d37276a2555255fccd1a8",
"ref": "refs/heads/main"
}
}
}
[00:05:31.713] Invocation finished in 5h21m32.054605619s with status FAILED