[19:44:45.300] New invocation is queued and will start shortly
[19:44:46.804] Starting the invocation (attempt 1)
[19:44:46.833] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/4400ac74aa60fd1960ba899d34cbe78d103c03d9"
[19:44:46.833] Popped gitiles commit info from properties and tags
[19:44:46.833] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[19:44:46.833] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[19:44:46.833] Buildbucket request:
{
"requestId": "8936286308966979664",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4400ac74aa60fd1960ba899d34cbe78d103c03d9",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8936286308966979664"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[19:44:47.368] Scheduled build:
{
"id": "8770856246637653665",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 30260,
"createdBy": "project:chromium",
"createTime": "2023-09-04T19:44:46.898569085Z",
"updateTime": "2023-09-04T19:44:46.898569085Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4400ac74aa60fd1960ba899d34cbe78d103c03d9",
"ref": "refs/heads/main"
}
}
}
[19:44:47.368] Task URL: https://cr-buildbucket.appspot.com/build/8770856246637653665
[19:44:47.368] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:2:0) after 8m26s
[19:44:48.271] Received PubSub notification, asking Buildbucket for the build status
[19:44:48.285] Build status: SCHEDULED
[19:48:15.139] Received PubSub notification, asking Buildbucket for the build status
[19:48:15.207] Build status: STARTED
[19:53:13.352] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:2:0)
[19:53:13.368] Build status: STARTED
[19:53:13.368] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:5:0) after 8m48s
[20:02:01.605] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:5:0)
[20:02:01.634] Build status: STARTED
[20:02:01.634] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:6:0) after 3m34s
[20:05:35.671] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:6:0)
[20:05:35.692] Build status: STARTED
[20:05:35.692] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:7:0) after 2m26s
[20:08:01.673] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:7:0)
[20:08:01.698] Build status: STARTED
[20:08:01.698] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:8:0) after 8m13s
[20:16:14.769] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:8:0)
[20:16:14.795] Build status: STARTED
[20:16:14.795] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:9:0) after 5m49s
[20:22:03.887] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:9:0)
[20:22:03.909] Build status: STARTED
[20:22:03.909] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:10:0) after 9m5s
[20:31:08.959] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:10:0)
[20:31:08.975] Build status: STARTED
[20:31:08.975] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:11:0) after 5m54s
[20:37:02.992] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:11:0)
[20:37:03.019] Build status: STARTED
[20:37:03.019] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:12:0) after 6m4s
[20:43:07.389] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:12:0)
[20:43:07.410] Build status: STARTED
[20:43:07.410] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:13:0) after 9m44s
[20:52:51.529] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:13:0)
[20:52:51.545] Build status: STARTED
[20:52:51.545] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:14:0) after 7m24s
[21:00:15.628] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:14:0)
[21:00:15.649] Build status: STARTED
[21:00:15.649] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:15:0) after 7m2s
[21:07:17.671] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:15:0)
[21:07:17.695] Build status: STARTED
[21:07:17.695] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:16:0) after 5m3s
[21:12:20.715] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:16:0)
[21:12:20.746] Build status: STARTED
[21:12:20.746] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:17:0) after 9m43s
[21:22:04.051] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:17:0)
[21:22:04.128] Build status: STARTED
[21:22:04.128] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:18:0) after 3m9s
[21:25:13.255] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:18:0)
[21:25:13.375] Build status: STARTED
[21:25:13.375] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:19:0) after 5m53s
[21:31:06.535] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:19:0)
[21:31:06.558] Build status: STARTED
[21:31:06.558] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:20:0) after 8m5s
[21:39:11.581] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:20:0)
[21:39:11.607] Build status: STARTED
[21:39:11.607] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:21:0) after 2m59s
[21:42:10.629] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:21:0)
[21:42:10.676] Build status: STARTED
[21:42:10.676] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:22:0) after 2m53s
[21:45:03.898] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:22:0)
[21:45:03.920] Build status: STARTED
[21:45:03.920] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:23:0) after 1m47s
[21:46:50.950] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:23:0)
[21:46:50.967] Build status: STARTED
[21:46:50.967] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:24:0) after 1m25s
[21:48:15.990] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:24:0)
[21:48:16.008] Build status: STARTED
[21:48:16.008] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:25:0) after 1m48s
[21:50:04.114] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:25:0)
[21:50:04.133] Build status: STARTED
[21:50:04.133] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:26:0) after 9m35s
[21:59:39.200] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:26:0)
[21:59:39.261] Build status: STARTED
[21:59:39.261] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:27:0) after 1m52s
[22:01:31.305] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:27:0)
[22:01:31.328] Build status: STARTED
[22:01:31.328] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:28:0) after 1m49s
[22:03:20.384] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:28:0)
[22:03:20.405] Build status: STARTED
[22:03:20.405] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:29:0) after 7m58s
[22:11:18.443] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:29:0)
[22:11:18.536] Build status: STARTED
[22:11:18.536] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:30:0) after 1m19s
[22:12:37.568] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:30:0)
[22:12:37.588] Build status: STARTED
[22:12:37.588] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:31:0) after 7m23s
[22:20:00.706] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:31:0)
[22:20:00.734] Build status: STARTED
[22:20:00.734] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:32:0) after 1m19s
[22:21:19.853] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:32:0)
[22:21:19.886] Build status: STARTED
[22:21:19.886] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:33:0) after 8m2s
[22:29:21.905] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:33:0)
[22:29:21.921] Build status: STARTED
[22:29:21.921] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:34:0) after 6m13s
[22:35:34.938] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:34:0)
[22:35:34.976] Build status: STARTED
[22:35:34.976] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:35:0) after 3m10s
[22:38:44.997] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:35:0)
[22:38:45.013] Build status: STARTED
[22:38:45.013] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:36:0) after 6m33s
[22:45:18.102] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:36:0)
[22:45:18.125] Build status: STARTED
[22:45:18.125] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:37:0) after 2m48s
[22:48:06.257] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:37:0)
[22:48:06.339] Build status: STARTED
[22:48:06.339] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:38:0) after 5m12s
[22:53:18.371] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:38:0)
[22:53:18.394] Build status: STARTED
[22:53:18.394] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:39:0) after 8m32s
[23:01:50.392] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:39:0)
[23:01:50.417] Build status: STARTED
[23:01:50.417] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:40:0) after 1m18s
[23:03:08.536] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:40:0)
[23:03:08.554] Build status: STARTED
[23:03:08.554] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:41:0) after 6m1s
[23:09:09.656] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:41:0)
[23:09:09.687] Build status: STARTED
[23:09:09.687] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:42:0) after 9m52s
[23:19:01.821] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:42:0)
[23:19:01.925] Build status: STARTED
[23:19:01.925] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:43:0) after 2m55s
[23:21:56.945] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:43:0)
[23:21:56.966] Build status: STARTED
[23:21:56.966] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:44:0) after 9m47s
[23:31:44.028] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:44:0)
[23:31:44.049] Build status: STARTED
[23:31:44.049] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:45:0) after 7m40s
[23:39:24.270] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:45:0)
[23:39:24.288] Build status: STARTED
[23:39:24.288] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:46:0) after 4m12s
[23:43:36.314] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:46:0)
[23:43:36.330] Build status: STARTED
[23:43:36.331] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:47:0) after 7m35s
[23:51:11.527] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:47:0)
[23:51:11.546] Build status: STARTED
[23:51:11.546] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:48:0) after 7m54s
[23:59:05.565] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:48:0)
[23:59:05.580] Build status: STARTED
[23:59:05.580] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:49:0) after 2m18s
[00:01:23.708] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:49:0)
[00:01:23.756] Build status: STARTED
[00:01:23.756] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:50:0) after 4m40s
[00:06:03.968] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:50:0)
[00:06:03.993] Build status: STARTED
[00:06:03.993] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:51:0) after 8m57s
[00:15:01.042] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:51:0)
[00:15:01.123] Build status: STARTED
[00:15:01.123] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:52:0) after 8m40s
[00:23:41.142] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:52:0)
[00:23:41.164] Build status: STARTED
[00:23:41.164] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:53:0) after 1m26s
[00:25:07.182] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:53:0)
[00:25:07.211] Build status: STARTED
[00:25:07.211] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:54:0) after 1m56s
[00:27:03.334] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:54:0)
[00:27:03.352] Build status: STARTED
[00:27:03.352] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:55:0) after 8m31s
[00:35:34.383] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:55:0)
[00:35:34.438] Build status: STARTED
[00:35:34.438] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:56:0) after 3m39s
[00:39:13.513] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:56:0)
[00:39:13.572] Build status: STARTED
[00:39:13.572] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:57:0) after 8m41s
[00:47:54.599] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:57:0)
[00:47:54.625] Build status: STARTED
[00:47:54.625] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:58:0) after 5m4s
[00:52:58.901] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:58:0)
[00:52:58.995] Build status: STARTED
[00:52:58.995] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:59:0) after 4m47s
[00:57:46.082] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:59:0)
[00:57:46.104] Build status: STARTED
[00:57:46.104] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:60:0) after 6m15s
[01:04:01.152] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:60:0)
[01:04:01.301] Build status: STARTED
[01:04:01.301] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:61:0) after 1m0s
[01:05:01.325] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:61:0)
[01:05:01.344] Build status: STARTED
[01:05:01.344] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:62:0) after 8m41s
[01:13:42.469] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:62:0)
[01:13:42.485] Build status: STARTED
[01:13:42.485] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:63:0) after 9m3s
[01:22:45.605] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:63:0)
[01:22:45.631] Build status: STARTED
[01:22:45.631] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:64:0) after 2m8s
[01:24:53.650] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:64:0)
[01:24:53.673] Build status: STARTED
[01:24:53.673] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:65:0) after 4m23s
[01:29:16.692] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:65:0)
[01:29:16.710] Build status: STARTED
[01:29:16.710] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:66:0) after 7m51s
[01:37:07.830] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:66:0)
[01:37:07.849] Build status: STARTED
[01:37:07.849] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936286308966979664:67:0) after 3m46s
[01:37:28.570] Received PubSub notification, asking Buildbucket for the build status
[01:37:28.588] Build:
{
"id": "8770856246637653665",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 30260,
"createdBy": "project:chromium",
"createTime": "2023-09-04T19:44:46.898569085Z",
"startTime": "2023-09-04T19:48:14.661244Z",
"endTime": "2023-09-05T01:37:28.329615884Z",
"updateTime": "2023-09-05T01:37:28.329615884Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4400ac74aa60fd1960ba899d34cbe78d103c03d9",
"ref": "refs/heads/main"
}
}
}
[01:37:28.588] Invocation finished in 5h52m43.29502555s with status FAILED