[17:28:22.364] New invocation is queued and will start shortly
[17:28:23.435] Starting the invocation (attempt 1)
[17:28:23.469] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/f9f865bf9ea063460b53e693c717e476e1fca00d"
[17:28:23.469] Popped gitiles commit info from properties and tags
[17:28:23.469] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[17:28:23.470] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[17:28:23.470] Buildbucket request:
{
"requestId": "8952058761551348688",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f9f865bf9ea063460b53e693c717e476e1fca00d",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8952058761551348688"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[17:28:24.176] Scheduled build:
{
"id": "8786628699639449569",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29074,
"createdBy": "project:chromium",
"createTime": "2023-03-14T17:28:23.563687791Z",
"updateTime": "2023-03-14T17:28:23.563687791Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f9f865bf9ea063460b53e693c717e476e1fca00d",
"ref": "refs/heads/main"
}
}
}
[17:28:24.176] Task URL: https://cr-buildbucket.appspot.com/build/8786628699639449569
[17:28:24.176] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:2:0) after 6m37s
[17:30:17.907] Received PubSub notification, asking Buildbucket for the build status
[17:30:18.021] Build status: STARTED
[17:35:01.204] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:2:0)
[17:35:01.277] Build status: STARTED
[17:35:01.277] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:4:0) after 3m9s
[17:38:10.310] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:4:0)
[17:38:10.331] Build status: STARTED
[17:38:10.331] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:5:0) after 2m35s
[17:40:45.346] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:5:0)
[17:40:45.452] Build status: STARTED
[17:40:45.452] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:6:0) after 4m21s
[17:45:06.532] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:6:0)
[17:45:06.572] Build status: STARTED
[17:45:06.572] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:7:0) after 4m16s
[17:49:22.595] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:7:0)
[17:49:22.736] Build status: STARTED
[17:49:22.736] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:8:0) after 4m1s
[17:53:23.742] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:8:0)
[17:53:23.765] Build status: STARTED
[17:53:23.765] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:9:0) after 8m17s
[18:01:40.797] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:9:0)
[18:01:40.867] Build status: STARTED
[18:01:40.867] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:10:0) after 1m14s
[18:02:54.940] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:10:0)
[18:02:54.976] Build status: STARTED
[18:02:54.976] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:11:0) after 3m42s
[18:06:37.063] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:11:0)
[18:06:37.163] Build status: STARTED
[18:06:37.163] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:12:0) after 7m51s
[18:14:28.198] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:12:0)
[18:14:28.221] Build status: STARTED
[18:14:28.221] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:13:0) after 1m36s
[18:16:04.279] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:13:0)
[18:16:04.341] Build status: STARTED
[18:16:04.341] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:14:0) after 1m36s
[18:17:40.370] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:14:0)
[18:17:40.395] Build status: STARTED
[18:17:40.395] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:15:0) after 5m32s
[18:23:12.522] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:15:0)
[18:23:12.543] Build status: STARTED
[18:23:12.543] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:16:0) after 6m45s
[18:29:57.638] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:16:0)
[18:29:57.661] Build status: STARTED
[18:29:57.661] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:17:0) after 6m2s
[18:35:59.681] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:17:0)
[18:35:59.708] Build status: STARTED
[18:35:59.709] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:18:0) after 1m26s
[18:37:25.729] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:18:0)
[18:37:25.768] Build status: STARTED
[18:37:25.768] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:19:0) after 5m23s
[18:42:48.788] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:19:0)
[18:42:48.816] Build status: STARTED
[18:42:48.816] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:20:0) after 3m32s
[18:46:20.914] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:20:0)
[18:46:20.943] Build status: STARTED
[18:46:20.943] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:21:0) after 5m4s
[18:51:25.012] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:21:0)
[18:51:25.034] Build status: STARTED
[18:51:25.034] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:22:0) after 5m36s
[18:57:01.048] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:22:0)
[18:57:01.087] Build status: STARTED
[18:57:01.087] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:23:0) after 3m11s
[19:00:12.177] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:23:0)
[19:00:12.210] Build status: STARTED
[19:00:12.210] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:24:0) after 1m34s
[19:01:46.329] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:24:0)
[19:01:46.367] Build status: STARTED
[19:01:46.367] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:25:0) after 8m5s
[19:09:51.408] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:25:0)
[19:09:51.437] Build status: STARTED
[19:09:51.438] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:26:0) after 4m12s
[19:14:03.886] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:26:0)
[19:14:03.913] Build status: STARTED
[19:14:03.913] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:27:0) after 4m47s
[19:18:50.965] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:27:0)
[19:18:50.985] Build status: STARTED
[19:18:50.985] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:28:0) after 3m53s
[19:22:43.998] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:28:0)
[19:22:44.020] Build status: STARTED
[19:22:44.020] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:29:0) after 6m36s
[19:29:20.095] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:29:0)
[19:29:20.118] Build status: STARTED
[19:29:20.118] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:30:0) after 4m28s
[19:33:48.385] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:30:0)
[19:33:48.437] Build status: STARTED
[19:33:48.437] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:31:0) after 3m1s
[19:36:49.604] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:31:0)
[19:36:49.634] Build status: STARTED
[19:36:49.634] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:32:0) after 8m48s
[19:45:37.663] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:32:0)
[19:45:37.686] Build status: STARTED
[19:45:37.686] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:33:0) after 6m31s
[19:52:08.894] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:33:0)
[19:52:08.943] Build status: STARTED
[19:52:08.943] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:34:0) after 9m25s
[20:01:34.436] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:34:0)
[20:01:34.457] Build status: STARTED
[20:01:34.457] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:35:0) after 7m51s
[20:09:25.516] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:35:0)
[20:09:25.535] Build status: STARTED
[20:09:25.535] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:36:0) after 1m3s
[20:10:28.737] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:36:0)
[20:10:28.762] Build status: STARTED
[20:10:28.762] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:37:0) after 2m58s
[20:13:26.795] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:37:0)
[20:13:26.817] Build status: STARTED
[20:13:26.817] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:38:0) after 2m7s
[20:15:33.849] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:38:0)
[20:15:33.876] Build status: STARTED
[20:15:33.876] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:39:0) after 3m2s
[20:18:35.948] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:39:0)
[20:18:35.988] Build status: STARTED
[20:18:35.988] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:40:0) after 4m45s
[20:23:21.010] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:40:0)
[20:23:21.039] Build status: STARTED
[20:23:21.039] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:41:0) after 2m11s
[20:25:32.049] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:41:0)
[20:25:32.073] Build status: STARTED
[20:25:32.073] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:42:0) after 8m31s
[20:34:03.093] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:42:0)
[20:34:03.129] Build status: STARTED
[20:34:03.129] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:43:0) after 8m33s
[20:42:36.197] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:43:0)
[20:42:36.233] Build status: STARTED
[20:42:36.233] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:44:0) after 6m3s
[20:48:39.266] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:44:0)
[20:48:39.293] Build status: STARTED
[20:48:39.293] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:45:0) after 4m21s
[20:53:00.318] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:45:0)
[20:53:00.342] Build status: STARTED
[20:53:00.342] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:46:0) after 9m55s
[21:02:55.374] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:46:0)
[21:02:55.398] Build status: STARTED
[21:02:55.398] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:47:0) after 7m51s
[21:10:46.518] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:47:0)
[21:10:46.557] Build status: STARTED
[21:10:46.557] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:48:0) after 9m14s
[21:20:00.648] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:48:0)
[21:20:00.679] Build status: STARTED
[21:20:00.679] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:49:0) after 3m56s
[21:23:57.016] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:49:0)
[21:23:57.042] Build status: STARTED
[21:23:57.042] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:50:0) after 1m44s
[21:25:41.467] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:50:0)
[21:25:41.491] Build status: STARTED
[21:25:41.491] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:51:0) after 4m23s
[21:30:04.583] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:51:0)
[21:30:04.605] Build status: STARTED
[21:30:04.605] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:52:0) after 2m44s
[21:32:48.631] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:52:0)
[21:32:48.656] Build status: STARTED
[21:32:48.656] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:53:0) after 1m43s
[21:34:31.744] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:53:0)
[21:34:31.773] Build status: STARTED
[21:34:31.773] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:54:0) after 1m23s
[21:35:54.803] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:54:0)
[21:35:54.829] Build status: STARTED
[21:35:54.829] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:55:0) after 4m13s
[21:40:08.460] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:55:0)
[21:40:08.494] Build status: STARTED
[21:40:08.494] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:56:0) after 6m0s
[21:46:08.523] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:56:0)
[21:46:08.553] Build status: STARTED
[21:46:08.553] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:57:0) after 2m7s
[21:48:15.544] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:57:0)
[21:48:15.570] Build status: STARTED
[21:48:15.570] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:58:0) after 7m44s
[21:55:59.599] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:58:0)
[21:55:59.624] Build status: STARTED
[21:55:59.624] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:59:0) after 1m10s
[21:57:09.661] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:59:0)
[21:57:09.685] Build status: STARTED
[21:57:09.685] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:60:0) after 6m44s
[22:03:53.697] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:60:0)
[22:03:53.729] Build status: STARTED
[22:03:53.729] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:61:0) after 3m44s
[22:07:37.763] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:61:0)
[22:07:37.790] Build status: STARTED
[22:07:37.790] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:62:0) after 8m49s
[22:16:26.836] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:62:0)
[22:16:26.858] Build status: STARTED
[22:16:26.858] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:63:0) after 7m41s
[22:24:08.213] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:63:0)
[22:24:08.234] Build status: STARTED
[22:24:08.234] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:64:0) after 7m41s
[22:31:49.474] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:64:0)
[22:31:49.553] Build status: STARTED
[22:31:49.553] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:65:0) after 8m18s
[22:40:08.081] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:65:0)
[22:40:08.114] Build status: STARTED
[22:40:08.114] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:66:0) after 7m59s
[22:48:07.573] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:66:0)
[22:48:07.601] Build status: STARTED
[22:48:07.601] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952058761551348688:67:0) after 9m42s
[22:50:01.393] Received PubSub notification, asking Buildbucket for the build status
[22:50:01.423] Build:
{
"id": "8786628699639449569",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29074,
"createdBy": "project:chromium",
"createTime": "2023-03-14T17:28:23.563687791Z",
"startTime": "2023-03-14T17:30:16.869922Z",
"endTime": "2023-03-14T22:50:01.028437023Z",
"updateTime": "2023-03-14T22:50:01.028437023Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f9f865bf9ea063460b53e693c717e476e1fca00d",
"ref": "refs/heads/main"
}
}
}
[22:50:01.423] Invocation finished in 5h21m39.066994847s with status FAILED