[11:17:01.407] New invocation is queued and will start shortly
[11:17:02.492] Starting the invocation (attempt 1)
[11:17:02.523] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/a78ed6adcb777a662dec51feed17d76ae2d718cb"
[11:17:02.523] Popped gitiles commit info from properties and tags
[11:17:02.523] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[11:17:02.523] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[11:17:02.523] Buildbucket request:
{
"requestId": "8945106158416157248",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a78ed6adcb777a662dec51feed17d76ae2d718cb",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8945106158416157248"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[11:17:02.949] Scheduled build:
{
"id": "8779676096519575281",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29498,
"createdBy": "project:chromium",
"createTime": "2023-05-30T11:17:02.591547483Z",
"updateTime": "2023-05-30T11:17:02.591547483Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a78ed6adcb777a662dec51feed17d76ae2d718cb",
"ref": "refs/heads/main"
}
}
}
[11:17:02.949] Task URL: https://cr-buildbucket.appspot.com/build/8779676096519575281
[11:17:02.949] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:2:0) after 6m45s
[11:19:53.504] Received PubSub notification, asking Buildbucket for the build status
[11:19:53.534] Build status: STARTED
[11:23:47.968] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:2:0)
[11:23:47.987] Build status: STARTED
[11:23:47.987] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:4:0) after 1m2s
[11:24:50.018] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:4:0)
[11:24:50.048] Build status: STARTED
[11:24:50.048] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:5:0) after 4m33s
[11:29:23.079] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:5:0)
[11:29:23.096] Build status: STARTED
[11:29:23.096] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:6:0) after 5m45s
[11:35:08.680] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:6:0)
[11:35:08.703] Build status: STARTED
[11:35:08.703] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:7:0) after 6m22s
[11:41:30.750] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:7:0)
[11:41:30.769] Build status: STARTED
[11:41:30.769] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:8:0) after 6m51s
[11:48:21.786] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:8:0)
[11:48:21.824] Build status: STARTED
[11:48:21.824] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:9:0) after 6m37s
[11:54:58.843] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:9:0)
[11:54:58.857] Build status: STARTED
[11:54:58.857] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:10:0) after 8m51s
[12:03:49.875] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:10:0)
[12:03:49.903] Build status: STARTED
[12:03:49.903] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:11:0) after 9m28s
[12:13:18.027] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:11:0)
[12:13:18.058] Build status: STARTED
[12:13:18.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:12:0) after 5m6s
[12:18:24.095] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:12:0)
[12:18:24.152] Build status: STARTED
[12:18:24.152] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:13:0) after 8m34s
[12:26:58.171] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:13:0)
[12:26:58.192] Build status: STARTED
[12:26:58.192] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:14:0) after 5m45s
[12:32:43.422] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:14:0)
[12:32:43.441] Build status: STARTED
[12:32:43.441] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:15:0) after 4m8s
[12:36:51.462] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:15:0)
[12:36:51.483] Build status: STARTED
[12:36:51.483] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:16:0) after 3m55s
[12:40:46.646] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:16:0)
[12:40:46.661] Build status: STARTED
[12:40:46.661] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:17:0) after 9m20s
[12:50:06.694] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:17:0)
[12:50:06.714] Build status: STARTED
[12:50:06.715] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:18:0) after 1m50s
[12:51:56.734] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:18:0)
[12:51:57.564] Build status: STARTED
[12:51:57.564] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:19:0) after 7m27s
[12:59:24.601] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:19:0)
[12:59:24.667] Build status: STARTED
[12:59:24.667] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:20:0) after 8m21s
[13:07:45.693] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:20:0)
[13:07:45.721] Build status: STARTED
[13:07:45.721] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:21:0) after 4m22s
[13:12:07.746] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:21:0)
[13:12:07.778] Build status: STARTED
[13:12:07.778] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:22:0) after 4m42s
[13:16:49.846] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:22:0)
[13:16:49.863] Build status: STARTED
[13:16:49.863] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:23:0) after 6m53s
[13:23:42.996] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:23:0)
[13:23:43.021] Build status: STARTED
[13:23:43.021] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:24:0) after 9m12s
[13:32:55.086] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:24:0)
[13:32:55.128] Build status: STARTED
[13:32:55.128] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:25:0) after 3m43s
[13:36:38.157] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:25:0)
[13:36:38.173] Build status: STARTED
[13:36:38.174] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:26:0) after 5m32s
[13:42:10.192] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:26:0)
[13:42:10.235] Build status: STARTED
[13:42:10.235] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:27:0) after 2m41s
[13:44:51.339] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:27:0)
[13:44:51.365] Build status: STARTED
[13:44:51.365] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:28:0) after 7m16s
[13:52:07.383] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:28:0)
[13:52:07.403] Build status: STARTED
[13:52:07.403] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:29:0) after 8m32s
[14:00:39.523] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:29:0)
[14:00:39.561] Build status: STARTED
[14:00:39.561] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:30:0) after 7m36s
[14:08:15.695] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:30:0)
[14:08:15.716] Build status: STARTED
[14:08:15.716] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:31:0) after 2m10s
[14:10:25.814] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:31:0)
[14:10:25.836] Build status: STARTED
[14:10:25.836] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:32:0) after 9m5s
[14:19:31.063] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:32:0)
[14:19:31.078] Build status: STARTED
[14:19:31.078] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:33:0) after 9m11s
[14:28:42.450] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:33:0)
[14:28:42.471] Build status: STARTED
[14:28:42.471] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:34:0) after 8m7s
[14:36:49.589] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:34:0)
[14:36:49.609] Build status: STARTED
[14:36:49.609] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:35:0) after 4m24s
[14:41:13.823] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:35:0)
[14:41:13.844] Build status: STARTED
[14:41:13.844] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:36:0) after 4m33s
[14:45:46.907] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:36:0)
[14:45:46.930] Build status: STARTED
[14:45:46.930] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:37:0) after 4m18s
[14:50:05.245] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:37:0)
[14:50:05.270] Build status: STARTED
[14:50:05.270] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:38:0) after 2m28s
[14:52:33.308] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:38:0)
[14:52:33.332] Build status: STARTED
[14:52:33.332] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:39:0) after 5m11s
[14:57:44.708] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:39:0)
[14:57:44.728] Build status: STARTED
[14:57:44.728] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:40:0) after 5m13s
[15:02:58.130] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:40:0)
[15:02:58.146] Build status: STARTED
[15:02:58.146] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:41:0) after 3m32s
[15:06:30.537] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:41:0)
[15:06:30.636] Build status: STARTED
[15:06:30.636] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:42:0) after 9m5s
[15:15:35.661] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:42:0)
[15:15:35.707] Build status: STARTED
[15:15:35.707] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:43:0) after 6m1s
[15:21:37.139] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:43:0)
[15:21:37.163] Build status: STARTED
[15:21:37.163] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:44:0) after 9m30s
[15:31:07.192] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:44:0)
[15:31:07.221] Build status: STARTED
[15:31:07.221] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:45:0) after 1m37s
[15:32:44.615] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:45:0)
[15:32:44.636] Build status: STARTED
[15:32:44.637] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:46:0) after 1m42s
[15:34:26.656] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:46:0)
[15:34:26.676] Build status: STARTED
[15:34:26.676] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:47:0) after 1m44s
[15:36:11.163] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:47:0)
[15:36:11.186] Build status: STARTED
[15:36:11.186] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:48:0) after 6m29s
[15:42:40.206] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:48:0)
[15:42:40.226] Build status: STARTED
[15:42:40.226] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:49:0) after 6m31s
[15:49:11.245] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:49:0)
[15:49:11.265] Build status: STARTED
[15:49:11.265] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:50:0) after 6m50s
[15:56:01.774] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:50:0)
[15:56:01.794] Build status: STARTED
[15:56:01.794] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:51:0) after 8m47s
[16:04:48.927] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:51:0)
[16:04:48.949] Build status: STARTED
[16:04:48.949] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:52:0) after 3m46s
[16:08:34.967] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:52:0)
[16:08:35.009] Build status: STARTED
[16:08:35.009] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:53:0) after 6m51s
[16:15:26.087] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:53:0)
[16:15:26.129] Build status: STARTED
[16:15:26.129] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:54:0) after 6m10s
[16:21:36.151] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:54:0)
[16:21:36.189] Build status: STARTED
[16:21:36.189] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:55:0) after 7m15s
[16:28:51.281] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:55:0)
[16:28:51.300] Build status: STARTED
[16:28:51.300] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:56:0) after 3m54s
[16:32:45.774] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:56:0)
[16:32:45.798] Build status: STARTED
[16:32:45.798] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945106158416157248:57:0) after 4m36s
[16:36:33.979] Received PubSub notification, asking Buildbucket for the build status
[16:36:34.084] Build:
{
"id": "8779676096519575281",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29498,
"createdBy": "project:chromium",
"createTime": "2023-05-30T11:17:02.591547483Z",
"startTime": "2023-05-30T11:19:52.975114Z",
"endTime": "2023-05-30T16:36:33.764728168Z",
"updateTime": "2023-05-30T16:36:33.764728168Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a78ed6adcb777a662dec51feed17d76ae2d718cb",
"ref": "refs/heads/main"
}
}
}
[16:36:34.084] Invocation finished in 5h19m32.685306919s with status FAILED