[13:17:48.122] New invocation is queued and will start shortly
[13:17:49.190] Starting the invocation (attempt 1)
[13:17:49.217] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/9be4c26876dbf5718c5af426e82aaf69d23f000a"
[13:17:49.218] Popped gitiles commit info from properties and tags
[13:17:49.218] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[13:17:49.218] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[13:17:49.218] Buildbucket request:
{
"requestId": "8941384084069813520",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9be4c26876dbf5718c5af426e82aaf69d23f000a",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8941384084069813520"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[13:17:49.738] Scheduled build:
{
"id": "8775954022147112305",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29888,
"createdBy": "project:chromium",
"createTime": "2023-07-10T13:17:49.324526376Z",
"updateTime": "2023-07-10T13:17:49.324526376Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9be4c26876dbf5718c5af426e82aaf69d23f000a",
"ref": "refs/heads/main"
}
}
}
[13:17:49.738] Task URL: https://cr-buildbucket.appspot.com/build/8775954022147112305
[13:17:49.738] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:2:0) after 9m46s
[13:21:12.922] Received PubSub notification, asking Buildbucket for the build status
[13:21:12.940] Build status: STARTED
[13:27:35.830] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:2:0)
[13:27:35.856] Build status: STARTED
[13:27:35.856] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:4:0) after 9m14s
[13:36:50.027] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:4:0)
[13:36:50.049] Build status: STARTED
[13:36:50.049] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:5:0) after 9m40s
[13:46:30.095] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:5:0)
[13:46:30.121] Build status: STARTED
[13:46:30.121] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:6:0) after 2m0s
[13:48:30.147] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:6:0)
[13:48:30.175] Build status: STARTED
[13:48:30.175] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:7:0) after 9m27s
[13:57:57.241] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:7:0)
[13:57:57.279] Build status: STARTED
[13:57:57.279] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:8:0) after 4m45s
[14:02:42.352] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:8:0)
[14:02:42.426] Build status: STARTED
[14:02:42.426] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:9:0) after 8m28s
[14:11:10.559] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:9:0)
[14:11:10.590] Build status: STARTED
[14:11:10.590] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:10:0) after 6m46s
[14:17:56.620] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:10:0)
[14:17:56.639] Build status: STARTED
[14:17:56.639] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:11:0) after 4m58s
[14:22:54.667] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:11:0)
[14:22:54.743] Build status: STARTED
[14:22:54.743] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:12:0) after 9m4s
[14:31:58.798] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:12:0)
[14:31:58.819] Build status: STARTED
[14:31:58.819] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:13:0) after 5m39s
[14:37:38.352] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:13:0)
[14:37:38.427] Build status: STARTED
[14:37:38.427] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:14:0) after 7m56s
[14:45:34.948] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:14:0)
[14:45:34.982] Build status: STARTED
[14:45:34.982] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:15:0) after 9m58s
[14:55:33.007] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:15:0)
[14:55:33.057] Build status: STARTED
[14:55:33.057] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:16:0) after 9m6s
[15:04:39.249] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:16:0)
[15:04:39.278] Build status: STARTED
[15:04:39.278] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:17:0) after 1m20s
[15:05:59.489] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:17:0)
[15:05:59.532] Build status: STARTED
[15:05:59.532] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:18:0) after 2m20s
[15:08:19.976] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:18:0)
[15:08:20.001] Build status: STARTED
[15:08:20.001] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:19:0) after 7m23s
[15:15:43.044] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:19:0)
[15:15:43.064] Build status: STARTED
[15:15:43.064] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:20:0) after 8m59s
[15:24:42.211] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:20:0)
[15:24:42.262] Build status: STARTED
[15:24:42.262] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:21:0) after 8m6s
[15:32:48.290] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:21:0)
[15:32:48.318] Build status: STARTED
[15:32:48.318] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:22:0) after 1m19s
[15:34:07.344] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:22:0)
[15:34:07.372] Build status: STARTED
[15:34:07.372] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:23:0) after 7m48s
[15:41:55.365] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:23:0)
[15:41:55.395] Build status: STARTED
[15:41:55.395] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:24:0) after 3m0s
[15:44:55.509] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:24:0)
[15:44:55.527] Build status: STARTED
[15:44:55.527] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:25:0) after 6m18s
[15:51:13.578] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:25:0)
[15:51:13.718] Build status: STARTED
[15:51:13.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:26:0) after 9m43s
[16:00:56.750] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:26:0)
[16:00:56.787] Build status: STARTED
[16:00:56.787] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:27:0) after 3m27s
[16:04:23.875] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:27:0)
[16:04:23.960] Build status: STARTED
[16:04:23.960] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:28:0) after 2m3s
[16:06:27.090] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:28:0)
[16:06:27.112] Build status: STARTED
[16:06:27.112] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:29:0) after 3m36s
[16:10:03.230] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:29:0)
[16:10:03.268] Build status: STARTED
[16:10:03.268] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:30:0) after 4m47s
[16:14:50.409] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:30:0)
[16:14:50.439] Build status: STARTED
[16:14:50.439] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:31:0) after 2m32s
[16:17:22.573] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:31:0)
[16:17:22.622] Build status: STARTED
[16:17:22.622] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:32:0) after 6m57s
[16:24:19.717] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:32:0)
[16:24:19.739] Build status: STARTED
[16:24:19.739] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:33:0) after 4m53s
[16:29:12.790] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:33:0)
[16:29:12.810] Build status: STARTED
[16:29:12.810] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:34:0) after 2m52s
[16:32:05.201] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:34:0)
[16:32:05.225] Build status: STARTED
[16:32:05.225] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:35:0) after 2m54s
[16:34:59.278] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:35:0)
[16:34:59.300] Build status: STARTED
[16:34:59.300] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:36:0) after 4m6s
[16:39:05.376] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:36:0)
[16:39:05.394] Build status: STARTED
[16:39:05.394] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:37:0) after 8m54s
[16:47:59.788] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:37:0)
[16:47:59.808] Build status: STARTED
[16:47:59.808] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:38:0) after 1m19s
[16:49:18.884] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:38:0)
[16:49:18.909] Build status: STARTED
[16:49:18.909] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:39:0) after 3m58s
[16:53:17.019] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:39:0)
[16:53:17.052] Build status: STARTED
[16:53:17.052] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:40:0) after 2m27s
[16:55:44.238] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:40:0)
[16:55:44.269] Build status: STARTED
[16:55:44.269] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:41:0) after 7m44s
[17:03:28.392] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:41:0)
[17:03:28.449] Build status: STARTED
[17:03:28.449] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:42:0) after 2m46s
[17:06:14.490] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:42:0)
[17:06:14.516] Build status: STARTED
[17:06:14.517] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:43:0) after 3m52s
[17:10:06.730] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:43:0)
[17:10:06.749] Build status: STARTED
[17:10:06.749] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:44:0) after 2m8s
[17:12:14.860] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:44:0)
[17:12:14.942] Build status: STARTED
[17:12:14.943] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:45:0) after 5m37s
[17:17:52.033] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:45:0)
[17:17:52.053] Build status: STARTED
[17:17:52.053] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:46:0) after 1m45s
[17:19:37.294] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:46:0)
[17:19:37.367] Build status: STARTED
[17:19:37.367] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:47:0) after 2m9s
[17:21:46.412] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:47:0)
[17:21:46.433] Build status: STARTED
[17:21:46.433] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:48:0) after 9m43s
[17:31:29.517] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:48:0)
[17:31:29.538] Build status: STARTED
[17:31:29.538] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:49:0) after 4m45s
[17:36:15.034] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:49:0)
[17:36:15.052] Build status: STARTED
[17:36:15.052] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:50:0) after 5m6s
[17:41:21.069] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:50:0)
[17:41:21.142] Build status: STARTED
[17:41:21.142] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:51:0) after 8m29s
[17:49:50.218] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:51:0)
[17:49:50.245] Build status: STARTED
[17:49:50.245] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:52:0) after 3m42s
[17:53:32.713] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:52:0)
[17:53:32.739] Build status: STARTED
[17:53:32.739] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:53:0) after 7m19s
[18:00:51.776] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:53:0)
[18:00:51.820] Build status: STARTED
[18:00:51.820] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:54:0) after 3m33s
[18:04:24.844] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:54:0)
[18:04:24.867] Build status: STARTED
[18:04:24.868] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:55:0) after 4m17s
[18:08:41.967] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:55:0)
[18:08:41.987] Build status: STARTED
[18:08:41.987] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:56:0) after 6m55s
[18:15:37.057] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:56:0)
[18:15:37.077] Build status: STARTED
[18:15:37.077] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:57:0) after 8m51s
[18:24:28.227] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:57:0)
[18:24:28.300] Build status: STARTED
[18:24:28.301] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:58:0) after 3m44s
[18:28:12.624] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:58:0)
[18:28:12.644] Build status: STARTED
[18:28:12.644] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:59:0) after 6m54s
[18:35:06.774] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:59:0)
[18:35:06.799] Build status: STARTED
[18:35:06.799] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:60:0) after 3m45s
[18:38:51.898] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:60:0)
[18:38:51.921] Build status: STARTED
[18:38:51.921] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:61:0) after 8m20s
[18:47:12.098] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:61:0)
[18:47:12.117] Build status: STARTED
[18:47:12.118] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:62:0) after 9m2s
[18:56:14.142] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:62:0)
[18:56:14.171] Build status: STARTED
[18:56:14.171] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941384084069813520:63:0) after 6m39s
[18:56:44.852] Received PubSub notification, asking Buildbucket for the build status
[18:56:44.874] Build:
{
"id": "8775954022147112305",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29888,
"createdBy": "project:chromium",
"createTime": "2023-07-10T13:17:49.324526376Z",
"startTime": "2023-07-10T13:21:12.168133Z",
"endTime": "2023-07-10T18:56:44.655618842Z",
"updateTime": "2023-07-10T18:56:44.655618842Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9be4c26876dbf5718c5af426e82aaf69d23f000a",
"ref": "refs/heads/main"
}
}
}
[18:56:44.874] Invocation finished in 5h38m56.768043606s with status FAILED