[20:14:34.800] New invocation is queued and will start shortly
[20:14:35.930] Starting the invocation (attempt 1)
[20:14:35.967] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/33f61b11212c8d0d2f8536686324d6ea6ed24319"
[20:14:35.967] Popped gitiles commit info from properties and tags
[20:14:35.967] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[20:14:35.969] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[20:14:35.969] Buildbucket request:
{
"requestId": "8995806639473227152",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "33f61b11212c8d0d2f8536686324d6ea6ed24319",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8995806639473227152"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[20:14:36.442] Scheduled build:
{
"id": "8830376577518162609",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23566,
"createdBy": "project:chromium",
"createTime": "2021-11-16T20:14:36.033837454Z",
"updateTime": "2021-11-16T20:14:36.033837454Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "33f61b11212c8d0d2f8536686324d6ea6ed24319",
"ref": "refs/heads/main"
}
}
}
[20:14:36.442] Task URL: https://cr-buildbucket.appspot.com/build/8830376577518162609
[20:14:36.442] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:2:0) after 1m2s
[20:15:38.643] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:2:0)
[20:15:38.682] Build status: SCHEDULED
[20:15:38.682] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:3:0) after 1m44s
[20:17:08.213] Received PubSub notification, asking Buildbucket for the build status
[20:17:08.241] Build status: STARTED
[20:17:22.709] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:3:0)
[20:17:22.752] Build status: STARTED
[20:17:22.752] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:5:0) after 8m12s
[20:25:34.807] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:5:0)
[20:25:34.834] Build status: STARTED
[20:25:34.834] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:6:0) after 8m32s
[20:34:07.040] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:6:0)
[20:34:07.085] Build status: STARTED
[20:34:07.085] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:7:0) after 6m56s
[20:41:03.125] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:7:0)
[20:41:03.155] Build status: STARTED
[20:41:03.155] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:8:0) after 4m58s
[20:46:01.258] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:8:0)
[20:46:01.295] Build status: STARTED
[20:46:01.295] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:9:0) after 8m4s
[20:54:05.320] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:9:0)
[20:54:05.385] Build status: STARTED
[20:54:05.385] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:10:0) after 7m35s
[21:01:40.411] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:10:0)
[21:01:40.574] Build status: STARTED
[21:01:40.574] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:11:0) after 5m18s
[21:06:58.824] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:11:0)
[21:06:58.882] Build status: STARTED
[21:06:58.882] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:12:0) after 4m36s
[21:11:35.155] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:12:0)
[21:11:35.189] Build status: STARTED
[21:11:35.189] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:13:0) after 4m51s
[21:16:26.221] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:13:0)
[21:16:26.256] Build status: STARTED
[21:16:26.256] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:14:0) after 7m18s
[21:23:44.329] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:14:0)
[21:23:44.366] Build status: STARTED
[21:23:44.366] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:15:0) after 5m11s
[21:28:55.390] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:15:0)
[21:28:55.450] Build status: STARTED
[21:28:55.450] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:16:0) after 8m36s
[21:37:31.524] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:16:0)
[21:37:31.658] Build status: STARTED
[21:37:31.658] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:17:0) after 6m56s
[21:44:27.952] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:17:0)
[21:44:27.983] Build status: STARTED
[21:44:27.983] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:18:0) after 3m48s
[21:48:16.061] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:18:0)
[21:48:16.467] Build status: STARTED
[21:48:16.467] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:19:0) after 3m19s
[21:51:35.513] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:19:0)
[21:51:35.549] Build status: STARTED
[21:51:35.549] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:20:0) after 8m4s
[21:59:39.578] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:20:0)
[21:59:39.659] Build status: STARTED
[21:59:39.659] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:21:0) after 4m29s
[22:04:09.210] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:21:0)
[22:04:09.244] Build status: STARTED
[22:04:09.244] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:22:0) after 4m4s
[22:08:13.485] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:22:0)
[22:08:13.516] Build status: STARTED
[22:08:13.516] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:23:0) after 2m5s
[22:10:18.592] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:23:0)
[22:10:18.623] Build status: STARTED
[22:10:18.623] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:24:0) after 4m0s
[22:14:18.682] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:24:0)
[22:14:18.718] Build status: STARTED
[22:14:18.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:25:0) after 2m1s
[22:16:19.753] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:25:0)
[22:16:19.785] Build status: STARTED
[22:16:19.785] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:26:0) after 2m16s
[22:18:35.826] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:26:0)
[22:18:35.861] Build status: STARTED
[22:18:35.861] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:27:0) after 9m21s
[22:27:56.991] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:27:0)
[22:27:57.025] Build status: STARTED
[22:27:57.025] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:28:0) after 9m52s
[22:37:49.059] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:28:0)
[22:37:49.094] Build status: STARTED
[22:37:49.094] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:29:0) after 3m57s
[22:41:46.173] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:29:0)
[22:41:46.206] Build status: STARTED
[22:41:46.206] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:30:0) after 9m25s
[22:51:12.000] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:30:0)
[22:51:12.040] Build status: STARTED
[22:51:12.040] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:31:0) after 8m44s
[22:59:56.195] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:31:0)
[22:59:56.227] Build status: STARTED
[22:59:56.227] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:32:0) after 7m2s
[23:06:58.380] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:32:0)
[23:06:58.412] Build status: STARTED
[23:06:58.412] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:33:0) after 5m36s
[23:12:34.436] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:33:0)
[23:12:34.479] Build status: STARTED
[23:12:34.479] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:34:0) after 2m45s
[23:15:19.605] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:34:0)
[23:15:19.773] Build status: STARTED
[23:15:19.773] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:35:0) after 3m25s
[23:18:44.804] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:35:0)
[23:18:44.841] Build status: STARTED
[23:18:44.841] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:36:0) after 1m16s
[23:20:00.923] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:36:0)
[23:20:00.975] Build status: STARTED
[23:20:00.975] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:37:0) after 3m12s
[23:23:12.999] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:37:0)
[23:23:13.033] Build status: STARTED
[23:23:13.033] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:38:0) after 7m38s
[23:30:51.054] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:38:0)
[23:30:51.106] Build status: STARTED
[23:30:51.106] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:39:0) after 8m9s
[23:39:00.142] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:39:0)
[23:39:00.178] Build status: STARTED
[23:39:00.178] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:40:0) after 9m25s
[23:48:25.333] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:40:0)
[23:48:25.362] Build status: STARTED
[23:48:25.362] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:41:0) after 1m1s
[23:49:26.386] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:41:0)
[23:49:26.416] Build status: STARTED
[23:49:26.416] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:42:0) after 6m19s
[23:55:45.621] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:42:0)
[23:55:45.686] Build status: STARTED
[23:55:45.686] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:43:0) after 7m17s
[00:03:02.712] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:43:0)
[00:03:02.764] Build status: STARTED
[00:03:02.764] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:44:0) after 6m51s
[00:09:53.829] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:44:0)
[00:09:53.864] Build status: STARTED
[00:09:53.864] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:45:0) after 6m2s
[00:15:56.314] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:45:0)
[00:15:56.345] Build status: STARTED
[00:15:56.345] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:46:0) after 1m37s
[00:17:33.414] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:46:0)
[00:17:33.456] Build status: STARTED
[00:17:33.456] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:47:0) after 4m29s
[00:22:02.577] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:47:0)
[00:22:02.669] Build status: STARTED
[00:22:02.669] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:48:0) after 5m33s
[00:27:35.851] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:48:0)
[00:27:35.883] Build status: STARTED
[00:27:35.884] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:49:0) after 7m33s
[00:35:09.015] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:49:0)
[00:35:09.099] Build status: STARTED
[00:35:09.099] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:50:0) after 5m15s
[00:40:24.232] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:50:0)
[00:40:24.272] Build status: STARTED
[00:40:24.272] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:51:0) after 3m45s
[00:44:09.355] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:51:0)
[00:44:09.390] Build status: STARTED
[00:44:09.390] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:52:0) after 2m13s
[00:46:22.590] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:52:0)
[00:46:22.654] Build status: STARTED
[00:46:22.654] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:53:0) after 1m17s
[00:47:39.682] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:53:0)
[00:47:39.717] Build status: STARTED
[00:47:39.717] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:54:0) after 6m37s
[00:54:16.804] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:54:0)
[00:54:16.847] Build status: STARTED
[00:54:16.848] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:55:0) after 9m17s
[01:03:33.902] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:55:0)
[01:03:33.933] Build status: STARTED
[01:03:33.933] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:56:0) after 9m47s
[01:13:20.961] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:56:0)
[01:13:20.996] Build status: STARTED
[01:13:20.996] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:57:0) after 1m23s
[01:14:44.121] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:57:0)
[01:14:44.157] Build status: STARTED
[01:14:44.157] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:58:0) after 8m57s
[01:23:41.233] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:58:0)
[01:23:41.267] Build status: STARTED
[01:23:41.267] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:59:0) after 1m57s
[01:25:38.276] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:59:0)
[01:25:38.310] Build status: STARTED
[01:25:38.310] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:60:0) after 7m0s
[01:32:38.346] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:60:0)
[01:32:38.394] Build status: STARTED
[01:32:38.394] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:61:0) after 4m1s
[01:36:39.502] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:61:0)
[01:36:39.534] Build status: STARTED
[01:36:39.534] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:62:0) after 1m12s
[01:37:51.568] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:62:0)
[01:37:51.603] Build status: STARTED
[01:37:51.603] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995806639473227152:63:0) after 7m4s
[01:43:52.961] Received PubSub notification, asking Buildbucket for the build status
[01:43:52.999] Build:
{
"id": "8830376577518162609",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23566,
"createdBy": "project:chromium",
"createTime": "2021-11-16T20:14:36.033837454Z",
"startTime": "2021-11-16T20:17:07.089882Z",
"endTime": "2021-11-17T01:43:52.449782739Z",
"updateTime": "2021-11-17T01:43:52.449782739Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "33f61b11212c8d0d2f8536686324d6ea6ed24319",
"ref": "refs/heads/main"
}
}
}
[01:43:52.999] Invocation finished in 5h29m18.214379668s with status FAILED