[12:28:54.879] New invocation is queued and will start shortly
[12:28:56.013] Starting the invocation (attempt 1)
[12:28:56.054] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/3347fb0a6001612b2927b2cf491a8e6b845a8e8c"
[12:28:56.054] Popped gitiles commit info from properties and tags
[12:28:56.054] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[12:28:56.054] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[12:28:56.054] Buildbucket request:
{
"requestId": "9001634142460182368",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3347fb0a6001612b2927b2cf491a8e6b845a8e8c",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9001634142460182368"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[12:28:56.634] Scheduled build:
{
"id": "8836204080443866017",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23086,
"createdBy": "project:chromium",
"createTime": "2021-09-13T12:28:56.164913481Z",
"updateTime": "2021-09-13T12:28:56.417395551Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3347fb0a6001612b2927b2cf491a8e6b845a8e8c",
"ref": "refs/heads/main"
}
}
}
[12:28:56.634] Task URL: https://cr-buildbucket.appspot.com/build/8836204080443866017
[12:28:56.634] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:2:0) after 6m4s
[12:32:29.067] Received PubSub notification, asking Buildbucket for the build status
[12:32:29.135] Build status: STARTED
[12:35:00.809] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:2:0)
[12:35:00.844] Build status: STARTED
[12:35:00.844] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:4:0) after 1m20s
[12:36:21.229] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:4:0)
[12:36:21.275] Build status: STARTED
[12:36:21.275] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:5:0) after 1m30s
[12:37:51.495] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:5:0)
[12:37:51.568] Build status: STARTED
[12:37:51.568] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:6:0) after 8m26s
[12:46:17.789] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:6:0)
[12:46:17.840] Build status: STARTED
[12:46:17.840] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:7:0) after 2m43s
[12:49:01.204] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:7:0)
[12:49:01.240] Build status: STARTED
[12:49:01.240] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:8:0) after 5m0s
[12:54:02.165] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:8:0)
[12:54:02.195] Build status: STARTED
[12:54:02.195] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:9:0) after 2m30s
[12:56:32.232] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:9:0)
[12:56:32.263] Build status: STARTED
[12:56:32.263] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:10:0) after 9m19s
[13:05:51.301] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:10:0)
[13:05:51.337] Build status: STARTED
[13:05:51.337] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:11:0) after 1m1s
[13:06:52.345] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:11:0)
[13:06:52.394] Build status: STARTED
[13:06:52.394] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:12:0) after 8m3s
[13:14:55.498] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:12:0)
[13:14:55.531] Build status: STARTED
[13:14:55.531] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:13:0) after 8m17s
[13:23:12.743] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:13:0)
[13:23:12.778] Build status: STARTED
[13:23:12.778] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:14:0) after 3m18s
[13:26:30.804] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:14:0)
[13:26:30.834] Build status: STARTED
[13:26:30.834] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:15:0) after 5m1s
[13:31:31.857] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:15:0)
[13:31:31.887] Build status: STARTED
[13:31:31.887] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:16:0) after 4m33s
[13:36:04.919] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:16:0)
[13:36:04.947] Build status: STARTED
[13:36:04.947] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:17:0) after 9m28s
[13:45:32.983] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:17:0)
[13:45:33.046] Build status: STARTED
[13:45:33.046] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:18:0) after 1m13s
[13:46:46.167] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:18:0)
[13:46:46.215] Build status: STARTED
[13:46:46.215] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:19:0) after 7m9s
[13:53:55.440] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:19:0)
[13:53:55.518] Build status: STARTED
[13:53:55.518] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:20:0) after 9m46s
[14:03:41.776] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:20:0)
[14:03:41.830] Build status: STARTED
[14:03:41.830] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:21:0) after 6m17s
[14:09:58.965] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:21:0)
[14:09:59.002] Build status: STARTED
[14:09:59.002] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:22:0) after 9m6s
[14:19:04.996] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:22:0)
[14:19:05.035] Build status: STARTED
[14:19:05.035] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:23:0) after 6m52s
[14:25:57.055] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:23:0)
[14:25:57.089] Build status: STARTED
[14:25:57.089] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:24:0) after 3m48s
[14:29:45.223] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:24:0)
[14:29:45.299] Build status: STARTED
[14:29:45.300] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:25:0) after 7m38s
[14:37:23.432] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:25:0)
[14:37:23.575] Build status: STARTED
[14:37:23.575] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:26:0) after 4m7s
[14:41:30.608] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:26:0)
[14:41:30.637] Build status: STARTED
[14:41:30.637] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:27:0) after 7m44s
[14:49:14.843] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:27:0)
[14:49:14.895] Build status: STARTED
[14:49:14.895] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:28:0) after 1m5s
[14:50:19.938] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:28:0)
[14:50:19.970] Build status: STARTED
[14:50:19.970] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:29:0) after 2m57s
[14:53:17.187] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:29:0)
[14:53:17.225] Build status: STARTED
[14:53:17.225] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:30:0) after 1m25s
[14:54:42.254] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:30:0)
[14:54:42.363] Build status: STARTED
[14:54:42.363] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:31:0) after 6m50s
[15:01:32.484] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:31:0)
[15:01:32.513] Build status: STARTED
[15:01:32.513] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:32:0) after 2m58s
[15:04:30.556] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:32:0)
[15:04:30.585] Build status: STARTED
[15:04:30.585] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:33:0) after 6m53s
[15:11:23.613] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:33:0)
[15:11:23.758] Build status: STARTED
[15:11:23.758] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:34:0) after 2m16s
[15:13:40.039] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:34:0)
[15:13:40.101] Build status: STARTED
[15:13:40.101] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:35:0) after 9m55s
[15:23:35.224] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:35:0)
[15:23:35.258] Build status: STARTED
[15:23:35.258] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:36:0) after 3m39s
[15:27:14.278] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:36:0)
[15:27:14.318] Build status: STARTED
[15:27:14.318] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:37:0) after 9m32s
[15:36:46.434] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:37:0)
[15:36:46.467] Build status: STARTED
[15:36:46.467] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:38:0) after 2m11s
[15:38:57.550] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:38:0)
[15:38:57.581] Build status: STARTED
[15:38:57.581] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:39:0) after 9m51s
[15:48:48.684] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:39:0)
[15:48:48.715] Build status: STARTED
[15:48:48.715] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:40:0) after 2m10s
[15:50:58.733] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:40:0)
[15:50:58.761] Build status: STARTED
[15:50:58.761] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:41:0) after 1m0s
[15:51:58.789] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:41:0)
[15:51:58.820] Build status: STARTED
[15:51:58.820] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:42:0) after 8m40s
[16:00:38.948] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:42:0)
[16:00:38.984] Build status: STARTED
[16:00:38.984] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:43:0) after 2m55s
[16:03:34.161] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:43:0)
[16:03:34.261] Build status: STARTED
[16:03:34.261] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:44:0) after 4m53s
[16:08:27.352] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:44:0)
[16:08:27.388] Build status: STARTED
[16:08:27.388] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:45:0) after 2m27s
[16:10:54.542] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:45:0)
[16:10:54.590] Build status: STARTED
[16:10:54.590] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:46:0) after 1m0s
[16:11:54.742] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:46:0)
[16:11:54.857] Build status: STARTED
[16:11:54.857] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:47:0) after 8m30s
[16:20:25.072] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:47:0)
[16:20:25.182] Build status: STARTED
[16:20:25.182] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:48:0) after 3m38s
[16:24:03.209] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:48:0)
[16:24:03.241] Build status: STARTED
[16:24:03.241] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:49:0) after 7m40s
[16:31:43.357] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:49:0)
[16:31:43.394] Build status: STARTED
[16:31:43.395] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:50:0) after 2m21s
[16:34:04.567] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:50:0)
[16:34:04.596] Build status: STARTED
[16:34:04.596] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:51:0) after 4m11s
[16:38:15.737] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:51:0)
[16:38:15.779] Build status: STARTED
[16:38:15.779] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:52:0) after 1m48s
[16:40:03.933] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:52:0)
[16:40:03.975] Build status: STARTED
[16:40:03.975] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:53:0) after 1m35s
[16:41:39.003] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:53:0)
[16:41:39.091] Build status: STARTED
[16:41:39.091] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:54:0) after 3m48s
[16:45:27.368] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:54:0)
[16:45:27.413] Build status: STARTED
[16:45:27.413] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:55:0) after 4m55s
[16:50:22.435] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:55:0)
[16:50:22.481] Build status: STARTED
[16:50:22.481] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:56:0) after 6m1s
[16:56:23.611] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:56:0)
[16:56:23.655] Build status: STARTED
[16:56:23.655] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:57:0) after 8m11s
[17:04:34.857] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:57:0)
[17:04:34.923] Build status: STARTED
[17:04:34.923] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:58:0) after 3m1s
[17:07:36.290] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:58:0)
[17:07:36.338] Build status: STARTED
[17:07:36.338] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:59:0) after 7m12s
[17:14:48.363] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:59:0)
[17:14:48.459] Build status: STARTED
[17:14:48.459] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:60:0) after 2m39s
[17:17:27.640] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:60:0)
[17:17:27.742] Build status: STARTED
[17:17:27.743] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:61:0) after 2m4s
[17:19:31.771] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:61:0)
[17:19:31.809] Build status: STARTED
[17:19:31.809] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:62:0) after 3m27s
[17:22:58.858] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:62:0)
[17:22:58.901] Build status: STARTED
[17:22:58.901] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:63:0) after 7m49s
[17:30:48.052] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:63:0)
[17:30:48.109] Build status: STARTED
[17:30:48.109] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:64:0) after 9m39s
[17:40:27.440] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:64:0)
[17:40:27.578] Build status: STARTED
[17:40:27.578] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:65:0) after 7m24s
[17:47:51.565] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:65:0)
[17:47:51.604] Build status: STARTED
[17:47:51.604] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001634142460182368:66:0) after 9m22s
[17:56:23.568] Received PubSub notification, asking Buildbucket for the build status
[17:56:23.661] Build:
{
"id": "8836204080443866017",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23086,
"createdBy": "project:chromium",
"createTime": "2021-09-13T12:28:56.164913481Z",
"startTime": "2021-09-13T12:32:28.058288Z",
"endTime": "2021-09-13T17:56:23.231792373Z",
"updateTime": "2021-09-13T17:56:23.232364405Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3347fb0a6001612b2927b2cf491a8e6b845a8e8c",
"ref": "refs/heads/main"
}
}
}
[17:56:23.661] Invocation finished in 5h27m28.803432275s with status FAILED