[11:33:34.114] New invocation is queued and will start shortly
[11:33:35.211] Starting the invocation (attempt 1)
[11:33:35.260] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/154c35a60296b384102c2755313dd8415ecddbdf"
[11:33:35.260] Popped gitiles commit info from properties and tags
[11:33:35.260] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[11:33:35.260] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[11:33:35.260] Buildbucket request:
{
"requestId": "8945467505355561936",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "154c35a60296b384102c2755313dd8415ecddbdf",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8945467505355561936"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[11:33:35.660] Scheduled build:
{
"id": "8780037443422953697",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29480,
"createdBy": "project:chromium",
"createTime": "2023-05-26T11:33:35.330309122Z",
"updateTime": "2023-05-26T11:33:35.330309122Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "154c35a60296b384102c2755313dd8415ecddbdf",
"ref": "refs/heads/main"
}
}
}
[11:33:35.660] Task URL: https://cr-buildbucket.appspot.com/build/8780037443422953697
[11:33:35.660] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:2:0) after 9m5s
[11:36:21.002] Received PubSub notification, asking Buildbucket for the build status
[11:36:21.025] Build status: STARTED
[11:42:41.059] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:2:0)
[11:42:41.104] Build status: STARTED
[11:42:41.104] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:4:0) after 4m40s
[11:47:21.886] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:4:0)
[11:47:21.901] Build status: STARTED
[11:47:21.901] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:5:0) after 3m35s
[11:50:56.919] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:5:0)
[11:50:56.951] Build status: STARTED
[11:50:56.951] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:6:0) after 3m48s
[11:54:44.923] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:6:0)
[11:54:44.971] Build status: STARTED
[11:54:44.971] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:7:0) after 2m23s
[11:57:07.949] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:7:0)
[11:57:07.972] Build status: STARTED
[11:57:07.972] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:8:0) after 2m26s
[11:59:33.991] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:8:0)
[11:59:34.021] Build status: STARTED
[11:59:34.021] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:9:0) after 2m3s
[12:01:37.041] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:9:0)
[12:01:37.157] Build status: STARTED
[12:01:37.157] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:10:0) after 3m40s
[12:05:17.176] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:10:0)
[12:05:17.194] Build status: STARTED
[12:05:17.194] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:11:0) after 7m13s
[12:12:30.326] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:11:0)
[12:12:30.353] Build status: STARTED
[12:12:30.353] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:12:0) after 3m36s
[12:16:06.456] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:12:0)
[12:16:06.475] Build status: STARTED
[12:16:06.475] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:13:0) after 1m40s
[12:17:46.585] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:13:0)
[12:17:46.607] Build status: STARTED
[12:17:46.608] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:14:0) after 7m26s
[12:25:12.640] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:14:0)
[12:25:12.658] Build status: STARTED
[12:25:12.658] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:15:0) after 3m0s
[12:28:12.669] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:15:0)
[12:28:12.688] Build status: STARTED
[12:28:12.688] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:16:0) after 9m31s
[12:37:43.774] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:16:0)
[12:37:43.794] Build status: STARTED
[12:37:43.794] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:17:0) after 1m47s
[12:39:30.820] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:17:0)
[12:39:30.850] Build status: STARTED
[12:39:30.850] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:18:0) after 4m31s
[12:44:01.869] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:18:0)
[12:44:01.886] Build status: STARTED
[12:44:01.886] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:19:0) after 7m9s
[12:51:11.029] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:19:0)
[12:51:11.053] Build status: STARTED
[12:51:11.053] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:20:0) after 3m50s
[12:55:01.483] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:20:0)
[12:55:01.544] Build status: STARTED
[12:55:01.544] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:21:0) after 3m17s
[12:58:18.597] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:21:0)
[12:58:18.616] Build status: STARTED
[12:58:18.616] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:22:0) after 3m26s
[13:01:44.736] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:22:0)
[13:01:44.761] Build status: STARTED
[13:01:44.761] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:23:0) after 1m14s
[13:02:58.955] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:23:0)
[13:02:58.982] Build status: STARTED
[13:02:58.982] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:24:0) after 5m18s
[13:08:17.411] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:24:0)
[13:08:17.429] Build status: STARTED
[13:08:17.429] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:25:0) after 8m50s
[13:17:07.871] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:25:0)
[13:17:07.888] Build status: STARTED
[13:17:07.888] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:26:0) after 3m42s
[13:20:50.138] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:26:0)
[13:20:50.188] Build status: STARTED
[13:20:50.188] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:27:0) after 7m51s
[13:28:41.224] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:27:0)
[13:28:41.247] Build status: STARTED
[13:28:41.248] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:28:0) after 2m48s
[13:31:29.370] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:28:0)
[13:31:29.394] Build status: STARTED
[13:31:29.394] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:29:0) after 8m41s
[13:40:10.648] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:29:0)
[13:40:10.760] Build status: STARTED
[13:40:10.760] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:30:0) after 7m48s
[13:47:58.780] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:30:0)
[13:47:58.808] Build status: STARTED
[13:47:58.808] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:31:0) after 7m12s
[13:55:10.826] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:31:0)
[13:55:10.852] Build status: STARTED
[13:55:10.852] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:32:0) after 8m11s
[14:03:22.155] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:32:0)
[14:03:22.202] Build status: STARTED
[14:03:22.202] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:33:0) after 3m13s
[14:06:35.270] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:33:0)
[14:06:35.313] Build status: STARTED
[14:06:35.313] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:34:0) after 5m44s
[14:12:19.430] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:34:0)
[14:12:19.450] Build status: STARTED
[14:12:19.450] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:35:0) after 6m13s
[14:18:32.467] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:35:0)
[14:18:32.489] Build status: STARTED
[14:18:32.489] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:36:0) after 5m18s
[14:23:50.565] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:36:0)
[14:23:50.590] Build status: STARTED
[14:23:50.590] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:37:0) after 9m50s
[14:33:40.898] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:37:0)
[14:33:40.922] Build status: STARTED
[14:33:40.922] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:38:0) after 9m6s
[14:42:47.314] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:38:0)
[14:42:47.333] Build status: STARTED
[14:42:47.333] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:39:0) after 2m51s
[14:45:38.356] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:39:0)
[14:45:38.406] Build status: STARTED
[14:45:38.406] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:40:0) after 9m20s
[14:54:58.439] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:40:0)
[14:54:58.462] Build status: STARTED
[14:54:58.462] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:41:0) after 6m9s
[15:01:07.480] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:41:0)
[15:01:07.505] Build status: STARTED
[15:01:07.505] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:42:0) after 1m26s
[15:02:33.523] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:42:0)
[15:02:33.545] Build status: STARTED
[15:02:33.545] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:43:0) after 5m56s
[15:08:29.625] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:43:0)
[15:08:29.713] Build status: STARTED
[15:08:29.713] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:44:0) after 4m54s
[15:13:23.731] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:44:0)
[15:13:23.757] Build status: STARTED
[15:13:23.757] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:45:0) after 5m26s
[15:18:49.951] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:45:0)
[15:18:50.023] Build status: STARTED
[15:18:50.023] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:46:0) after 1m11s
[15:20:01.328] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:46:0)
[15:20:01.351] Build status: STARTED
[15:20:01.351] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:47:0) after 5m53s
[15:25:54.482] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:47:0)
[15:25:54.500] Build status: STARTED
[15:25:54.500] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:48:0) after 7m53s
[15:33:47.747] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:48:0)
[15:33:47.779] Build status: STARTED
[15:33:47.779] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:49:0) after 5m39s
[15:39:26.840] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:49:0)
[15:39:26.859] Build status: STARTED
[15:39:26.859] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:50:0) after 8m56s
[15:48:22.894] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:50:0)
[15:48:22.918] Build status: STARTED
[15:48:22.918] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:51:0) after 8m26s
[15:56:48.942] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:51:0)
[15:56:48.961] Build status: STARTED
[15:56:48.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:52:0) after 5m59s
[16:02:47.993] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:52:0)
[16:02:48.016] Build status: STARTED
[16:02:48.016] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:53:0) after 4m30s
[16:07:18.198] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:53:0)
[16:07:18.230] Build status: STARTED
[16:07:18.230] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:54:0) after 1m5s
[16:08:23.249] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:54:0)
[16:08:23.277] Build status: STARTED
[16:08:23.277] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:55:0) after 3m33s
[16:11:56.365] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:55:0)
[16:11:56.389] Build status: STARTED
[16:11:56.389] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:56:0) after 6m17s
[16:18:13.410] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:56:0)
[16:18:13.482] Build status: STARTED
[16:18:13.482] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:57:0) after 9m55s
[16:28:08.667] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:57:0)
[16:28:08.687] Build status: STARTED
[16:28:08.687] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:58:0) after 6m52s
[16:35:00.736] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:58:0)
[16:35:00.784] Build status: STARTED
[16:35:00.784] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:59:0) after 6m7s
[16:41:07.938] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:59:0)
[16:41:07.965] Build status: STARTED
[16:41:07.965] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:60:0) after 8m15s
[16:49:23.310] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:60:0)
[16:49:23.327] Build status: STARTED
[16:49:23.327] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:61:0) after 3m30s
[16:52:53.338] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:61:0)
[16:52:53.361] Build status: STARTED
[16:52:53.361] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:62:0) after 3m30s
[16:56:24.103] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:62:0)
[16:56:24.128] Build status: STARTED
[16:56:24.128] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:63:0) after 1m30s
[16:57:54.396] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:63:0)
[16:57:54.412] Build status: STARTED
[16:57:54.413] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945467505355561936:64:0) after 9m49s
[16:59:36.826] Received PubSub notification, asking Buildbucket for the build status
[16:59:36.847] Build:
{
"id": "8780037443422953697",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29480,
"createdBy": "project:chromium",
"createTime": "2023-05-26T11:33:35.330309122Z",
"startTime": "2023-05-26T11:36:20.127086Z",
"endTime": "2023-05-26T16:59:36.449227241Z",
"updateTime": "2023-05-26T16:59:36.449227241Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "154c35a60296b384102c2755313dd8415ecddbdf",
"ref": "refs/heads/main"
}
}
}
[16:59:36.847] Invocation finished in 5h26m2.743704951s with status FAILED