[10:52:39.979] New invocation is queued and will start shortly
[10:52:41.058] Starting the invocation (attempt 1)
[10:52:41.098] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/3a6d8c36cf29654f74616810765c24747e9e8a4f"
[10:52:41.098] Popped gitiles commit info from properties and tags
[10:52:41.098] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[10:52:41.098] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[10:52:41.098] Buildbucket request:
{
"requestId": "9002274376640732096",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3a6d8c36cf29654f74616810765c24747e9e8a4f",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9002274376640732096"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[10:52:41.648] Scheduled build:
{
"id": "8836844314712057857",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23054,
"createdBy": "project:chromium",
"createTime": "2021-09-06T10:52:41.186902383Z",
"updateTime": "2021-09-06T10:52:41.436869329Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3a6d8c36cf29654f74616810765c24747e9e8a4f",
"ref": "refs/heads/main"
}
}
}
[10:52:41.648] Task URL: https://cr-buildbucket.appspot.com/build/8836844314712057857
[10:52:41.648] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:2:0) after 4m33s
[10:55:04.789] Received PubSub notification, asking Buildbucket for the build status
[10:55:04.833] Build status: STARTED
[10:57:14.769] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:2:0)
[10:57:14.809] Build status: STARTED
[10:57:14.809] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:4:0) after 7m9s
[11:04:23.833] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:4:0)
[11:04:23.874] Build status: STARTED
[11:04:23.874] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:5:0) after 3m8s
[11:07:32.018] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:5:0)
[11:07:32.085] Build status: STARTED
[11:07:32.085] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:6:0) after 1m3s
[11:08:35.226] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:6:0)
[11:08:35.273] Build status: STARTED
[11:08:35.273] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:7:0) after 3m5s
[11:11:40.303] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:7:0)
[11:11:40.353] Build status: STARTED
[11:11:40.353] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:8:0) after 8m50s
[11:20:30.528] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:8:0)
[11:20:30.564] Build status: STARTED
[11:20:30.564] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:9:0) after 2m4s
[11:22:34.584] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:9:0)
[11:22:34.617] Build status: STARTED
[11:22:34.617] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:10:0) after 1m58s
[11:24:32.680] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:10:0)
[11:24:32.711] Build status: STARTED
[11:24:32.711] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:11:0) after 4m28s
[11:29:00.732] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:11:0)
[11:29:00.768] Build status: STARTED
[11:29:00.768] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:12:0) after 9m19s
[11:38:19.788] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:12:0)
[11:38:19.833] Build status: STARTED
[11:38:19.833] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:13:0) after 8m54s
[11:47:14.208] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:13:0)
[11:47:14.236] Build status: STARTED
[11:47:14.236] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:14:0) after 4m15s
[11:51:29.291] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:14:0)
[11:51:29.322] Build status: STARTED
[11:51:29.322] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:15:0) after 1m54s
[11:53:23.399] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:15:0)
[11:53:23.431] Build status: STARTED
[11:53:23.431] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:16:0) after 9m50s
[12:03:13.404] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:16:0)
[12:03:13.430] Build status: STARTED
[12:03:13.430] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:17:0) after 1m12s
[12:04:25.494] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:17:0)
[12:04:25.531] Build status: STARTED
[12:04:25.531] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:18:0) after 9m50s
[12:14:15.551] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:18:0)
[12:14:15.580] Build status: STARTED
[12:14:15.580] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:19:0) after 1m34s
[12:15:49.740] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:19:0)
[12:15:49.808] Build status: STARTED
[12:15:49.808] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:20:0) after 3m22s
[12:19:11.855] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:20:0)
[12:19:11.895] Build status: STARTED
[12:19:11.895] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:21:0) after 6m8s
[12:25:20.162] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:21:0)
[12:25:20.215] Build status: STARTED
[12:25:20.215] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:22:0) after 3m55s
[12:29:15.234] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:22:0)
[12:29:15.263] Build status: STARTED
[12:29:15.263] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:23:0) after 7m29s
[12:36:44.385] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:23:0)
[12:36:44.430] Build status: STARTED
[12:36:44.430] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:24:0) after 1m40s
[12:38:24.460] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:24:0)
[12:38:24.492] Build status: STARTED
[12:38:24.492] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:25:0) after 5m20s
[12:43:44.517] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:25:0)
[12:43:44.580] Build status: STARTED
[12:43:44.580] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:26:0) after 8m24s
[12:52:08.610] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:26:0)
[12:52:08.649] Build status: STARTED
[12:52:08.649] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:27:0) after 8m9s
[13:00:17.796] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:27:0)
[13:00:17.830] Build status: STARTED
[13:00:17.830] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:28:0) after 8m41s
[13:08:59.157] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:28:0)
[13:08:59.199] Build status: STARTED
[13:08:59.199] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:29:0) after 1m41s
[13:10:40.310] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:29:0)
[13:10:40.364] Build status: STARTED
[13:10:40.365] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:30:0) after 8m47s
[13:19:27.391] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:30:0)
[13:19:27.423] Build status: STARTED
[13:19:27.423] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:31:0) after 4m41s
[13:24:08.503] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:31:0)
[13:24:08.538] Build status: STARTED
[13:24:08.538] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:32:0) after 3m2s
[13:27:10.606] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:32:0)
[13:27:10.637] Build status: STARTED
[13:27:10.637] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:33:0) after 9m57s
[13:37:07.661] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:33:0)
[13:37:07.704] Build status: STARTED
[13:37:07.704] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:34:0) after 3m5s
[13:40:12.731] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:34:0)
[13:40:12.771] Build status: STARTED
[13:40:12.771] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:35:0) after 3m50s
[13:44:02.886] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:35:0)
[13:44:02.926] Build status: STARTED
[13:44:02.926] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:36:0) after 1m11s
[13:45:13.948] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:36:0)
[13:45:14.047] Build status: STARTED
[13:45:14.047] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:37:0) after 4m18s
[13:49:32.443] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:37:0)
[13:49:32.473] Build status: STARTED
[13:49:32.473] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:38:0) after 8m35s
[13:58:07.673] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:38:0)
[13:58:07.703] Build status: STARTED
[13:58:07.703] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:39:0) after 1m18s
[13:59:25.824] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:39:0)
[13:59:25.858] Build status: STARTED
[13:59:25.858] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:40:0) after 3m48s
[14:03:13.986] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:40:0)
[14:03:14.021] Build status: STARTED
[14:03:14.021] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:41:0) after 2m56s
[14:06:10.046] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:41:0)
[14:06:10.078] Build status: STARTED
[14:06:10.078] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:42:0) after 9m46s
[14:15:56.104] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:42:0)
[14:15:56.137] Build status: STARTED
[14:15:56.137] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:43:0) after 7m55s
[14:23:51.177] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:43:0)
[14:23:51.208] Build status: STARTED
[14:23:51.208] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:44:0) after 2m16s
[14:26:07.448] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:44:0)
[14:26:07.508] Build status: STARTED
[14:26:07.508] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:45:0) after 3m59s
[14:30:06.529] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:45:0)
[14:30:06.594] Build status: STARTED
[14:30:06.594] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:46:0) after 3m37s
[14:33:43.618] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:46:0)
[14:33:43.645] Build status: STARTED
[14:33:43.645] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:47:0) after 6m21s
[14:40:04.776] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:47:0)
[14:40:04.813] Build status: STARTED
[14:40:04.813] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:48:0) after 9m59s
[14:50:03.867] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:48:0)
[14:50:03.897] Build status: STARTED
[14:50:03.897] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:49:0) after 4m55s
[14:54:58.963] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:49:0)
[14:54:59.002] Build status: STARTED
[14:54:59.002] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:50:0) after 4m26s
[14:59:25.171] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:50:0)
[14:59:25.202] Build status: STARTED
[14:59:25.202] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:51:0) after 2m30s
[15:01:55.463] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:51:0)
[15:01:55.493] Build status: STARTED
[15:01:55.493] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:52:0) after 5m29s
[15:07:24.714] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:52:0)
[15:07:24.756] Build status: STARTED
[15:07:24.756] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:53:0) after 8m2s
[15:15:26.751] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:53:0)
[15:15:26.786] Build status: STARTED
[15:15:26.786] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:54:0) after 4m19s
[15:19:45.813] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:54:0)
[15:19:45.845] Build status: STARTED
[15:19:45.845] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:55:0) after 5m16s
[15:25:01.901] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:55:0)
[15:25:01.935] Build status: STARTED
[15:25:01.935] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:56:0) after 1m41s
[15:26:43.018] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:56:0)
[15:26:43.072] Build status: STARTED
[15:26:43.072] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:57:0) after 9m13s
[15:35:56.199] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:57:0)
[15:35:56.231] Build status: STARTED
[15:35:56.231] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:58:0) after 5m41s
[15:41:37.331] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:58:0)
[15:41:37.364] Build status: STARTED
[15:41:37.364] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:59:0) after 2m49s
[15:44:26.747] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:59:0)
[15:44:26.779] Build status: STARTED
[15:44:26.780] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:60:0) after 7m1s
[15:51:27.784] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:60:0)
[15:51:27.820] Build status: STARTED
[15:51:27.820] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:61:0) after 2m53s
[15:54:20.894] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:61:0)
[15:54:20.928] Build status: STARTED
[15:54:20.928] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:62:0) after 9m38s
[16:03:58.950] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:62:0)
[16:03:58.977] Build status: STARTED
[16:03:58.977] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:63:0) after 7m11s
[16:11:10.101] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:63:0)
[16:11:10.133] Build status: STARTED
[16:11:10.133] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002274376640732096:64:0) after 3m3s
[16:12:59.156] Received PubSub notification, asking Buildbucket for the build status
[16:12:59.196] Build:
{
"id": "8836844314712057857",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23054,
"createdBy": "project:chromium",
"createTime": "2021-09-06T10:52:41.186902383Z",
"startTime": "2021-09-06T10:55:04.153421Z",
"endTime": "2021-09-06T16:12:58.670361096Z",
"updateTime": "2021-09-06T16:12:58.670742690Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3a6d8c36cf29654f74616810765c24747e9e8a4f",
"ref": "refs/heads/main"
}
}
}
[16:12:59.196] Invocation finished in 5h20m19.233462666s with status FAILED