[02:19:58.766] New invocation is queued and will start shortly
[02:19:59.893] Starting the invocation (attempt 1)
[02:19:59.937] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/737e0130ec8378934a175182243937813fe4884f"
[02:19:59.937] Popped gitiles commit info from properties and tags
[02:19:59.937] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[02:19:59.938] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[02:19:59.938] Buildbucket request:
{
"requestId": "8959997848799490240",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "737e0130ec8378934a175182243937813fe4884f",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8959997848799490240"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[02:20:00.615] Scheduled build:
{
"id": "8794567786818797649",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 28331,
"createdBy": "project:chromium",
"createTime": "2022-12-17T02:20:00.025193831Z",
"updateTime": "2022-12-17T02:20:00.025193831Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "737e0130ec8378934a175182243937813fe4884f",
"ref": "refs/heads/main"
}
}
}
[02:20:00.615] Task URL: https://cr-buildbucket.appspot.com/build/8794567786818797649
[02:20:00.616] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:2:0) after 9m6s
[02:22:22.458] Received PubSub notification, asking Buildbucket for the build status
[02:22:22.484] Build status: STARTED
[02:29:07.008] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:2:0)
[02:29:07.091] Build status: STARTED
[02:29:07.091] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:4:0) after 9m16s
[02:38:23.164] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:4:0)
[02:38:23.186] Build status: STARTED
[02:38:23.187] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:5:0) after 5m41s
[02:44:04.360] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:5:0)
[02:44:04.392] Build status: STARTED
[02:44:04.392] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:6:0) after 5m10s
[02:49:14.415] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:6:0)
[02:49:14.441] Build status: STARTED
[02:49:14.441] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:7:0) after 3m39s
[02:52:53.417] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:7:0)
[02:52:53.439] Build status: STARTED
[02:52:53.439] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:8:0) after 2m59s
[02:55:52.494] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:8:0)
[02:55:52.518] Build status: STARTED
[02:55:52.518] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:9:0) after 5m14s
[03:01:06.554] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:9:0)
[03:01:06.577] Build status: STARTED
[03:01:06.577] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:10:0) after 2m7s
[03:03:13.819] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:10:0)
[03:03:13.843] Build status: STARTED
[03:03:13.843] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:11:0) after 4m50s
[03:08:03.895] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:11:0)
[03:08:03.929] Build status: STARTED
[03:08:03.929] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:12:0) after 6m47s
[03:14:51.252] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:12:0)
[03:14:51.283] Build status: STARTED
[03:14:51.283] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:13:0) after 5m50s
[03:20:41.315] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:13:0)
[03:20:41.339] Build status: STARTED
[03:20:41.339] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:14:0) after 2m0s
[03:22:41.452] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:14:0)
[03:22:41.481] Build status: STARTED
[03:22:41.481] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:15:0) after 3m1s
[03:25:42.731] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:15:0)
[03:25:42.755] Build status: STARTED
[03:25:42.755] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:16:0) after 9m23s
[03:35:06.013] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:16:0)
[03:35:06.057] Build status: STARTED
[03:35:06.057] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:17:0) after 9m13s
[03:44:19.790] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:17:0)
[03:44:19.816] Build status: STARTED
[03:44:19.816] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:18:0) after 1m22s
[03:45:41.839] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:18:0)
[03:45:41.860] Build status: STARTED
[03:45:41.860] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:19:0) after 1m19s
[03:47:00.886] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:19:0)
[03:47:00.910] Build status: STARTED
[03:47:00.910] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:20:0) after 8m6s
[03:55:07.102] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:20:0)
[03:55:07.127] Build status: STARTED
[03:55:07.127] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:21:0) after 9m31s
[04:04:38.153] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:21:0)
[04:04:38.178] Build status: STARTED
[04:04:38.178] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:22:0) after 5m31s
[04:10:09.556] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:22:0)
[04:10:09.580] Build status: STARTED
[04:10:09.580] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:23:0) after 1m29s
[04:11:38.616] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:23:0)
[04:11:38.644] Build status: STARTED
[04:11:38.644] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:24:0) after 2m41s
[04:14:19.695] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:24:0)
[04:14:19.719] Build status: STARTED
[04:14:19.719] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:25:0) after 7m26s
[04:21:45.839] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:25:0)
[04:21:45.865] Build status: STARTED
[04:21:45.866] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:26:0) after 3m31s
[04:25:17.003] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:26:0)
[04:25:17.025] Build status: STARTED
[04:25:17.025] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:27:0) after 5m9s
[04:30:26.040] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:27:0)
[04:30:26.063] Build status: STARTED
[04:30:26.063] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:28:0) after 9m8s
[04:39:34.121] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:28:0)
[04:39:34.146] Build status: STARTED
[04:39:34.146] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:29:0) after 7m54s
[04:47:28.204] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:29:0)
[04:47:28.226] Build status: STARTED
[04:47:28.226] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:30:0) after 8m21s
[04:55:49.256] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:30:0)
[04:55:49.278] Build status: STARTED
[04:55:49.278] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:31:0) after 6m54s
[05:02:43.303] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:31:0)
[05:02:43.329] Build status: STARTED
[05:02:43.330] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:32:0) after 1m29s
[05:04:12.356] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:32:0)
[05:04:12.419] Build status: STARTED
[05:04:12.419] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:33:0) after 6m34s
[05:10:46.448] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:33:0)
[05:10:46.472] Build status: STARTED
[05:10:46.472] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:34:0) after 9m51s
[05:20:37.516] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:34:0)
[05:20:37.542] Build status: STARTED
[05:20:37.542] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:35:0) after 3m33s
[05:24:10.632] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:35:0)
[05:24:10.674] Build status: STARTED
[05:24:10.674] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:36:0) after 6m32s
[05:30:42.862] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:36:0)
[05:30:42.887] Build status: STARTED
[05:30:42.887] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:37:0) after 5m59s
[05:36:42.018] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:37:0)
[05:36:42.041] Build status: STARTED
[05:36:42.041] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:38:0) after 1m42s
[05:38:24.164] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:38:0)
[05:38:24.190] Build status: STARTED
[05:38:24.190] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:39:0) after 2m45s
[05:41:09.267] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:39:0)
[05:41:09.327] Build status: STARTED
[05:41:09.327] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:40:0) after 7m18s
[05:48:27.468] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:40:0)
[05:48:27.534] Build status: STARTED
[05:48:27.534] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:41:0) after 8m14s
[05:56:41.594] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:41:0)
[05:56:41.618] Build status: STARTED
[05:56:41.618] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:42:0) after 7m41s
[06:04:22.676] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:42:0)
[06:04:22.702] Build status: STARTED
[06:04:22.702] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:43:0) after 9m30s
[06:13:52.724] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:43:0)
[06:13:52.746] Build status: STARTED
[06:13:52.746] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:44:0) after 2m32s
[06:16:24.804] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:44:0)
[06:16:24.831] Build status: STARTED
[06:16:24.831] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:45:0) after 2m46s
[06:19:10.832] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:45:0)
[06:19:10.855] Build status: STARTED
[06:19:10.855] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:46:0) after 6m5s
[06:25:15.984] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:46:0)
[06:25:16.038] Build status: STARTED
[06:25:16.038] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:47:0) after 8m15s
[06:33:31.196] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:47:0)
[06:33:31.220] Build status: STARTED
[06:33:31.220] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:48:0) after 7m20s
[06:40:51.405] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:48:0)
[06:40:51.428] Build status: STARTED
[06:40:51.428] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:49:0) after 9m37s
[06:50:28.454] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:49:0)
[06:50:28.477] Build status: STARTED
[06:50:28.477] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:50:0) after 5m26s
[06:55:54.501] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:50:0)
[06:55:54.526] Build status: STARTED
[06:55:54.526] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:51:0) after 8m18s
[07:04:12.612] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:51:0)
[07:04:12.651] Build status: STARTED
[07:04:12.651] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:52:0) after 3m20s
[07:07:32.816] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:52:0)
[07:07:32.844] Build status: STARTED
[07:07:32.844] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:53:0) after 1m53s
[07:09:26.216] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:53:0)
[07:09:26.240] Build status: STARTED
[07:09:26.240] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:54:0) after 3m10s
[07:12:36.263] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:54:0)
[07:12:36.300] Build status: STARTED
[07:12:36.300] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:55:0) after 2m46s
[07:15:22.469] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:55:0)
[07:15:22.490] Build status: STARTED
[07:15:22.490] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:56:0) after 7m19s
[07:22:41.758] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:56:0)
[07:22:41.788] Build status: STARTED
[07:22:41.788] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:57:0) after 6m2s
[07:28:43.812] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:57:0)
[07:28:43.836] Build status: STARTED
[07:28:43.836] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:58:0) after 9m57s
[07:38:40.880] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:58:0)
[07:38:40.909] Build status: STARTED
[07:38:40.910] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:59:0) after 7m0s
[07:45:40.950] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:59:0)
[07:45:40.973] Build status: STARTED
[07:45:40.973] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:60:0) after 2m3s
[07:47:44.096] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:60:0)
[07:47:44.254] Build status: STARTED
[07:47:44.254] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:61:0) after 2m7s
[07:49:51.338] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:61:0)
[07:49:51.360] Build status: STARTED
[07:49:51.360] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:62:0) after 5m7s
[07:54:58.383] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:62:0)
[07:54:58.460] Build status: STARTED
[07:54:58.460] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:63:0) after 8m24s
[08:03:22.592] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:63:0)
[08:03:22.620] Build status: STARTED
[08:03:22.620] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8959997848799490240:64:0) after 3m35s
[08:03:52.905] Received PubSub notification, asking Buildbucket for the build status
[08:03:52.959] Build:
{
"id": "8794567786818797649",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 28331,
"createdBy": "project:chromium",
"createTime": "2022-12-17T02:20:00.025193831Z",
"startTime": "2022-12-17T02:22:21.054737Z",
"endTime": "2022-12-17T08:03:52.214561687Z",
"updateTime": "2022-12-17T08:03:52.214561687Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "737e0130ec8378934a175182243937813fe4884f",
"ref": "refs/heads/main"
}
}
}
[08:03:52.959] Invocation finished in 5h43m54.207553535s with status FAILED