[04:08:39.110] New invocation is queued and will start shortly
[04:08:40.462] Starting the invocation (attempt 1)
[04:08:40.494] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/5a69df495a2d2872fa4dbb08095e4e3610ceb7cd"
[04:08:40.494] Popped gitiles commit info from properties and tags
[04:08:40.494] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[04:08:40.495] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[04:08:40.495] Buildbucket request:
{
"requestId": "8953649224070622704",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5a69df495a2d2872fa4dbb08095e4e3610ceb7cd",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8953649224070622704"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[04:08:41.058] Scheduled build:
{
"id": "8788219161732369057",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 28993,
"createdBy": "project:chromium",
"createTime": "2023-02-25T04:08:40.714828147Z",
"updateTime": "2023-02-25T04:08:40.714828147Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5a69df495a2d2872fa4dbb08095e4e3610ceb7cd",
"ref": "refs/heads/main"
}
}
}
[04:08:41.058] Task URL: https://cr-buildbucket.appspot.com/build/8788219161732369057
[04:08:41.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:2:0) after 3m31s
[04:11:10.189] Received PubSub notification, asking Buildbucket for the build status
[04:11:10.212] Build status: STARTED
[04:12:12.288] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:2:0)
[04:12:12.359] Build status: STARTED
[04:12:12.359] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:4:0) after 5m58s
[04:18:10.433] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:4:0)
[04:18:10.456] Build status: STARTED
[04:18:10.456] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:5:0) after 8m57s
[04:27:07.428] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:5:0)
[04:27:07.458] Build status: STARTED
[04:27:07.458] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:6:0) after 1m1s
[04:28:08.525] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:6:0)
[04:28:08.601] Build status: STARTED
[04:28:08.601] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:7:0) after 9m34s
[04:37:42.620] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:7:0)
[04:37:42.640] Build status: STARTED
[04:37:42.640] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:8:0) after 2m13s
[04:39:55.666] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:8:0)
[04:39:55.733] Build status: STARTED
[04:39:55.733] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:9:0) after 1m26s
[04:41:21.960] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:9:0)
[04:41:21.984] Build status: STARTED
[04:41:21.984] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:10:0) after 4m54s
[04:46:16.003] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:10:0)
[04:46:16.028] Build status: STARTED
[04:46:16.028] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:11:0) after 2m22s
[04:48:38.148] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:11:0)
[04:48:38.167] Build status: STARTED
[04:48:38.167] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:12:0) after 3m28s
[04:52:06.185] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:12:0)
[04:52:06.209] Build status: STARTED
[04:52:06.209] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:13:0) after 5m15s
[04:57:21.233] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:13:0)
[04:57:21.253] Build status: STARTED
[04:57:21.254] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:14:0) after 9m26s
[05:06:47.279] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:14:0)
[05:06:47.307] Build status: STARTED
[05:06:47.307] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:15:0) after 3m27s
[05:10:14.368] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:15:0)
[05:10:14.389] Build status: STARTED
[05:10:14.389] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:16:0) after 4m43s
[05:14:57.407] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:16:0)
[05:14:57.473] Build status: STARTED
[05:14:57.473] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:17:0) after 4m6s
[05:19:03.511] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:17:0)
[05:19:03.529] Build status: STARTED
[05:19:03.529] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:18:0) after 1m52s
[05:20:55.546] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:18:0)
[05:20:55.568] Build status: STARTED
[05:20:55.568] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:19:0) after 3m17s
[05:24:12.666] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:19:0)
[05:24:12.689] Build status: STARTED
[05:24:12.689] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:20:0) after 8m44s
[05:32:56.782] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:20:0)
[05:32:56.802] Build status: STARTED
[05:32:56.802] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:21:0) after 4m57s
[05:37:53.850] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:21:0)
[05:37:53.870] Build status: STARTED
[05:37:53.870] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:22:0) after 4m39s
[05:42:32.891] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:22:0)
[05:42:32.928] Build status: STARTED
[05:42:32.928] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:23:0) after 8m37s
[05:51:09.962] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:23:0)
[05:51:09.983] Build status: STARTED
[05:51:09.983] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:24:0) after 4m22s
[05:55:31.977] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:24:0)
[05:55:32.029] Build status: STARTED
[05:55:32.029] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:25:0) after 5m47s
[06:01:19.046] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:25:0)
[06:01:19.094] Build status: STARTED
[06:01:19.094] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:26:0) after 2m21s
[06:03:40.122] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:26:0)
[06:03:40.144] Build status: STARTED
[06:03:40.144] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:27:0) after 3m21s
[06:07:01.277] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:27:0)
[06:07:01.309] Build status: STARTED
[06:07:01.309] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:28:0) after 7m54s
[06:14:55.326] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:28:0)
[06:14:55.343] Build status: STARTED
[06:14:55.343] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:29:0) after 1m31s
[06:16:26.352] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:29:0)
[06:16:26.372] Build status: STARTED
[06:16:26.372] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:30:0) after 3m5s
[06:19:31.493] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:30:0)
[06:19:31.514] Build status: STARTED
[06:19:31.514] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:31:0) after 5m18s
[06:24:49.623] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:31:0)
[06:24:49.641] Build status: STARTED
[06:24:49.642] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:32:0) after 9m29s
[06:34:18.697] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:32:0)
[06:34:18.720] Build status: STARTED
[06:34:18.720] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:33:0) after 2m57s
[06:37:15.747] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:33:0)
[06:37:15.764] Build status: STARTED
[06:37:15.764] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:34:0) after 9m8s
[06:46:24.043] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:34:0)
[06:46:24.066] Build status: STARTED
[06:46:24.066] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:35:0) after 4m57s
[06:51:21.081] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:35:0)
[06:51:21.127] Build status: STARTED
[06:51:21.127] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:36:0) after 4m10s
[06:55:31.160] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:36:0)
[06:55:31.208] Build status: STARTED
[06:55:31.208] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:37:0) after 1m30s
[06:57:01.450] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:37:0)
[06:57:01.472] Build status: STARTED
[06:57:01.472] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:38:0) after 3m32s
[07:00:33.716] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:38:0)
[07:00:33.736] Build status: STARTED
[07:00:33.736] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:39:0) after 1m50s
[07:02:23.797] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:39:0)
[07:02:23.822] Build status: STARTED
[07:02:23.822] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:40:0) after 6m55s
[07:09:18.841] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:40:0)
[07:09:18.860] Build status: STARTED
[07:09:18.860] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:41:0) after 1m15s
[07:10:33.879] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:41:0)
[07:10:33.902] Build status: STARTED
[07:10:33.902] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:42:0) after 5m43s
[07:16:17.036] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:42:0)
[07:16:17.057] Build status: STARTED
[07:16:17.057] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:43:0) after 7m55s
[07:24:12.129] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:43:0)
[07:24:12.151] Build status: STARTED
[07:24:12.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:44:0) after 7m28s
[07:31:40.284] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:44:0)
[07:31:40.305] Build status: STARTED
[07:31:40.305] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:45:0) after 8m48s
[07:40:28.327] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:45:0)
[07:40:28.348] Build status: STARTED
[07:40:28.348] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:46:0) after 1m14s
[07:41:42.369] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:46:0)
[07:41:42.390] Build status: STARTED
[07:41:42.390] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:47:0) after 5m19s
[07:47:01.423] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:47:0)
[07:47:01.444] Build status: STARTED
[07:47:01.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:48:0) after 6m43s
[07:53:44.587] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:48:0)
[07:53:44.611] Build status: STARTED
[07:53:44.611] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:49:0) after 8m58s
[08:02:42.639] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:49:0)
[08:02:42.663] Build status: STARTED
[08:02:42.663] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:50:0) after 4m11s
[08:06:53.699] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:50:0)
[08:06:53.724] Build status: STARTED
[08:06:53.724] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:51:0) after 5m37s
[08:12:30.903] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:51:0)
[08:12:30.927] Build status: STARTED
[08:12:30.927] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:52:0) after 6m51s
[08:19:22.056] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:52:0)
[08:19:22.082] Build status: STARTED
[08:19:22.082] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:53:0) after 9m16s
[08:28:38.103] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:53:0)
[08:28:38.126] Build status: STARTED
[08:28:38.126] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:54:0) after 1m29s
[08:30:07.151] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:54:0)
[08:30:07.170] Build status: STARTED
[08:30:07.170] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:55:0) after 8m17s
[08:38:24.191] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:55:0)
[08:38:24.252] Build status: STARTED
[08:38:24.252] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:56:0) after 6m6s
[08:44:30.296] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:56:0)
[08:44:30.314] Build status: STARTED
[08:44:30.314] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:57:0) after 5m27s
[08:49:57.456] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:57:0)
[08:49:57.478] Build status: STARTED
[08:49:57.478] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:58:0) after 5m4s
[08:55:01.501] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:58:0)
[08:55:01.524] Build status: STARTED
[08:55:01.524] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:59:0) after 1m18s
[08:56:19.543] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:59:0)
[08:56:19.565] Build status: STARTED
[08:56:19.565] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:60:0) after 1m44s
[08:58:03.586] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:60:0)
[08:58:03.665] Build status: STARTED
[08:58:03.665] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:61:0) after 6m7s
[09:04:10.812] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:61:0)
[09:04:10.832] Build status: STARTED
[09:04:10.832] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:62:0) after 5m10s
[09:09:20.810] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:62:0)
[09:09:20.828] Build status: STARTED
[09:09:20.828] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:63:0) after 2m38s
[09:11:58.921] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:63:0)
[09:11:58.941] Build status: STARTED
[09:11:58.941] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:64:0) after 1m20s
[09:13:19.003] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:64:0)
[09:13:19.028] Build status: STARTED
[09:13:19.028] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:65:0) after 2m2s
[09:15:21.051] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:65:0)
[09:15:21.081] Build status: STARTED
[09:15:21.081] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953649224070622704:66:0) after 8m41s
[09:21:08.373] Received PubSub notification, asking Buildbucket for the build status
[09:21:08.393] Build:
{
"id": "8788219161732369057",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 28993,
"createdBy": "project:chromium",
"createTime": "2023-02-25T04:08:40.714828147Z",
"startTime": "2023-02-25T04:11:09.553868Z",
"endTime": "2023-02-25T09:21:08.090794321Z",
"updateTime": "2023-02-25T09:21:08.090794321Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5a69df495a2d2872fa4dbb08095e4e3610ceb7cd",
"ref": "refs/heads/main"
}
}
}
[09:21:08.393] Invocation finished in 5h12m29.291402592s with status FAILED