[01:49:56.649] New invocation is queued and will start shortly
[01:49:57.736] Starting the invocation (attempt 1)
[01:49:57.774] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/c01d91275f220571eedc2565dbcd9f3febb34de9"
[01:49:57.775] Popped gitiles commit info from properties and tags
[01:49:57.775] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[01:49:57.775] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[01:49:57.775] Buildbucket request:
{
"requestId": "9007744339750746592",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c01d91275f220571eedc2565dbcd9f3febb34de9",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9007744339750746592"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[01:49:58.714] Scheduled build:
{
"id": "8842314277798685920",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22500,
"createdBy": "project:chromium",
"createTime": "2021-07-08T01:49:57.879652Z",
"updateTime": "2021-07-08T01:49:58.481377Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c01d91275f220571eedc2565dbcd9f3febb34de9",
"ref": "refs/heads/main"
}
}
}
[01:49:58.714] Task URL: https://cr-buildbucket.appspot.com/build/8842314277798685920
[01:49:58.714] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:2:0) after 2m23s
[01:52:21.800] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:2:0)
[01:52:21.833] Build status: SCHEDULED
[01:52:21.833] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:3:0) after 7m16s
[01:54:11.717] Received PubSub notification, asking Buildbucket for the build status
[01:54:11.749] Build status: STARTED
[01:59:38.035] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:3:0)
[01:59:38.067] Build status: STARTED
[01:59:38.067] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:5:0) after 3m21s
[02:02:59.094] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:5:0)
[02:02:59.206] Build status: STARTED
[02:02:59.206] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:6:0) after 3m30s
[02:06:29.344] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:6:0)
[02:06:29.372] Build status: STARTED
[02:06:29.372] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:7:0) after 8m41s
[02:15:10.510] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:7:0)
[02:15:10.549] Build status: STARTED
[02:15:10.549] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:8:0) after 1m21s
[02:16:31.536] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:8:0)
[02:16:31.564] Build status: STARTED
[02:16:31.564] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:9:0) after 8m46s
[02:25:17.616] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:9:0)
[02:25:17.645] Build status: STARTED
[02:25:17.645] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:10:0) after 8m51s
[02:34:08.767] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:10:0)
[02:34:08.799] Build status: STARTED
[02:34:08.799] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:11:0) after 9m59s
[02:44:07.856] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:11:0)
[02:44:07.881] Build status: STARTED
[02:44:07.881] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:12:0) after 7m4s
[02:51:12.084] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:12:0)
[02:51:12.114] Build status: STARTED
[02:51:12.114] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:13:0) after 2m24s
[02:53:36.256] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:13:0)
[02:53:36.285] Build status: STARTED
[02:53:36.285] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:14:0) after 9m49s
[03:03:25.387] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:14:0)
[03:03:25.423] Build status: STARTED
[03:03:25.423] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:15:0) after 5m11s
[03:08:36.678] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:15:0)
[03:08:36.714] Build status: STARTED
[03:08:36.714] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:16:0) after 4m43s
[03:13:19.893] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:16:0)
[03:13:19.923] Build status: STARTED
[03:13:19.923] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:17:0) after 1m3s
[03:14:23.019] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:17:0)
[03:14:23.056] Build status: STARTED
[03:14:23.056] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:18:0) after 3m29s
[03:17:52.282] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:18:0)
[03:17:52.312] Build status: STARTED
[03:17:52.312] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:19:0) after 2m52s
[03:20:44.448] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:19:0)
[03:20:44.478] Build status: STARTED
[03:20:44.478] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:20:0) after 5m6s
[03:25:50.500] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:20:0)
[03:25:50.529] Build status: STARTED
[03:25:50.529] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:21:0) after 8m2s
[03:33:52.634] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:21:0)
[03:33:52.671] Build status: STARTED
[03:33:52.671] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:22:0) after 4m16s
[03:38:08.692] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:22:0)
[03:38:08.720] Build status: STARTED
[03:38:08.720] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:23:0) after 9m28s
[03:47:36.712] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:23:0)
[03:47:36.737] Build status: STARTED
[03:47:36.737] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:24:0) after 7m34s
[03:55:10.763] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:24:0)
[03:55:10.793] Build status: STARTED
[03:55:10.793] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:25:0) after 3m58s
[03:59:08.874] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:25:0)
[03:59:08.900] Build status: STARTED
[03:59:08.900] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:26:0) after 7m36s
[04:06:45.054] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:26:0)
[04:06:45.459] Build status: STARTED
[04:06:45.459] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:27:0) after 6m36s
[04:13:21.483] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:27:0)
[04:13:21.515] Build status: STARTED
[04:13:21.515] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:28:0) after 5m18s
[04:18:39.538] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:28:0)
[04:18:39.570] Build status: STARTED
[04:18:39.570] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:29:0) after 9m37s
[04:28:16.751] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:29:0)
[04:28:16.823] Build status: STARTED
[04:28:16.823] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:30:0) after 5m17s
[04:33:33.963] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:30:0)
[04:33:33.999] Build status: STARTED
[04:33:33.999] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:31:0) after 8m58s
[04:42:32.130] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:31:0)
[04:42:32.160] Build status: STARTED
[04:42:32.160] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:32:0) after 8m28s
[04:51:00.188] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:32:0)
[04:51:00.220] Build status: STARTED
[04:51:00.220] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:33:0) after 2m0s
[04:53:00.383] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:33:0)
[04:53:00.422] Build status: STARTED
[04:53:00.422] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:34:0) after 4m15s
[04:57:15.448] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:34:0)
[04:57:15.637] Build status: STARTED
[04:57:15.637] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:35:0) after 2m44s
[04:59:59.700] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:35:0)
[04:59:59.729] Build status: STARTED
[04:59:59.729] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:36:0) after 3m25s
[05:03:24.721] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:36:0)
[05:03:24.771] Build status: STARTED
[05:03:24.771] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:37:0) after 8m11s
[05:11:35.789] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:37:0)
[05:11:35.824] Build status: STARTED
[05:11:35.824] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:38:0) after 4m21s
[05:15:56.893] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:38:0)
[05:15:56.920] Build status: STARTED
[05:15:56.920] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:39:0) after 6m50s
[05:22:47.003] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:39:0)
[05:22:47.032] Build status: STARTED
[05:22:47.032] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:40:0) after 4m7s
[05:26:54.169] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:40:0)
[05:26:54.199] Build status: STARTED
[05:26:54.199] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:41:0) after 4m8s
[05:31:02.384] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:41:0)
[05:31:02.435] Build status: STARTED
[05:31:02.435] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:42:0) after 2m57s
[05:33:59.504] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:42:0)
[05:33:59.557] Build status: STARTED
[05:33:59.557] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:43:0) after 8m57s
[05:42:56.649] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:43:0)
[05:42:56.678] Build status: STARTED
[05:42:56.678] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:44:0) after 7m10s
[05:50:06.699] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:44:0)
[05:50:06.734] Build status: STARTED
[05:50:06.734] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:45:0) after 8m17s
[05:58:23.980] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:45:0)
[05:58:24.013] Build status: STARTED
[05:58:24.013] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:46:0) after 1m25s
[05:59:49.150] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:46:0)
[05:59:49.182] Build status: STARTED
[05:59:49.182] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:47:0) after 2m42s
[06:02:31.388] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:47:0)
[06:02:31.448] Build status: STARTED
[06:02:31.448] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:48:0) after 4m42s
[06:07:13.672] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:48:0)
[06:07:13.698] Build status: STARTED
[06:07:13.698] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:49:0) after 9m28s
[06:16:41.728] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:49:0)
[06:16:41.755] Build status: STARTED
[06:16:41.755] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:50:0) after 1m12s
[06:17:53.792] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:50:0)
[06:17:53.864] Build status: STARTED
[06:17:53.864] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:51:0) after 4m19s
[06:22:12.886] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:51:0)
[06:22:12.916] Build status: STARTED
[06:22:12.916] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:52:0) after 4m18s
[06:26:31.317] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:52:0)
[06:26:31.344] Build status: STARTED
[06:26:31.344] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:53:0) after 7m50s
[06:34:21.575] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:53:0)
[06:34:21.606] Build status: STARTED
[06:34:21.606] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:54:0) after 9m45s
[06:44:06.746] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:54:0)
[06:44:06.775] Build status: STARTED
[06:44:06.775] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:55:0) after 2m56s
[06:47:02.784] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:55:0)
[06:47:02.814] Build status: STARTED
[06:47:02.814] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:56:0) after 8m49s
[06:55:51.834] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:56:0)
[06:55:51.876] Build status: STARTED
[06:55:51.876] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:57:0) after 1m33s
[06:57:24.958] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:57:0)
[06:57:24.993] Build status: STARTED
[06:57:24.993] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007744339750746592:58:0) after 2m52s
[06:58:06.296] Received PubSub notification, asking Buildbucket for the build status
[06:58:06.325] Build:
{
"id": "8842314277798685920",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22500,
"createdBy": "project:chromium",
"createTime": "2021-07-08T01:49:57.879652Z",
"startTime": "2021-07-08T01:54:10.703612Z",
"endTime": "2021-07-08T06:58:05.084952907Z",
"updateTime": "2021-07-08T06:58:05.085278015Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c01d91275f220571eedc2565dbcd9f3febb34de9",
"ref": "refs/heads/main"
}
}
}
[06:58:06.325] Invocation finished in 5h8m9.692182694s with status FAILED