[03:53:14.521] New invocation is queued and will start shortly
[03:53:15.596] Starting the invocation (attempt 1)
[03:53:15.623] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/2342595ff9e1cd97d417de054dc78443d0c113e4"
[03:53:15.623] Popped gitiles commit info from properties and tags
[03:53:15.623] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[03:53:15.624] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[03:53:15.624] Buildbucket request:
{
"requestId": "8941147812215137616",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2342595ff9e1cd97d417de054dc78443d0c113e4",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8941147812215137616"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[03:53:16.184] Scheduled build:
{
"id": "8775717750332589585",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29899,
"createdBy": "project:chromium",
"createTime": "2023-07-13T03:53:15.685986095Z",
"updateTime": "2023-07-13T03:53:15.685986095Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2342595ff9e1cd97d417de054dc78443d0c113e4",
"ref": "refs/heads/main"
}
}
}
[03:53:16.184] Task URL: https://cr-buildbucket.appspot.com/build/8775717750332589585
[03:53:16.184] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:2:0) after 3m42s
[03:56:43.403] Received PubSub notification, asking Buildbucket for the build status
[03:56:43.470] Build status: STARTED
[03:56:58.242] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:2:0)
[03:56:58.263] Build status: STARTED
[03:56:58.263] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:4:0) after 7m52s
[04:04:50.284] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:4:0)
[04:04:50.304] Build status: STARTED
[04:04:50.304] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:5:0) after 8m11s
[04:13:01.348] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:5:0)
[04:13:01.368] Build status: STARTED
[04:13:01.368] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:6:0) after 9m3s
[04:22:04.389] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:6:0)
[04:22:04.408] Build status: STARTED
[04:22:04.408] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:7:0) after 1m24s
[04:23:28.627] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:7:0)
[04:23:28.665] Build status: STARTED
[04:23:28.665] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:8:0) after 6m22s
[04:29:50.684] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:8:0)
[04:29:50.701] Build status: STARTED
[04:29:50.701] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:9:0) after 3m41s
[04:33:31.722] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:9:0)
[04:33:31.752] Build status: STARTED
[04:33:31.752] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:10:0) after 5m24s
[04:38:55.904] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:10:0)
[04:38:55.919] Build status: STARTED
[04:38:55.919] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:11:0) after 5m32s
[04:44:27.927] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:11:0)
[04:44:27.943] Build status: STARTED
[04:44:27.943] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:12:0) after 5m55s
[04:50:23.266] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:12:0)
[04:50:23.370] Build status: STARTED
[04:50:23.370] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:13:0) after 1m48s
[04:52:11.393] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:13:0)
[04:52:11.471] Build status: STARTED
[04:52:11.471] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:14:0) after 1m49s
[04:54:00.549] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:14:0)
[04:54:00.666] Build status: STARTED
[04:54:00.666] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:15:0) after 9m56s
[05:03:56.686] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:15:0)
[05:03:56.705] Build status: STARTED
[05:03:56.705] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:16:0) after 9m48s
[05:13:44.825] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:16:0)
[05:13:45.035] Build status: STARTED
[05:13:45.035] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:17:0) after 5m27s
[05:19:12.057] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:17:0)
[05:19:12.075] Build status: STARTED
[05:19:12.075] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:18:0) after 7m0s
[05:26:12.592] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:18:0)
[05:26:12.619] Build status: STARTED
[05:26:12.619] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:19:0) after 4m39s
[05:30:51.650] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:19:0)
[05:30:51.716] Build status: STARTED
[05:30:51.716] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:20:0) after 3m47s
[05:34:38.816] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:20:0)
[05:34:38.838] Build status: STARTED
[05:34:38.838] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:21:0) after 6m37s
[05:41:15.864] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:21:0)
[05:41:15.882] Build status: STARTED
[05:41:15.882] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:22:0) after 1m17s
[05:42:32.911] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:22:0)
[05:42:32.931] Build status: STARTED
[05:42:32.931] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:23:0) after 8m31s
[05:51:04.186] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:23:0)
[05:51:04.207] Build status: STARTED
[05:51:04.207] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:24:0) after 7m35s
[05:58:39.231] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:24:0)
[05:58:39.254] Build status: STARTED
[05:58:39.254] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:25:0) after 2m7s
[06:00:46.424] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:25:0)
[06:00:46.451] Build status: STARTED
[06:00:46.451] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:26:0) after 9m44s
[06:10:30.478] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:26:0)
[06:10:30.555] Build status: STARTED
[06:10:30.555] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:27:0) after 4m55s
[06:15:25.613] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:27:0)
[06:15:25.634] Build status: STARTED
[06:15:25.634] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:28:0) after 9m12s
[06:24:37.635] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:28:0)
[06:24:37.666] Build status: STARTED
[06:24:37.666] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:29:0) after 1m44s
[06:26:21.710] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:29:0)
[06:26:21.730] Build status: STARTED
[06:26:21.730] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:30:0) after 4m0s
[06:30:22.284] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:30:0)
[06:30:22.377] Build status: STARTED
[06:30:22.377] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:31:0) after 7m35s
[06:37:57.377] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:31:0)
[06:37:57.516] Build status: STARTED
[06:37:57.516] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:32:0) after 9m3s
[06:47:00.535] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:32:0)
[06:47:00.653] Build status: STARTED
[06:47:00.653] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:33:0) after 1m53s
[06:48:53.718] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:33:0)
[06:48:53.737] Build status: STARTED
[06:48:53.737] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:34:0) after 8m21s
[06:57:14.866] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:34:0)
[06:57:14.885] Build status: STARTED
[06:57:14.885] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:35:0) after 4m1s
[07:01:16.013] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:35:0)
[07:01:16.067] Build status: STARTED
[07:01:16.067] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:36:0) after 5m3s
[07:06:19.242] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:36:0)
[07:06:19.259] Build status: STARTED
[07:06:19.259] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:37:0) after 3m35s
[07:09:54.279] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:37:0)
[07:09:54.296] Build status: STARTED
[07:09:54.296] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:38:0) after 6m11s
[07:16:05.404] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:38:0)
[07:16:05.421] Build status: STARTED
[07:16:05.421] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:39:0) after 7m52s
[07:23:57.441] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:39:0)
[07:23:57.469] Build status: STARTED
[07:23:57.469] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:40:0) after 4m39s
[07:28:36.490] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:40:0)
[07:28:36.509] Build status: STARTED
[07:28:36.509] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:41:0) after 2m40s
[07:31:16.554] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:41:0)
[07:31:16.577] Build status: STARTED
[07:31:16.577] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:42:0) after 5m44s
[07:37:00.614] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:42:0)
[07:37:00.631] Build status: STARTED
[07:37:00.631] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:43:0) after 6m55s
[07:43:55.776] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:43:0)
[07:43:55.794] Build status: STARTED
[07:43:55.794] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:44:0) after 4m34s
[07:48:30.216] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:44:0)
[07:48:30.233] Build status: STARTED
[07:48:30.233] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:45:0) after 1m12s
[07:49:42.293] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:45:0)
[07:49:42.313] Build status: STARTED
[07:49:42.313] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:46:0) after 3m43s
[07:53:25.665] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:46:0)
[07:53:25.689] Build status: STARTED
[07:53:25.689] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:47:0) after 4m44s
[07:58:09.829] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:47:0)
[07:58:09.848] Build status: STARTED
[07:58:09.848] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:48:0) after 6m41s
[08:04:50.868] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:48:0)
[08:04:50.884] Build status: STARTED
[08:04:50.884] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:49:0) after 2m57s
[08:07:48.011] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:49:0)
[08:07:48.031] Build status: STARTED
[08:07:48.031] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:50:0) after 3m51s
[08:11:39.051] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:50:0)
[08:11:39.071] Build status: STARTED
[08:11:39.071] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:51:0) after 4m43s
[08:16:22.165] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:51:0)
[08:16:22.181] Build status: STARTED
[08:16:22.181] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:52:0) after 4m46s
[08:21:08.418] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:52:0)
[08:21:08.525] Build status: STARTED
[08:21:08.525] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:53:0) after 4m40s
[08:25:48.727] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:53:0)
[08:25:48.743] Build status: STARTED
[08:25:48.743] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:54:0) after 6m56s
[08:32:44.807] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:54:0)
[08:32:44.825] Build status: STARTED
[08:32:44.825] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:55:0) after 7m29s
[08:40:13.851] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:55:0)
[08:40:13.869] Build status: STARTED
[08:40:13.869] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:56:0) after 4m11s
[08:44:24.895] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:56:0)
[08:44:24.926] Build status: STARTED
[08:44:24.926] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:57:0) after 1m4s
[08:45:29.082] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:57:0)
[08:45:29.098] Build status: STARTED
[08:45:29.098] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:58:0) after 4m55s
[08:50:24.494] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:58:0)
[08:50:24.515] Build status: STARTED
[08:50:24.515] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:59:0) after 6m14s
[08:56:38.860] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:59:0)
[08:56:38.897] Build status: STARTED
[08:56:38.897] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:60:0) after 9m42s
[09:06:21.058] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:60:0)
[09:06:21.078] Build status: STARTED
[09:06:21.078] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:61:0) after 8m5s
[09:14:26.344] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:61:0)
[09:14:26.364] Build status: STARTED
[09:14:26.364] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:62:0) after 2m52s
[09:17:18.640] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:62:0)
[09:17:18.656] Build status: STARTED
[09:17:18.656] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:63:0) after 7m34s
[09:24:52.758] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:63:0)
[09:24:52.777] Build status: STARTED
[09:24:52.777] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:64:0) after 2m28s
[09:27:20.761] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:64:0)
[09:27:20.798] Build status: STARTED
[09:27:20.798] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:65:0) after 7m8s
[09:34:29.090] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:65:0)
[09:34:29.108] Build status: STARTED
[09:34:29.108] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941147812215137616:66:0) after 6m39s
[09:35:48.674] Received PubSub notification, asking Buildbucket for the build status
[09:35:48.690] Build:
{
"id": "8775717750332589585",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29899,
"createdBy": "project:chromium",
"createTime": "2023-07-13T03:53:15.685986095Z",
"startTime": "2023-07-13T03:56:42.790560Z",
"endTime": "2023-07-13T09:35:47.803948568Z",
"updateTime": "2023-07-13T09:35:47.803948568Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2342595ff9e1cd97d417de054dc78443d0c113e4",
"ref": "refs/heads/main"
}
}
}
[09:35:48.690] Invocation finished in 5h42m34.184152455s with status FAILED