[19:46:09.149] New invocation is queued and will start shortly
[19:46:10.228] Starting the invocation (attempt 1)
[19:46:10.263] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/8811f6a5ab85a9a7401cd33aef5c3b4307ddc477"
[19:46:10.263] Popped gitiles commit info from properties and tags
[19:46:10.263] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[19:46:10.263] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[19:46:10.263] Buildbucket request:
{
"requestId": "8929310254632040512",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8811f6a5ab85a9a7401cd33aef5c3b4307ddc477",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8929310254632040512"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[19:46:11.021] Scheduled build:
{
"id": "8763880192735853297",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 30931,
"createdBy": "project:chromium",
"createTime": "2023-11-20T19:46:10.334422580Z",
"updateTime": "2023-11-20T19:46:10.334422580Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8811f6a5ab85a9a7401cd33aef5c3b4307ddc477",
"ref": "refs/heads/main"
}
}
}
[19:46:11.021] Task URL: https://cr-buildbucket.appspot.com/build/8763880192735853297
[19:46:11.021] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:2:0) after 1m9s
[19:46:11.103] Received PubSub notification, asking Buildbucket for the build status
[19:46:11.123] Build status: SCHEDULED
[19:46:58.170] Received PubSub notification, asking Buildbucket for the build status
[19:46:58.384] Build status: STARTED
[19:47:20.105] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:2:0)
[19:47:20.126] Build status: STARTED
[19:47:20.126] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:5:0) after 3m58s
[19:51:18.199] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:5:0)
[19:51:18.230] Build status: STARTED
[19:51:18.230] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:6:0) after 3m8s
[19:54:26.258] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:6:0)
[19:54:26.279] Build status: STARTED
[19:54:26.279] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:7:0) after 4m57s
[19:59:23.305] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:7:0)
[19:59:23.329] Build status: STARTED
[19:59:23.329] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:8:0) after 2m39s
[20:02:02.487] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:8:0)
[20:02:02.526] Build status: STARTED
[20:02:02.526] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:9:0) after 9m4s
[20:11:06.551] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:9:0)
[20:11:06.618] Build status: STARTED
[20:11:06.618] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:10:0) after 4m4s
[20:15:10.648] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:10:0)
[20:15:10.710] Build status: STARTED
[20:15:10.710] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:11:0) after 7m5s
[20:22:15.698] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:11:0)
[20:22:15.726] Build status: STARTED
[20:22:15.726] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:12:0) after 6m35s
[20:28:50.798] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:12:0)
[20:28:50.826] Build status: STARTED
[20:28:50.826] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:13:0) after 1m19s
[20:30:09.960] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:13:0)
[20:30:10.097] Build status: STARTED
[20:30:10.097] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:14:0) after 4m8s
[20:34:18.125] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:14:0)
[20:34:18.145] Build status: STARTED
[20:34:18.145] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:15:0) after 9m19s
[20:43:37.171] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:15:0)
[20:43:37.236] Build status: STARTED
[20:43:37.236] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:16:0) after 9m8s
[20:52:45.321] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:16:0)
[20:52:45.341] Build status: STARTED
[20:52:45.341] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:17:0) after 7m30s
[21:00:15.384] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:17:0)
[21:00:15.485] Build status: STARTED
[21:00:15.485] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:18:0) after 7m28s
[21:07:43.708] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:18:0)
[21:07:43.726] Build status: STARTED
[21:07:43.726] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:19:0) after 9m47s
[21:17:30.772] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:19:0)
[21:17:30.792] Build status: STARTED
[21:17:30.792] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:20:0) after 6m27s
[21:23:57.828] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:20:0)
[21:23:57.902] Build status: STARTED
[21:23:57.903] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:21:0) after 2m28s
[21:26:26.035] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:21:0)
[21:26:26.058] Build status: STARTED
[21:26:26.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:22:0) after 2m55s
[21:29:21.077] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:22:0)
[21:29:21.096] Build status: STARTED
[21:29:21.096] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:23:0) after 7m47s
[21:37:08.282] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:23:0)
[21:37:08.302] Build status: STARTED
[21:37:08.302] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:24:0) after 1m58s
[21:39:06.299] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:24:0)
[21:39:06.318] Build status: STARTED
[21:39:06.318] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:25:0) after 8m56s
[21:48:02.350] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:25:0)
[21:48:02.396] Build status: STARTED
[21:48:02.396] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:26:0) after 9m49s
[21:57:51.435] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:26:0)
[21:57:51.455] Build status: STARTED
[21:57:51.455] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:27:0) after 8m11s
[22:06:02.494] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:27:0)
[22:06:02.579] Build status: STARTED
[22:06:02.579] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:28:0) after 9m55s
[22:15:57.653] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:28:0)
[22:15:57.670] Build status: STARTED
[22:15:57.670] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:29:0) after 5m47s
[22:21:44.696] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:29:0)
[22:21:44.727] Build status: STARTED
[22:21:44.727] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:30:0) after 6m32s
[22:28:16.733] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:30:0)
[22:28:16.750] Build status: STARTED
[22:28:16.750] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:31:0) after 5m24s
[22:33:40.774] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:31:0)
[22:33:40.794] Build status: STARTED
[22:33:40.794] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:32:0) after 2m45s
[22:36:25.864] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:32:0)
[22:36:25.948] Build status: STARTED
[22:36:25.948] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:33:0) after 1m23s
[22:37:48.981] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:33:0)
[22:37:48.997] Build status: STARTED
[22:37:48.997] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:34:0) after 9m5s
[22:46:54.027] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:34:0)
[22:46:54.047] Build status: STARTED
[22:46:54.047] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:35:0) after 8m15s
[22:55:09.097] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:35:0)
[22:55:09.162] Build status: STARTED
[22:55:09.162] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:36:0) after 2m55s
[22:58:04.185] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:36:0)
[22:58:04.206] Build status: STARTED
[22:58:04.206] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:37:0) after 3m25s
[23:01:29.278] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:37:0)
[23:01:29.304] Build status: STARTED
[23:01:29.304] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:38:0) after 9m58s
[23:11:27.329] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:38:0)
[23:11:27.352] Build status: STARTED
[23:11:27.352] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:39:0) after 3m54s
[23:15:22.191] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:39:0)
[23:15:22.236] Build status: STARTED
[23:15:22.236] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:40:0) after 6m14s
[23:21:36.357] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:40:0)
[23:21:36.376] Build status: STARTED
[23:21:36.376] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:41:0) after 8m41s
[23:30:17.350] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:41:0)
[23:30:17.455] Build status: STARTED
[23:30:17.455] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:42:0) after 6m31s
[23:36:48.476] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:42:0)
[23:36:48.497] Build status: STARTED
[23:36:48.497] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:43:0) after 1m57s
[23:38:45.479] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:43:0)
[23:38:45.499] Build status: STARTED
[23:38:45.499] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:44:0) after 3m13s
[23:41:58.532] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:44:0)
[23:41:58.561] Build status: STARTED
[23:41:58.561] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:45:0) after 8m57s
[23:50:55.593] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:45:0)
[23:50:55.626] Build status: STARTED
[23:50:55.626] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:46:0) after 9m7s
[00:00:02.873] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:46:0)
[00:00:02.910] Build status: STARTED
[00:00:02.910] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:47:0) after 6m27s
[00:06:29.992] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:47:0)
[00:06:30.041] Build status: STARTED
[00:06:30.041] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:48:0) after 8m43s
[00:15:13.070] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:48:0)
[00:15:13.126] Build status: STARTED
[00:15:13.127] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:49:0) after 8m11s
[00:23:24.188] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:49:0)
[00:23:24.208] Build status: STARTED
[00:23:24.208] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:50:0) after 2m13s
[00:25:37.215] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:50:0)
[00:25:37.239] Build status: STARTED
[00:25:37.239] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:51:0) after 3m3s
[00:28:40.305] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:51:0)
[00:28:40.323] Build status: STARTED
[00:28:40.323] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:52:0) after 9m56s
[00:38:36.356] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:52:0)
[00:38:36.379] Build status: STARTED
[00:38:36.379] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:53:0) after 2m59s
[00:41:35.402] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:53:0)
[00:41:35.447] Build status: STARTED
[00:41:35.447] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:54:0) after 9m52s
[00:51:27.469] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:54:0)
[00:51:27.501] Build status: STARTED
[00:51:27.502] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:55:0) after 6m58s
[00:58:25.577] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:55:0)
[00:58:25.598] Build status: STARTED
[00:58:25.599] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:56:0) after 3m59s
[01:02:24.716] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:56:0)
[01:02:24.734] Build status: STARTED
[01:02:24.734] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:57:0) after 4m49s
[01:07:13.758] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:57:0)
[01:07:13.798] Build status: STARTED
[01:07:13.798] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:58:0) after 4m2s
[01:11:15.871] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:58:0)
[01:11:15.894] Build status: STARTED
[01:11:15.894] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:59:0) after 5m42s
[01:16:57.966] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:59:0)
[01:16:57.993] Build status: STARTED
[01:16:57.994] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:60:0) after 8m38s
[01:25:36.021] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:60:0)
[01:25:36.049] Build status: STARTED
[01:25:36.049] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:61:0) after 9m10s
[01:34:46.222] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:61:0)
[01:34:46.249] Build status: STARTED
[01:34:46.249] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:62:0) after 1m47s
[01:36:33.288] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:62:0)
[01:36:33.314] Build status: STARTED
[01:36:33.314] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:63:0) after 7m25s
[01:43:58.346] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:63:0)
[01:43:58.368] Build status: STARTED
[01:43:58.368] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:64:0) after 8m53s
[01:52:51.459] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:64:0)
[01:52:51.521] Build status: STARTED
[01:52:51.521] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:65:0) after 6m55s
[01:59:46.952] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:65:0)
[01:59:46.978] Build status: STARTED
[01:59:46.979] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:66:0) after 1m57s
[02:01:44.070] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:66:0)
[02:01:44.094] Build status: STARTED
[02:01:44.094] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929310254632040512:67:0) after 7m39s
[02:03:57.137] Received PubSub notification, asking Buildbucket for the build status
[02:03:57.158] Build:
{
"id": "8763880192735853297",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 30931,
"createdBy": "project:chromium",
"createTime": "2023-11-20T19:46:10.334422580Z",
"startTime": "2023-11-20T19:46:56.019477Z",
"endTime": "2023-11-21T02:03:56.363212Z",
"updateTime": "2023-11-21T02:03:56.363212Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8811f6a5ab85a9a7401cd33aef5c3b4307ddc477",
"ref": "refs/heads/main"
}
}
}
[02:03:57.158] Invocation finished in 6h17m48.016259409s with status FAILED