[23:33:13.935] New invocation is queued and will start shortly
[23:33:14.997] Starting the invocation (attempt 1)
[23:33:15.026] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/fdc84efa9784471ff75cdd89c3023ac4376b3fff"
[23:33:15.026] Popped gitiles commit info from properties and tags
[23:33:15.026] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[23:33:15.026] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[23:33:15.026] Buildbucket request:
{
"requestId": "8943157303866357456",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "linux-code-coverage"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fdc84efa9784471ff75cdd89c3023ac4376b3fff",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8943157303866357456"
},
{
"key": "scheduler_job_id",
"value": "chromium/linux-code-coverage"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[23:33:15.444] Scheduled build:
{
"id": "8777727242018329649",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "linux-code-coverage"
},
"number": 5539,
"createdBy": "project:chromium",
"createTime": "2023-06-20T23:33:15.075139629Z",
"updateTime": "2023-06-20T23:33:15.075139629Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fdc84efa9784471ff75cdd89c3023ac4376b3fff",
"ref": "refs/heads/main"
}
}
}
[23:33:15.444] Task URL: https://cr-buildbucket.appspot.com/build/8777727242018329649
[23:33:15.444] Scheduling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:2:0) after 1m17s
[23:34:32.762] Handling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:2:0)
[23:34:32.779] Build status: SCHEDULED
[23:34:32.779] Scheduling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:3:0) after 9m23s
[23:43:55.855] Handling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:3:0)
[23:43:55.904] Build status: SCHEDULED
[23:43:55.904] Scheduling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:4:0) after 8m47s
[23:52:42.935] Handling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:4:0)
[23:52:42.953] Build status: SCHEDULED
[23:52:42.953] Scheduling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:5:0) after 7m46s
[00:00:29.206] Handling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:5:0)
[00:00:29.228] Build status: SCHEDULED
[00:00:29.228] Scheduling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:6:0) after 3m17s
[00:03:46.856] Handling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:6:0)
[00:03:46.873] Build status: SCHEDULED
[00:03:46.873] Scheduling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:7:0) after 3m29s
[00:07:15.890] Handling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:7:0)
[00:07:15.912] Build status: SCHEDULED
[00:07:15.913] Scheduling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:8:0) after 8m46s
[00:16:02.358] Handling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:8:0)
[00:16:02.448] Build status: SCHEDULED
[00:16:02.448] Scheduling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:9:0) after 9m22s
[00:25:24.693] Handling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:9:0)
[00:25:24.713] Build status: SCHEDULED
[00:25:24.713] Scheduling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:10:0) after 8m53s
[00:33:48.333] Received PubSub notification, asking Buildbucket for the build status
[00:33:48.361] Build status: STARTED
[00:34:17.704] Handling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:10:0)
[00:34:17.721] Build status: STARTED
[00:34:17.721] Scheduling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:12:0) after 7m53s
[00:42:10.760] Handling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:12:0)
[00:42:10.775] Build status: STARTED
[00:42:10.775] Scheduling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:13:0) after 4m36s
[00:46:46.801] Handling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:13:0)
[00:46:46.819] Build status: STARTED
[00:46:46.819] Scheduling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:14:0) after 8m16s
[00:55:03.071] Handling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:14:0)
[00:55:03.089] Build status: STARTED
[00:55:03.089] Scheduling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:15:0) after 3m22s
[00:58:25.233] Handling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:15:0)
[00:58:25.252] Build status: STARTED
[00:58:25.252] Scheduling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:16:0) after 9m40s
[01:08:05.372] Handling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:16:0)
[01:08:05.388] Build status: STARTED
[01:08:05.388] Scheduling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:17:0) after 5m51s
[01:13:56.409] Handling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:17:0)
[01:13:56.427] Build status: STARTED
[01:13:56.427] Scheduling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:18:0) after 5m19s
[01:19:15.534] Handling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:18:0)
[01:19:15.550] Build status: STARTED
[01:19:15.550] Scheduling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:19:0) after 4m23s
[01:23:38.741] Handling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:19:0)
[01:23:38.815] Build status: STARTED
[01:23:38.815] Scheduling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:20:0) after 1m7s
[01:24:45.963] Handling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:20:0)
[01:24:45.980] Build status: STARTED
[01:24:45.980] Scheduling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:21:0) after 1m56s
[01:26:41.995] Handling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:21:0)
[01:26:42.059] Build status: STARTED
[01:26:42.059] Scheduling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:22:0) after 2m29s
[01:29:11.074] Handling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:22:0)
[01:29:11.092] Build status: STARTED
[01:29:11.092] Scheduling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:23:0) after 9m59s
[01:39:10.111] Handling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:23:0)
[01:39:10.127] Build status: STARTED
[01:39:10.127] Scheduling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:24:0) after 4m53s
[01:44:03.142] Handling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:24:0)
[01:44:03.162] Build status: STARTED
[01:44:03.162] Scheduling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:25:0) after 3m9s
[01:47:12.276] Handling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:25:0)
[01:47:12.292] Build status: STARTED
[01:47:12.292] Scheduling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:26:0) after 2m28s
[01:49:40.414] Handling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:26:0)
[01:49:40.453] Build status: STARTED
[01:49:40.453] Scheduling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:27:0) after 9m59s
[01:59:39.693] Handling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:27:0)
[01:59:39.722] Build status: STARTED
[01:59:39.722] Scheduling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:28:0) after 4m59s
[02:04:38.755] Handling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:28:0)
[02:04:38.770] Build status: STARTED
[02:04:38.770] Scheduling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:29:0) after 5m25s
[02:10:03.842] Handling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:29:0)
[02:10:03.874] Build status: STARTED
[02:10:03.874] Scheduling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:30:0) after 4m44s
[02:14:48.018] Handling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:30:0)
[02:14:48.038] Build status: STARTED
[02:14:48.038] Scheduling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:31:0) after 6m29s
[02:21:17.052] Handling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:31:0)
[02:21:17.079] Build status: STARTED
[02:21:17.079] Scheduling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:32:0) after 6m11s
[02:27:28.139] Handling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:32:0)
[02:27:28.162] Build status: STARTED
[02:27:28.162] Scheduling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:33:0) after 9m0s
[02:36:28.328] Handling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:33:0)
[02:36:28.416] Build status: STARTED
[02:36:28.416] Scheduling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:34:0) after 5m26s
[02:41:54.446] Handling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:34:0)
[02:41:54.473] Build status: STARTED
[02:41:54.473] Scheduling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:35:0) after 9m54s
[02:51:48.502] Handling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:35:0)
[02:51:48.634] Build status: STARTED
[02:51:48.634] Scheduling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:36:0) after 5m30s
[02:57:18.660] Handling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:36:0)
[02:57:18.676] Build status: STARTED
[02:57:18.676] Scheduling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:37:0) after 5m4s
[03:02:22.791] Handling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:37:0)
[03:02:22.815] Build status: STARTED
[03:02:22.815] Scheduling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:38:0) after 2m38s
[03:05:00.832] Handling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:38:0)
[03:05:00.850] Build status: STARTED
[03:05:00.850] Scheduling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:39:0) after 1m19s
[03:06:20.012] Handling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:39:0)
[03:06:20.095] Build status: STARTED
[03:06:20.095] Scheduling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:40:0) after 7m0s
[03:13:20.228] Handling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:40:0)
[03:13:20.249] Build status: STARTED
[03:13:20.250] Scheduling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:41:0) after 2m40s
[03:16:00.353] Handling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:41:0)
[03:16:00.368] Build status: STARTED
[03:16:00.368] Scheduling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:42:0) after 4m40s
[03:20:40.396] Handling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:42:0)
[03:20:40.414] Build status: STARTED
[03:20:40.414] Scheduling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:43:0) after 1m8s
[03:21:48.871] Handling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:43:0)
[03:21:48.892] Build status: STARTED
[03:21:48.892] Scheduling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:44:0) after 1m44s
[03:23:33.110] Handling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:44:0)
[03:23:33.127] Build status: STARTED
[03:23:33.127] Scheduling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:45:0) after 8m32s
[03:32:05.145] Handling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:45:0)
[03:32:05.164] Build status: STARTED
[03:32:05.164] Scheduling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:46:0) after 6m58s
[03:39:03.182] Handling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:46:0)
[03:39:03.203] Build status: STARTED
[03:39:03.203] Scheduling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:47:0) after 8m0s
[03:47:03.309] Handling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:47:0)
[03:47:03.326] Build status: STARTED
[03:47:03.326] Scheduling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:48:0) after 3m25s
[03:50:28.379] Handling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:48:0)
[03:50:28.396] Build status: STARTED
[03:50:28.396] Scheduling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:49:0) after 7m39s
[03:58:07.390] Handling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:49:0)
[03:58:07.409] Build status: STARTED
[03:58:07.409] Scheduling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:50:0) after 7m56s
[04:06:03.433] Handling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:50:0)
[04:06:03.471] Build status: STARTED
[04:06:03.471] Scheduling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:51:0) after 3m18s
[04:09:21.589] Handling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:51:0)
[04:09:21.690] Build status: STARTED
[04:09:21.690] Scheduling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:52:0) after 8m28s
[04:17:49.711] Handling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:52:0)
[04:17:49.731] Build status: STARTED
[04:17:49.731] Scheduling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:53:0) after 9m26s
[04:27:15.798] Handling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:53:0)
[04:27:15.815] Build status: STARTED
[04:27:15.815] Scheduling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:54:0) after 8m47s
[04:36:02.798] Handling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:54:0)
[04:36:02.829] Build status: STARTED
[04:36:02.829] Scheduling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:55:0) after 7m42s
[04:43:44.955] Handling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:55:0)
[04:43:44.978] Build status: STARTED
[04:43:44.978] Scheduling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:56:0) after 2m4s
[04:45:48.967] Handling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:56:0)
[04:45:48.985] Build status: STARTED
[04:45:48.985] Scheduling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:57:0) after 5m52s
[04:51:41.034] Handling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:57:0)
[04:51:41.054] Build status: STARTED
[04:51:41.054] Scheduling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:58:0) after 3m52s
[04:55:33.058] Handling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:58:0)
[04:55:33.077] Build status: STARTED
[04:55:33.077] Scheduling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:59:0) after 1m14s
[04:56:47.263] Handling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:59:0)
[04:56:47.289] Build status: STARTED
[04:56:47.289] Scheduling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:60:0) after 5m56s
[05:02:43.560] Handling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:60:0)
[05:02:43.579] Build status: STARTED
[05:02:43.579] Scheduling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:61:0) after 8m57s
[05:11:40.597] Handling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:61:0)
[05:11:40.783] Build status: STARTED
[05:11:40.783] Scheduling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:62:0) after 9m15s
[05:20:55.804] Handling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:62:0)
[05:20:55.857] Build status: STARTED
[05:20:55.857] Scheduling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:63:0) after 5m18s
[05:26:13.876] Handling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:63:0)
[05:26:13.898] Build status: STARTED
[05:26:13.898] Scheduling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:64:0) after 6m28s
[05:32:41.968] Handling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:64:0)
[05:32:42.009] Build status: STARTED
[05:32:42.009] Scheduling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:65:0) after 3m17s
[05:35:59.025] Handling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:65:0)
[05:35:59.094] Build status: STARTED
[05:35:59.094] Scheduling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:66:0) after 9m3s
[05:45:02.119] Handling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:66:0)
[05:45:02.136] Build status: STARTED
[05:45:02.136] Scheduling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:67:0) after 5m18s
[05:50:20.155] Handling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:67:0)
[05:50:20.174] Build status: STARTED
[05:50:20.174] Scheduling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:68:0) after 5m26s
[05:55:46.321] Handling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:68:0)
[05:55:46.337] Build status: STARTED
[05:55:46.337] Scheduling timer "check-buildbucket-build-status" (chromium/linux-code-coverage:8943157303866357456:69:0) after 9m33s
[06:04:49.158] Received PubSub notification, asking Buildbucket for the build status
[06:04:49.185] Build:
{
"id": "8777727242018329649",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "linux-code-coverage"
},
"number": 5539,
"createdBy": "project:chromium",
"createTime": "2023-06-20T23:33:15.075139629Z",
"startTime": "2023-06-21T00:33:47.685311Z",
"endTime": "2023-06-21T06:04:48.795590932Z",
"updateTime": "2023-06-21T06:04:48.795590932Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fdc84efa9784471ff75cdd89c3023ac4376b3fff",
"ref": "refs/heads/main"
}
}
}
[06:04:49.185] Invocation finished in 6h31m35.255598178s with status FAILED