[11:19:01.349] New invocation is queued and will start shortly
[11:19:02.844] Starting the invocation (attempt 1)
[11:19:02.885] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/a6aefd7d9f07c0846cf16d0a6db82fc76ef0c102"
[11:19:02.885] Popped gitiles commit info from properties and tags
[11:19:02.885] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[11:19:02.885] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[11:19:02.885] Buildbucket request:
{
"requestId": "8984878100905209872",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "win10-code-coverage"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a6aefd7d9f07c0846cf16d0a6db82fc76ef0c102",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8984878100905209872"
},
{
"key": "scheduler_job_id",
"value": "chromium/win10-code-coverage"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[11:19:03.452] Scheduled build:
{
"id": "8819448038550403249",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "win10-code-coverage"
},
"number": 13522,
"createdBy": "project:chromium",
"createTime": "2022-03-17T11:19:02.963664373Z",
"updateTime": "2022-03-17T11:19:02.963664373Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a6aefd7d9f07c0846cf16d0a6db82fc76ef0c102",
"ref": "refs/heads/main"
}
},
"canary": true
}
[11:19:03.452] Task URL: https://cr-buildbucket.appspot.com/build/8819448038550403249
[11:19:03.452] Scheduling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:2:0) after 6m52s
[11:21:07.494] Received PubSub notification, asking Buildbucket for the build status
[11:21:07.526] Build status: STARTED
[11:25:55.474] Handling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:2:0)
[11:25:55.493] Build status: STARTED
[11:25:55.493] Scheduling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:4:0) after 5m44s
[11:31:39.530] Handling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:4:0)
[11:31:39.551] Build status: STARTED
[11:31:39.551] Scheduling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:5:0) after 1m37s
[11:33:16.635] Handling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:5:0)
[11:33:16.655] Build status: STARTED
[11:33:16.655] Scheduling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:6:0) after 1m42s
[11:34:58.678] Handling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:6:0)
[11:34:58.696] Build status: STARTED
[11:34:58.696] Scheduling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:7:0) after 9m10s
[11:44:08.746] Handling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:7:0)
[11:44:08.769] Build status: STARTED
[11:44:08.769] Scheduling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:8:0) after 8m53s
[11:53:01.740] Handling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:8:0)
[11:53:01.761] Build status: STARTED
[11:53:01.761] Scheduling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:9:0) after 1m34s
[11:54:35.789] Handling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:9:0)
[11:54:35.829] Build status: STARTED
[11:54:35.829] Scheduling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:10:0) after 3m39s
[11:58:14.924] Handling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:10:0)
[11:58:14.971] Build status: STARTED
[11:58:14.971] Scheduling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:11:0) after 8m26s
[12:06:40.993] Handling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:11:0)
[12:06:41.015] Build status: STARTED
[12:06:41.015] Scheduling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:12:0) after 3m32s
[12:10:13.035] Handling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:12:0)
[12:10:13.066] Build status: STARTED
[12:10:13.066] Scheduling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:13:0) after 1m40s
[12:11:53.186] Handling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:13:0)
[12:11:53.220] Build status: STARTED
[12:11:53.220] Scheduling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:14:0) after 7m2s
[12:18:55.561] Handling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:14:0)
[12:18:55.584] Build status: STARTED
[12:18:55.584] Scheduling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:15:0) after 6m0s
[12:24:56.015] Handling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:15:0)
[12:24:56.034] Build status: STARTED
[12:24:56.034] Scheduling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:16:0) after 1m32s
[12:26:28.057] Handling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:16:0)
[12:26:28.096] Build status: STARTED
[12:26:28.096] Scheduling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:17:0) after 4m16s
[12:30:44.124] Handling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:17:0)
[12:30:44.157] Build status: STARTED
[12:30:44.157] Scheduling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:18:0) after 7m42s
[12:38:26.280] Handling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:18:0)
[12:38:26.318] Build status: STARTED
[12:38:26.318] Scheduling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:19:0) after 5m2s
[12:43:28.472] Handling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:19:0)
[12:43:28.495] Build status: STARTED
[12:43:28.495] Scheduling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:20:0) after 5m39s
[12:49:07.631] Handling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:20:0)
[12:49:07.665] Build status: STARTED
[12:49:07.665] Scheduling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:21:0) after 3m17s
[12:52:24.783] Handling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:21:0)
[12:52:24.830] Build status: STARTED
[12:52:24.830] Scheduling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:22:0) after 6m13s
[12:58:37.861] Handling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:22:0)
[12:58:37.884] Build status: STARTED
[12:58:37.884] Scheduling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:23:0) after 4m49s
[13:03:26.906] Handling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:23:0)
[13:03:26.943] Build status: STARTED
[13:03:26.943] Scheduling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:24:0) after 1m4s
[13:04:30.964] Handling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:24:0)
[13:04:30.989] Build status: STARTED
[13:04:30.989] Scheduling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:25:0) after 8m23s
[13:12:54.211] Handling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:25:0)
[13:12:54.246] Build status: STARTED
[13:12:54.246] Scheduling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:26:0) after 3m54s
[13:16:48.369] Handling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:26:0)
[13:16:48.391] Build status: STARTED
[13:16:48.391] Scheduling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:27:0) after 5m7s
[13:21:55.949] Handling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:27:0)
[13:21:55.969] Build status: STARTED
[13:21:55.969] Scheduling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:28:0) after 9m20s
[13:31:16.046] Handling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:28:0)
[13:31:16.071] Build status: STARTED
[13:31:16.071] Scheduling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:29:0) after 4m59s
[13:36:15.121] Handling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:29:0)
[13:36:15.156] Build status: STARTED
[13:36:15.156] Scheduling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:30:0) after 4m10s
[13:40:25.179] Handling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:30:0)
[13:40:25.216] Build status: STARTED
[13:40:25.216] Scheduling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:31:0) after 1m35s
[13:42:00.467] Handling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:31:0)
[13:42:00.500] Build status: STARTED
[13:42:00.500] Scheduling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:32:0) after 4m30s
[13:46:30.524] Handling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:32:0)
[13:46:30.559] Build status: STARTED
[13:46:30.559] Scheduling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:33:0) after 5m26s
[13:51:56.756] Handling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:33:0)
[13:51:56.784] Build status: STARTED
[13:51:56.784] Scheduling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:34:0) after 6m24s
[13:58:20.809] Handling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:34:0)
[13:58:20.843] Build status: STARTED
[13:58:20.843] Scheduling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:35:0) after 8m9s
[14:06:29.866] Handling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:35:0)
[14:06:29.898] Build status: STARTED
[14:06:29.898] Scheduling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:36:0) after 4m11s
[14:10:41.249] Handling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:36:0)
[14:10:41.277] Build status: STARTED
[14:10:41.277] Scheduling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:37:0) after 2m8s
[14:12:49.504] Handling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:37:0)
[14:12:49.530] Build status: STARTED
[14:12:49.530] Scheduling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:38:0) after 7m20s
[14:20:09.941] Handling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:38:0)
[14:20:09.965] Build status: STARTED
[14:20:09.965] Scheduling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:39:0) after 3m21s
[14:23:30.985] Handling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:39:0)
[14:23:31.014] Build status: STARTED
[14:23:31.014] Scheduling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:40:0) after 8m52s
[14:32:23.211] Handling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:40:0)
[14:32:23.267] Build status: STARTED
[14:32:23.267] Scheduling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:41:0) after 3m25s
[14:35:48.301] Handling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:41:0)
[14:35:48.325] Build status: STARTED
[14:35:48.325] Scheduling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:42:0) after 5m29s
[14:41:17.349] Handling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:42:0)
[14:41:17.377] Build status: STARTED
[14:41:17.377] Scheduling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:43:0) after 3m20s
[14:44:37.441] Handling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:43:0)
[14:44:37.467] Build status: STARTED
[14:44:37.467] Scheduling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:44:0) after 5m26s
[14:50:03.731] Handling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:44:0)
[14:50:03.764] Build status: STARTED
[14:50:03.764] Scheduling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:45:0) after 1m52s
[14:51:55.796] Handling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:45:0)
[14:51:55.853] Build status: STARTED
[14:51:55.853] Scheduling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:46:0) after 1m53s
[14:53:48.954] Handling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:46:0)
[14:53:48.980] Build status: STARTED
[14:53:48.980] Scheduling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:47:0) after 9m16s
[15:03:05.211] Handling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:47:0)
[15:03:05.239] Build status: STARTED
[15:03:05.239] Scheduling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:48:0) after 9m16s
[15:12:21.262] Handling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:48:0)
[15:12:21.356] Build status: STARTED
[15:12:21.356] Scheduling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:49:0) after 7m59s
[15:20:20.591] Handling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:49:0)
[15:20:20.616] Build status: STARTED
[15:20:20.616] Scheduling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:50:0) after 2m37s
[15:22:57.681] Handling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:50:0)
[15:22:57.719] Build status: STARTED
[15:22:57.719] Scheduling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:51:0) after 1m53s
[15:24:50.841] Handling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:51:0)
[15:24:50.887] Build status: STARTED
[15:24:50.887] Scheduling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:52:0) after 6m40s
[15:31:30.965] Handling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:52:0)
[15:31:30.990] Build status: STARTED
[15:31:30.991] Scheduling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:53:0) after 2m6s
[15:33:37.127] Handling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:53:0)
[15:33:37.181] Build status: STARTED
[15:33:37.181] Scheduling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:54:0) after 5m7s
[15:38:44.331] Handling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:54:0)
[15:38:44.356] Build status: STARTED
[15:38:44.356] Scheduling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:55:0) after 9m16s
[15:48:00.500] Handling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:55:0)
[15:48:00.525] Build status: STARTED
[15:48:00.525] Scheduling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:56:0) after 4m48s
[15:52:48.548] Handling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:56:0)
[15:52:48.574] Build status: STARTED
[15:52:48.574] Scheduling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:57:0) after 6m6s
[15:58:54.722] Handling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:57:0)
[15:58:54.745] Build status: STARTED
[15:58:54.745] Scheduling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:58:0) after 1m32s
[16:00:26.750] Handling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:58:0)
[16:00:26.786] Build status: STARTED
[16:00:26.786] Scheduling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:59:0) after 9m20s
[16:09:47.131] Handling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:59:0)
[16:09:47.164] Build status: STARTED
[16:09:47.164] Scheduling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:60:0) after 7m17s
[16:17:04.296] Handling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:60:0)
[16:17:04.322] Build status: STARTED
[16:17:04.322] Scheduling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:61:0) after 5m24s
[16:23:00.437] Handling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:61:0)
[16:23:00.485] Build status: STARTED
[16:23:00.485] Scheduling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:62:0) after 1m48s
[16:24:48.508] Handling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:62:0)
[16:24:48.530] Build status: STARTED
[16:24:48.530] Scheduling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:63:0) after 9m12s
[16:34:00.825] Handling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:63:0)
[16:34:00.858] Build status: STARTED
[16:34:00.858] Scheduling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:64:0) after 9m12s
[16:43:12.850] Handling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:64:0)
[16:43:12.874] Build status: STARTED
[16:43:12.875] Scheduling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:65:0) after 8m21s
[16:51:33.902] Handling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:65:0)
[16:51:33.938] Build status: STARTED
[16:51:33.938] Scheduling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:66:0) after 5m21s
[16:56:55.260] Handling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:66:0)
[16:56:55.282] Build status: STARTED
[16:56:55.282] Scheduling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:67:0) after 2m30s
[16:59:25.284] Handling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:67:0)
[16:59:25.327] Build status: STARTED
[16:59:25.327] Scheduling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:68:0) after 6m31s
[17:05:56.356] Handling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:68:0)
[17:05:56.377] Build status: STARTED
[17:05:56.377] Scheduling timer "check-buildbucket-build-status" (chromium/win10-code-coverage:8984878100905209872:69:0) after 7m15s
[17:09:50.984] Received PubSub notification, asking Buildbucket for the build status
[17:09:51.011] Build:
{
"id": "8819448038550403249",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "win10-code-coverage"
},
"number": 13522,
"createdBy": "project:chromium",
"createTime": "2022-03-17T11:19:02.963664373Z",
"startTime": "2022-03-17T11:21:06.844359Z",
"endTime": "2022-03-17T17:09:50.602664762Z",
"updateTime": "2022-03-17T17:09:50.602664762Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a6aefd7d9f07c0846cf16d0a6db82fc76ef0c102",
"ref": "refs/heads/main"
}
},
"canary": true
}
[17:09:51.011] Invocation finished in 5h50m49.677732521s with status FAILED