1. All projects
  2. pigweed
  3. showcase.sense.dev.ci-showcase-sense-linux-bazel
  4. 8858613178662908144
Status: FAILED
Triggered by: -
Duration: 3 hours
Actions:

Definition (rev b13a9305651a678ebf66be6d9321f194afdab8e6) 

buildbucket: <
  server: "cr-buildbucket.appspot.com"
  bucket: "showcase.sense.dev.ci"
  builder: "showcase-sense-linux-bazel"
>

Incoming triggers

Incoming properties

{
  "branch": "refs/heads/main",
  "repository": "https://pigweed.googlesource.com/pigweed/showcase/sense",
  "revision": "ccf5caffc342e465ae00cbef791a471d24f2b85e"
}

Incoming tags

  • buildset:commit/gitiles/pigweed.googlesource.com/pigweed/showcase/sense/+/ccf5caffc342e465ae00cbef791a471d24f2b85e
  • gitiles_ref:refs/heads/main

Debug log (UTC)

[04:05:54.744] New invocation is queued and will start shortly
[04:05:55.952] Starting the invocation (attempt 1)
[04:05:55.980] Popped buildset tag "buildset:commit/gitiles/pigweed.googlesource.com/pigweed/showcase/sense/+/ccf5caffc342e465ae00cbef791a471d24f2b85e"
[04:05:55.980] Popped gitiles commit info from properties and tags
[04:05:55.980] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[04:05:55.981] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[04:05:55.981] Buildbucket request:
{
  "requestId": "8858613178662908144",
  "builder": {
    "project": "pigweed",
    "bucket": "showcase.sense.dev.ci",
    "builder": "showcase-sense-linux-bazel"
  },
  "properties": {
      "$recipe_engine/scheduler": {
            "hostname": "luci-scheduler.appspot.com",
            "invocation": "8858613178662908144",
            "job": "pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel",
            "triggers": [
                  {
                        "gitiles": {
                              "ref": "refs/heads/main",
                              "repo": "https://pigweed.googlesource.com/pigweed/showcase/sense",
                              "revision": "ccf5caffc342e465ae00cbef791a471d24f2b85e"
                            },
                        "id": "https://pigweed.googlesource.com/pigweed/showcase/sense/+/refs/heads/main@ccf5caffc342e465ae00cbef791a471d24f2b85e",
                        "title": "ccf5caffc342e465ae00cbef791a471d24f2b85e",
                        "url": "https://pigweed.googlesource.com/pigweed/showcase/sense/+/ccf5caffc342e465ae00cbef791a471d24f2b85e"
                      }
                ]
          }
    },
  "gitilesCommit": {
    "host": "pigweed.googlesource.com",
    "project": "pigweed/showcase/sense",
    "id": "ccf5caffc342e465ae00cbef791a471d24f2b85e",
    "ref": "refs/heads/main"
  },
  "tags": [
    {
      "key": "scheduler_invocation_id",
      "value": "8858613178662908144"
    },
    {
      "key": "scheduler_job_id",
      "value": "pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel"
    },
    {
      "key": "user_agent",
      "value": "luci-scheduler"
    }
  ],
  "notify": {
    "pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
  }
}
[04:05:56.397] Scheduled build:
{
  "id": "8693183116660409329",
  "builder": {
    "project": "pigweed",
    "bucket": "showcase.sense.dev.ci",
    "builder": "showcase-sense-linux-bazel"
  },
  "createdBy": "project:pigweed",
  "createTime": "2026-01-09T04:05:56.032395510Z",
  "updateTime": "2026-01-09T04:05:56.032395510Z",
  "status": "SCHEDULED",
  "input": {
    "gitilesCommit": {
      "host": "pigweed.googlesource.com",
      "project": "pigweed/showcase/sense",
      "id": "ccf5caffc342e465ae00cbef791a471d24f2b85e",
      "ref": "refs/heads/main"
    }
  }
}
[04:05:56.397] Task URL: https://cr-buildbucket.appspot.com/build/8693183116660409329
[04:05:56.397] Scheduling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:2:0) after 1m52s
[04:05:57.324] Received PubSub notification, asking Buildbucket for the build status
[04:05:57.377] Build status: SCHEDULED
[04:07:48.411] Handling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:2:0)
[04:07:48.440] Build status: SCHEDULED
[04:07:48.440] Scheduling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:4:0) after 6m36s
[04:14:24.506] Handling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:4:0)
[04:14:24.562] Build status: SCHEDULED
[04:14:24.562] Scheduling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:5:0) after 2m46s
[04:17:10.613] Handling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:5:0)
[04:17:10.818] Build status: SCHEDULED
[04:17:10.818] Scheduling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:6:0) after 6m25s
[04:23:35.825] Handling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:6:0)
[04:23:36.013] Build status: SCHEDULED
[04:23:36.013] Scheduling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:7:0) after 4m4s
[04:27:40.066] Handling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:7:0)
[04:27:40.098] Build status: SCHEDULED
[04:27:40.098] Scheduling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:8:0) after 2m40s
[04:30:20.110] Handling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:8:0)
[04:30:20.129] Build status: SCHEDULED
[04:30:20.129] Scheduling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:9:0) after 1m14s
[04:31:34.191] Handling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:9:0)
[04:31:34.222] Build status: SCHEDULED
[04:31:34.222] Scheduling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:10:0) after 1m44s
[04:33:18.236] Handling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:10:0)
[04:33:18.251] Build status: SCHEDULED
[04:33:18.251] Scheduling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:11:0) after 9m50s
[04:43:08.380] Handling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:11:0)
[04:43:08.393] Build status: SCHEDULED
[04:43:08.393] Scheduling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:12:0) after 1m43s
[04:44:51.407] Handling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:12:0)
[04:44:51.470] Build status: SCHEDULED
[04:44:51.470] Scheduling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:13:0) after 5m3s
[04:49:54.477] Handling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:13:0)
[04:49:54.494] Build status: SCHEDULED
[04:49:54.495] Scheduling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:14:0) after 7m58s
[04:57:52.546] Handling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:14:0)
[04:57:52.574] Build status: SCHEDULED
[04:57:52.574] Scheduling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:15:0) after 9m40s
[05:07:32.636] Handling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:15:0)
[05:07:32.664] Build status: SCHEDULED
[05:07:32.664] Scheduling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:16:0) after 9m9s
[05:16:41.801] Handling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:16:0)
[05:16:41.832] Build status: SCHEDULED
[05:16:41.832] Scheduling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:17:0) after 6m44s
[05:23:25.844] Handling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:17:0)
[05:23:25.857] Build status: SCHEDULED
[05:23:25.857] Scheduling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:18:0) after 5m44s
[05:29:09.873] Handling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:18:0)
[05:29:09.930] Build status: SCHEDULED
[05:29:09.930] Scheduling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:19:0) after 8m37s
[05:37:46.994] Handling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:19:0)
[05:37:47.020] Build status: SCHEDULED
[05:37:47.020] Scheduling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:20:0) after 5m42s
[05:43:29.109] Handling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:20:0)
[05:43:29.123] Build status: SCHEDULED
[05:43:29.123] Scheduling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:21:0) after 2m32s
[05:46:01.220] Handling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:21:0)
[05:46:01.241] Build status: SCHEDULED
[05:46:01.241] Scheduling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:22:0) after 2m9s
[05:48:10.301] Handling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:22:0)
[05:48:10.327] Build status: SCHEDULED
[05:48:10.328] Scheduling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:23:0) after 5m54s
[05:54:04.390] Handling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:23:0)
[05:54:04.415] Build status: SCHEDULED
[05:54:04.415] Scheduling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:24:0) after 8m34s
[06:02:38.428] Handling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:24:0)
[06:02:38.455] Build status: SCHEDULED
[06:02:38.455] Scheduling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:25:0) after 4m32s
[06:07:10.519] Handling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:25:0)
[06:07:10.547] Build status: SCHEDULED
[06:07:10.547] Scheduling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:26:0) after 2m59s
[06:10:09.560] Handling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:26:0)
[06:10:09.649] Build status: SCHEDULED
[06:10:09.653] Scheduling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:27:0) after 8m22s
[06:18:31.694] Handling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:27:0)
[06:18:31.711] Build status: SCHEDULED
[06:18:31.711] Scheduling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:28:0) after 9m57s
[06:28:28.738] Handling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:28:0)
[06:28:28.752] Build status: SCHEDULED
[06:28:28.752] Scheduling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:29:0) after 4m12s
[06:32:40.766] Handling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:29:0)
[06:32:40.781] Build status: SCHEDULED
[06:32:40.781] Scheduling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:30:0) after 1m14s
[06:33:54.801] Handling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:30:0)
[06:33:54.817] Build status: SCHEDULED
[06:33:54.817] Scheduling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:31:0) after 4m52s
[06:38:46.942] Handling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:31:0)
[06:38:46.962] Build status: SCHEDULED
[06:38:46.962] Scheduling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:32:0) after 9m24s
[06:48:10.989] Handling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:32:0)
[06:48:11.005] Build status: SCHEDULED
[06:48:11.005] Scheduling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:33:0) after 1m31s
[06:49:42.165] Handling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:33:0)
[06:49:42.189] Build status: SCHEDULED
[06:49:42.189] Scheduling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:34:0) after 2m36s
[06:52:18.206] Handling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:34:0)
[06:52:18.222] Build status: SCHEDULED
[06:52:18.222] Scheduling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:35:0) after 4m22s
[06:56:40.237] Handling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:35:0)
[06:56:40.268] Build status: SCHEDULED
[06:56:40.268] Scheduling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:36:0) after 2m48s
[06:59:28.416] Handling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:36:0)
[06:59:28.436] Build status: SCHEDULED
[06:59:28.436] Scheduling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:37:0) after 2m59s
[07:02:27.450] Handling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:37:0)
[07:02:27.515] Build status: SCHEDULED
[07:02:27.515] Scheduling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:38:0) after 4m50s
[07:07:17.529] Handling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:38:0)
[07:07:17.543] Build status: SCHEDULED
[07:07:17.543] Scheduling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:39:0) after 6m48s
[07:14:05.599] Handling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:39:0)
[07:14:05.708] Build status: SCHEDULED
[07:14:05.708] Scheduling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:40:0) after 3m19s
[07:17:24.766] Handling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:40:0)
[07:17:24.785] Build status: SCHEDULED
[07:17:24.785] Scheduling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:41:0) after 9m58s
[07:27:22.850] Handling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:41:0)
[07:27:22.863] Build status: SCHEDULED
[07:27:22.863] Scheduling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:42:0) after 1m36s
[07:28:58.878] Handling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:42:0)
[07:28:58.924] Build status: SCHEDULED
[07:28:58.924] Scheduling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:43:0) after 4m4s
[07:33:02.968] Handling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:43:0)
[07:33:03.047] Build status: SCHEDULED
[07:33:03.047] Scheduling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:44:0) after 9m1s
[07:42:04.079] Handling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:44:0)
[07:42:04.121] Build status: SCHEDULED
[07:42:04.121] Scheduling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:45:0) after 1m6s
[07:43:10.194] Handling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:45:0)
[07:43:10.219] Build status: SCHEDULED
[07:43:10.219] Scheduling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:46:0) after 3m15s
[07:46:25.233] Handling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:46:0)
[07:46:25.264] Build status: SCHEDULED
[07:46:25.264] Scheduling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:47:0) after 4m31s
[07:50:56.277] Handling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:47:0)
[07:50:56.291] Build status: SCHEDULED
[07:50:56.291] Scheduling timer "check-buildbucket-build-status" (pigweed/showcase.sense.dev.ci-showcase-sense-linux-bazel:8858613178662908144:48:0) after 7m0s
[07:51:23.616] Received PubSub notification, asking Buildbucket for the build status
[07:51:23.638] Build status: STARTED
[07:52:02.527] Received PubSub notification, asking Buildbucket for the build status
[07:52:02.550] Build:
{
  "id": "8693183116660409329",
  "builder": {
    "project": "pigweed",
    "bucket": "showcase.sense.dev.ci",
    "builder": "showcase-sense-linux-bazel"
  },
  "createdBy": "project:pigweed",
  "createTime": "2026-01-09T04:05:56.032395510Z",
  "startTime": "2026-01-09T07:51:23.460800135Z",
  "endTime": "2026-01-09T07:52:02.121884435Z",
  "updateTime": "2026-01-09T07:52:02.121884435Z",
  "status": "FAILURE",
  "input": {
    "gitilesCommit": {
      "host": "pigweed.googlesource.com",
      "project": "pigweed/showcase/sense",
      "id": "ccf5caffc342e465ae00cbef791a471d24f2b85e",
      "ref": "refs/heads/main"
    }
  }
}
[07:52:02.550] Invocation finished in 3h46m7.810659277s with status FAILED