[18:27:24.854] New invocation is queued and will start shortly
[18:27:26.916] Starting the invocation (attempt 1)
[18:27:26.941] Popped buildset tag "buildset:commit/gitiles/fuchsia.googlesource.com/integration/+/6fdd01ebe7658154c250f3fb5c3c43137b417860"
[18:27:26.941] Popped gitiles commit info from properties and tags
[18:27:26.941] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[18:27:26.942] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[18:27:26.942] Buildbucket request:
{
"requestId": "8846147193257060736",
"builder": {
"project": "fuchsia",
"bucket": "global.ci",
"builder": "minimal.riscv64-debug"
},
"properties": {
"$recipe_engine/scheduler": {
"hostname": "luci-scheduler.appspot.com",
"invocation": "8846147193257060736",
"job": "fuchsia/global.ci-minimal.riscv64-debug-e5a0ec7f",
"triggers": [
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "4e3d67d398fe94023351a17190358c618059505a"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@4e3d67d398fe94023351a17190358c618059505a",
"title": "4e3d67d398fe94023351a17190358c618059505a",
"url": "https://fuchsia.googlesource.com/integration/+/4e3d67d398fe94023351a17190358c618059505a"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "827dc15af74bb035c44fb511c5dea5844b12677b"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@827dc15af74bb035c44fb511c5dea5844b12677b",
"title": "827dc15af74bb035c44fb511c5dea5844b12677b",
"url": "https://fuchsia.googlesource.com/integration/+/827dc15af74bb035c44fb511c5dea5844b12677b"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "2e5cd7d443440d18a3a80fab1e35565de4159795"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@2e5cd7d443440d18a3a80fab1e35565de4159795",
"title": "2e5cd7d443440d18a3a80fab1e35565de4159795",
"url": "https://fuchsia.googlesource.com/integration/+/2e5cd7d443440d18a3a80fab1e35565de4159795"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "de8b533b01d12dbf7c7e9a77e0738e76a3b57c49"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@de8b533b01d12dbf7c7e9a77e0738e76a3b57c49",
"title": "de8b533b01d12dbf7c7e9a77e0738e76a3b57c49",
"url": "https://fuchsia.googlesource.com/integration/+/de8b533b01d12dbf7c7e9a77e0738e76a3b57c49"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "b2ebfe7b93143d5b91accaf96a93624dbab7a791"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@b2ebfe7b93143d5b91accaf96a93624dbab7a791",
"title": "b2ebfe7b93143d5b91accaf96a93624dbab7a791",
"url": "https://fuchsia.googlesource.com/integration/+/b2ebfe7b93143d5b91accaf96a93624dbab7a791"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "e5362ca98c00d49b59d20d2de6e84335c6124563"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@e5362ca98c00d49b59d20d2de6e84335c6124563",
"title": "e5362ca98c00d49b59d20d2de6e84335c6124563",
"url": "https://fuchsia.googlesource.com/integration/+/e5362ca98c00d49b59d20d2de6e84335c6124563"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "18d9ab19235f84e218c49bf9639740a453dac0b6"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@18d9ab19235f84e218c49bf9639740a453dac0b6",
"title": "18d9ab19235f84e218c49bf9639740a453dac0b6",
"url": "https://fuchsia.googlesource.com/integration/+/18d9ab19235f84e218c49bf9639740a453dac0b6"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "2964c15cbfb50d77889d8f754e3b4d3ae1b4d64c"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@2964c15cbfb50d77889d8f754e3b4d3ae1b4d64c",
"title": "2964c15cbfb50d77889d8f754e3b4d3ae1b4d64c",
"url": "https://fuchsia.googlesource.com/integration/+/2964c15cbfb50d77889d8f754e3b4d3ae1b4d64c"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "c8715562bcb94d1dbe976de0ee6910b3c345f84c"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@c8715562bcb94d1dbe976de0ee6910b3c345f84c",
"title": "c8715562bcb94d1dbe976de0ee6910b3c345f84c",
"url": "https://fuchsia.googlesource.com/integration/+/c8715562bcb94d1dbe976de0ee6910b3c345f84c"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "a4f68c2c422fe124eba1623a00d7702a5cf20b16"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@a4f68c2c422fe124eba1623a00d7702a5cf20b16",
"title": "a4f68c2c422fe124eba1623a00d7702a5cf20b16",
"url": "https://fuchsia.googlesource.com/integration/+/a4f68c2c422fe124eba1623a00d7702a5cf20b16"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "5007d00dce6df263d2c472738c148f832980553e"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@5007d00dce6df263d2c472738c148f832980553e",
"title": "5007d00dce6df263d2c472738c148f832980553e",
"url": "https://fuchsia.googlesource.com/integration/+/5007d00dce6df263d2c472738c148f832980553e"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "b9607f6df3298941743904d48cfa06427f57a78f"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@b9607f6df3298941743904d48cfa06427f57a78f",
"title": "b9607f6df3298941743904d48cfa06427f57a78f",
"url": "https://fuchsia.googlesource.com/integration/+/b9607f6df3298941743904d48cfa06427f57a78f"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "80c2f6d01523bae415c09b7a24e705c200a7f171"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@80c2f6d01523bae415c09b7a24e705c200a7f171",
"title": "80c2f6d01523bae415c09b7a24e705c200a7f171",
"url": "https://fuchsia.googlesource.com/integration/+/80c2f6d01523bae415c09b7a24e705c200a7f171"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "99e984a4f56b960704ffb57ce19384bcbcbe035f"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@99e984a4f56b960704ffb57ce19384bcbcbe035f",
"title": "99e984a4f56b960704ffb57ce19384bcbcbe035f",
"url": "https://fuchsia.googlesource.com/integration/+/99e984a4f56b960704ffb57ce19384bcbcbe035f"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "8a91ce3cf84352cc275e30ef65f152d59ddd4001"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@8a91ce3cf84352cc275e30ef65f152d59ddd4001",
"title": "8a91ce3cf84352cc275e30ef65f152d59ddd4001",
"url": "https://fuchsia.googlesource.com/integration/+/8a91ce3cf84352cc275e30ef65f152d59ddd4001"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "88e9600e7953cdee9081ab149fbae62efbe467d7"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@88e9600e7953cdee9081ab149fbae62efbe467d7",
"title": "88e9600e7953cdee9081ab149fbae62efbe467d7",
"url": "https://fuchsia.googlesource.com/integration/+/88e9600e7953cdee9081ab149fbae62efbe467d7"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "6fdd01ebe7658154c250f3fb5c3c43137b417860"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@6fdd01ebe7658154c250f3fb5c3c43137b417860",
"title": "6fdd01ebe7658154c250f3fb5c3c43137b417860",
"url": "https://fuchsia.googlesource.com/integration/+/6fdd01ebe7658154c250f3fb5c3c43137b417860"
}
]
}
},
"gitilesCommit": {
"host": "fuchsia.googlesource.com",
"project": "integration",
"id": "6fdd01ebe7658154c250f3fb5c3c43137b417860",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8846147193257060736"
},
{
"key": "scheduler_job_id",
"value": "fuchsia/global.ci-minimal.riscv64-debug-e5a0ec7f"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[18:27:27.509] Scheduled build:
{
"id": "8680717130314053809",
"builder": {
"project": "fuchsia",
"bucket": "global.ci",
"builder": "minimal.riscv64-debug"
},
"createdBy": "project:fuchsia",
"createTime": "2026-05-26T18:27:27.039581941Z",
"updateTime": "2026-05-26T18:27:27.039581941Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "fuchsia.googlesource.com",
"project": "integration",
"id": "6fdd01ebe7658154c250f3fb5c3c43137b417860",
"ref": "refs/heads/main"
}
}
}
[18:27:27.509] Task URL: https://cr-buildbucket.appspot.com/build/8680717130314053809
[18:27:27.509] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-debug-e5a0ec7f:8846147193257060736:2:0) after 1m47s
[18:27:28.524] Received PubSub notification, asking Buildbucket for the build status
[18:27:28.542] Build status: SCHEDULED
[18:29:14.527] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-debug-e5a0ec7f:8846147193257060736:2:0)
[18:29:14.555] Build status: SCHEDULED
[18:29:14.555] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-debug-e5a0ec7f:8846147193257060736:4:0) after 3m24s
[18:31:56.728] Received PubSub notification, asking Buildbucket for the build status
[18:31:56.748] Build status: STARTED
[18:32:38.640] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-debug-e5a0ec7f:8846147193257060736:4:0)
[18:32:38.662] Build status: STARTED
[18:32:38.662] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-debug-e5a0ec7f:8846147193257060736:6:0) after 2m48s
[18:35:26.700] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-debug-e5a0ec7f:8846147193257060736:6:0)
[18:35:26.722] Build status: STARTED
[18:35:26.722] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-debug-e5a0ec7f:8846147193257060736:7:0) after 2m12s
[18:37:38.785] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-debug-e5a0ec7f:8846147193257060736:7:0)
[18:37:38.832] Build status: STARTED
[18:37:38.832] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-debug-e5a0ec7f:8846147193257060736:8:0) after 3m22s
[18:41:00.968] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-debug-e5a0ec7f:8846147193257060736:8:0)
[18:41:00.993] Build status: STARTED
[18:41:00.993] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-debug-e5a0ec7f:8846147193257060736:9:0) after 2m11s
[18:43:12.160] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-debug-e5a0ec7f:8846147193257060736:9:0)
[18:43:12.175] Build status: STARTED
[18:43:12.175] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-debug-e5a0ec7f:8846147193257060736:10:0) after 3m38s
[18:46:50.275] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-debug-e5a0ec7f:8846147193257060736:10:0)
[18:46:50.296] Build status: STARTED
[18:46:50.296] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-debug-e5a0ec7f:8846147193257060736:11:0) after 9m20s
[18:56:10.324] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-debug-e5a0ec7f:8846147193257060736:11:0)
[18:56:10.364] Build status: STARTED
[18:56:10.364] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-debug-e5a0ec7f:8846147193257060736:12:0) after 6m54s
[19:03:04.385] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-debug-e5a0ec7f:8846147193257060736:12:0)
[19:03:04.413] Build status: STARTED
[19:03:04.413] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-debug-e5a0ec7f:8846147193257060736:13:0) after 2m43s
[19:05:47.431] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-debug-e5a0ec7f:8846147193257060736:13:0)
[19:05:47.530] Build status: STARTED
[19:05:47.530] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-debug-e5a0ec7f:8846147193257060736:14:0) after 4m28s
[19:10:15.554] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-debug-e5a0ec7f:8846147193257060736:14:0)
[19:10:15.575] Build status: STARTED
[19:10:15.575] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-debug-e5a0ec7f:8846147193257060736:15:0) after 2m18s
[19:12:33.589] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-debug-e5a0ec7f:8846147193257060736:15:0)
[19:12:33.637] Build status: STARTED
[19:12:33.637] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-debug-e5a0ec7f:8846147193257060736:16:0) after 2m43s
[19:15:16.912] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-debug-e5a0ec7f:8846147193257060736:16:0)
[19:15:16.968] Build status: STARTED
[19:15:16.968] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-debug-e5a0ec7f:8846147193257060736:17:0) after 9m3s
[19:24:20.045] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-debug-e5a0ec7f:8846147193257060736:17:0)
[19:24:20.112] Build status: STARTED
[19:24:20.112] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-debug-e5a0ec7f:8846147193257060736:18:0) after 4m1s
[19:28:21.126] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-debug-e5a0ec7f:8846147193257060736:18:0)
[19:28:21.148] Build status: STARTED
[19:28:21.148] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-debug-e5a0ec7f:8846147193257060736:19:0) after 3m52s
[19:32:13.168] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-debug-e5a0ec7f:8846147193257060736:19:0)
[19:32:13.444] Build status: STARTED
[19:32:13.444] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-debug-e5a0ec7f:8846147193257060736:20:0) after 9m1s
[19:41:14.709] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-debug-e5a0ec7f:8846147193257060736:20:0)
[19:41:14.853] Build status: STARTED
[19:41:14.853] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-debug-e5a0ec7f:8846147193257060736:21:0) after 2m12s
[19:43:26.897] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-debug-e5a0ec7f:8846147193257060736:21:0)
[19:43:26.915] Build status: STARTED
[19:43:26.915] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-debug-e5a0ec7f:8846147193257060736:22:0) after 2m20s
[19:45:47.244] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-debug-e5a0ec7f:8846147193257060736:22:0)
[19:45:47.261] Build status: STARTED
[19:45:47.261] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-debug-e5a0ec7f:8846147193257060736:23:0) after 7m9s
[19:52:56.309] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-debug-e5a0ec7f:8846147193257060736:23:0)
[19:52:56.416] Build status: STARTED
[19:52:56.416] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-debug-e5a0ec7f:8846147193257060736:24:0) after 7m43s
[20:00:39.596] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-debug-e5a0ec7f:8846147193257060736:24:0)
[20:00:39.618] Build status: STARTED
[20:00:39.618] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-debug-e5a0ec7f:8846147193257060736:25:0) after 7m29s
[20:08:08.634] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-debug-e5a0ec7f:8846147193257060736:25:0)
[20:08:08.679] Build status: STARTED
[20:08:08.679] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-debug-e5a0ec7f:8846147193257060736:26:0) after 4m46s
[20:12:54.722] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-debug-e5a0ec7f:8846147193257060736:26:0)
[20:12:54.739] Build status: STARTED
[20:12:54.739] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-debug-e5a0ec7f:8846147193257060736:27:0) after 7m42s
[20:20:36.902] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-debug-e5a0ec7f:8846147193257060736:27:0)
[20:20:36.930] Build status: STARTED
[20:20:36.930] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-debug-e5a0ec7f:8846147193257060736:28:0) after 3m45s
[20:24:22.000] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-debug-e5a0ec7f:8846147193257060736:28:0)
[20:24:22.149] Build status: STARTED
[20:24:22.149] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-debug-e5a0ec7f:8846147193257060736:29:0) after 3m16s
[20:27:38.326] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-debug-e5a0ec7f:8846147193257060736:29:0)
[20:27:38.347] Build status: STARTED
[20:27:38.347] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-debug-e5a0ec7f:8846147193257060736:30:0) after 3m21s
[20:30:59.413] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-debug-e5a0ec7f:8846147193257060736:30:0)
[20:30:59.478] Build status: STARTED
[20:30:59.478] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-debug-e5a0ec7f:8846147193257060736:31:0) after 1m43s
[20:32:42.494] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-debug-e5a0ec7f:8846147193257060736:31:0)
[20:32:42.631] Build status: STARTED
[20:32:42.631] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-debug-e5a0ec7f:8846147193257060736:32:0) after 3m32s
[20:34:48.892] Received PubSub notification, asking Buildbucket for the build status
[20:34:48.919] Build:
{
"id": "8680717130314053809",
"builder": {
"project": "fuchsia",
"bucket": "global.ci",
"builder": "minimal.riscv64-debug"
},
"createdBy": "project:fuchsia",
"createTime": "2026-05-26T18:27:27.039581941Z",
"startTime": "2026-05-26T18:31:56.514948816Z",
"endTime": "2026-05-26T20:34:48.541038293Z",
"updateTime": "2026-05-26T20:34:48.541038293Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "fuchsia.googlesource.com",
"project": "integration",
"id": "6fdd01ebe7658154c250f3fb5c3c43137b417860",
"ref": "refs/heads/main"
}
}
}
[20:34:48.919] Invocation finished in 2h7m24.070456087s with status FAILED