[19:54:36.083] New invocation is queued and will start shortly
[19:54:37.185] Starting the invocation (attempt 1)
[19:54:37.219] Popped buildset tag "buildset:commit/gitiles/fuchsia.googlesource.com/integration/+/9e9a6ff05388ba7159a4e49d5fe7456009761952"
[19:54:37.219] Popped gitiles commit info from properties and tags
[19:54:37.219] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[19:54:37.219] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[19:54:37.220] Buildbucket request:
{
"requestId": "8868156770752993728",
"builder": {
"project": "fuchsia",
"bucket": "global.ci",
"builder": "core.x64-kubsan"
},
"properties": {
"$recipe_engine/scheduler": {
"hostname": "luci-scheduler.appspot.com",
"invocation": "8868156770752993728",
"job": "fuchsia/global.ci-core.x64-kubsan-e5a0ec7f",
"triggers": [
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "38ecbb82b46b03818f3f5060080e465ca93027dd"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@38ecbb82b46b03818f3f5060080e465ca93027dd",
"title": "38ecbb82b46b03818f3f5060080e465ca93027dd",
"url": "https://fuchsia.googlesource.com/integration/+/38ecbb82b46b03818f3f5060080e465ca93027dd"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "b1958de262768c7b1d8fb1b571f6f7b56d7fc22b"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@b1958de262768c7b1d8fb1b571f6f7b56d7fc22b",
"title": "b1958de262768c7b1d8fb1b571f6f7b56d7fc22b",
"url": "https://fuchsia.googlesource.com/integration/+/b1958de262768c7b1d8fb1b571f6f7b56d7fc22b"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "cf52e7974a785da051aaf1de9d3a429615440fa3"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@cf52e7974a785da051aaf1de9d3a429615440fa3",
"title": "cf52e7974a785da051aaf1de9d3a429615440fa3",
"url": "https://fuchsia.googlesource.com/integration/+/cf52e7974a785da051aaf1de9d3a429615440fa3"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "29511764f7c6c646f316882290e9f49f10f15357"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@29511764f7c6c646f316882290e9f49f10f15357",
"title": "29511764f7c6c646f316882290e9f49f10f15357",
"url": "https://fuchsia.googlesource.com/integration/+/29511764f7c6c646f316882290e9f49f10f15357"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "f22603535ec64c22d3bdbdff9cfb9b1329b213ee"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@f22603535ec64c22d3bdbdff9cfb9b1329b213ee",
"title": "f22603535ec64c22d3bdbdff9cfb9b1329b213ee",
"url": "https://fuchsia.googlesource.com/integration/+/f22603535ec64c22d3bdbdff9cfb9b1329b213ee"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "e6a08d34193d25cab0ea16089ac237ac75bb4e37"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@e6a08d34193d25cab0ea16089ac237ac75bb4e37",
"title": "e6a08d34193d25cab0ea16089ac237ac75bb4e37",
"url": "https://fuchsia.googlesource.com/integration/+/e6a08d34193d25cab0ea16089ac237ac75bb4e37"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "bc7712171573307aacbfec696f6da7d7d016e0ac"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@bc7712171573307aacbfec696f6da7d7d016e0ac",
"title": "bc7712171573307aacbfec696f6da7d7d016e0ac",
"url": "https://fuchsia.googlesource.com/integration/+/bc7712171573307aacbfec696f6da7d7d016e0ac"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "ba5b72c8f7db3dbecf86ecdcd6c0a2c3e6ddcf94"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@ba5b72c8f7db3dbecf86ecdcd6c0a2c3e6ddcf94",
"title": "ba5b72c8f7db3dbecf86ecdcd6c0a2c3e6ddcf94",
"url": "https://fuchsia.googlesource.com/integration/+/ba5b72c8f7db3dbecf86ecdcd6c0a2c3e6ddcf94"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "3db29f37c30987ebe76a5ec45bb3b27441fc897d"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@3db29f37c30987ebe76a5ec45bb3b27441fc897d",
"title": "3db29f37c30987ebe76a5ec45bb3b27441fc897d",
"url": "https://fuchsia.googlesource.com/integration/+/3db29f37c30987ebe76a5ec45bb3b27441fc897d"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "79de7445a03d7b052e371b710f6a599b0828b3f4"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@79de7445a03d7b052e371b710f6a599b0828b3f4",
"title": "79de7445a03d7b052e371b710f6a599b0828b3f4",
"url": "https://fuchsia.googlesource.com/integration/+/79de7445a03d7b052e371b710f6a599b0828b3f4"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "f14349e102148742e01598d2741e269eff91d46e"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@f14349e102148742e01598d2741e269eff91d46e",
"title": "f14349e102148742e01598d2741e269eff91d46e",
"url": "https://fuchsia.googlesource.com/integration/+/f14349e102148742e01598d2741e269eff91d46e"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "7a066f4279649d25e200c50729d2d742fac2dfb6"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@7a066f4279649d25e200c50729d2d742fac2dfb6",
"title": "7a066f4279649d25e200c50729d2d742fac2dfb6",
"url": "https://fuchsia.googlesource.com/integration/+/7a066f4279649d25e200c50729d2d742fac2dfb6"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "14d6e2e7c0f482c2838607ceb5b7ed5892272087"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@14d6e2e7c0f482c2838607ceb5b7ed5892272087",
"title": "14d6e2e7c0f482c2838607ceb5b7ed5892272087",
"url": "https://fuchsia.googlesource.com/integration/+/14d6e2e7c0f482c2838607ceb5b7ed5892272087"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "e63a045f772965817517153edf3c8cc7e5c23f63"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@e63a045f772965817517153edf3c8cc7e5c23f63",
"title": "e63a045f772965817517153edf3c8cc7e5c23f63",
"url": "https://fuchsia.googlesource.com/integration/+/e63a045f772965817517153edf3c8cc7e5c23f63"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "c954714e6e8324ea8a77c4a96c6579e7c814836b"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@c954714e6e8324ea8a77c4a96c6579e7c814836b",
"title": "c954714e6e8324ea8a77c4a96c6579e7c814836b",
"url": "https://fuchsia.googlesource.com/integration/+/c954714e6e8324ea8a77c4a96c6579e7c814836b"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "27b1ad2491e659edd02e35be558b5a9d5eaa1755"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@27b1ad2491e659edd02e35be558b5a9d5eaa1755",
"title": "27b1ad2491e659edd02e35be558b5a9d5eaa1755",
"url": "https://fuchsia.googlesource.com/integration/+/27b1ad2491e659edd02e35be558b5a9d5eaa1755"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "b59af56edbc1d9dfe694cfb13e2b47863ebd76b2"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@b59af56edbc1d9dfe694cfb13e2b47863ebd76b2",
"title": "b59af56edbc1d9dfe694cfb13e2b47863ebd76b2",
"url": "https://fuchsia.googlesource.com/integration/+/b59af56edbc1d9dfe694cfb13e2b47863ebd76b2"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "422e5fe2fd3a74f28409d3ad300bb0c592c2c7b0"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@422e5fe2fd3a74f28409d3ad300bb0c592c2c7b0",
"title": "422e5fe2fd3a74f28409d3ad300bb0c592c2c7b0",
"url": "https://fuchsia.googlesource.com/integration/+/422e5fe2fd3a74f28409d3ad300bb0c592c2c7b0"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "88a6a9467b1bafd507c8c436bea0cfa664fa7419"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@88a6a9467b1bafd507c8c436bea0cfa664fa7419",
"title": "88a6a9467b1bafd507c8c436bea0cfa664fa7419",
"url": "https://fuchsia.googlesource.com/integration/+/88a6a9467b1bafd507c8c436bea0cfa664fa7419"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "9e9a6ff05388ba7159a4e49d5fe7456009761952"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@9e9a6ff05388ba7159a4e49d5fe7456009761952",
"title": "9e9a6ff05388ba7159a4e49d5fe7456009761952",
"url": "https://fuchsia.googlesource.com/integration/+/9e9a6ff05388ba7159a4e49d5fe7456009761952"
}
]
}
},
"gitilesCommit": {
"host": "fuchsia.googlesource.com",
"project": "integration",
"id": "9e9a6ff05388ba7159a4e49d5fe7456009761952",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8868156770752993728"
},
{
"key": "scheduler_job_id",
"value": "fuchsia/global.ci-core.x64-kubsan-e5a0ec7f"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[19:54:37.640] Scheduled build:
{
"id": "8702726708834144561",
"builder": {
"project": "fuchsia",
"bucket": "global.ci",
"builder": "core.x64-kubsan"
},
"createdBy": "project:fuchsia",
"createTime": "2025-09-25T19:54:37.290035494Z",
"updateTime": "2025-09-25T19:54:37.290035494Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "fuchsia.googlesource.com",
"project": "integration",
"id": "9e9a6ff05388ba7159a4e49d5fe7456009761952",
"ref": "refs/heads/main"
}
}
}
[19:54:37.640] Task URL: https://cr-buildbucket.appspot.com/build/8702726708834144561
[19:54:37.640] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868156770752993728:2:0) after 1m28s
[19:54:38.025] Received PubSub notification, asking Buildbucket for the build status
[19:54:38.081] Build status: SCHEDULED
[19:55:40.948] Received PubSub notification, asking Buildbucket for the build status
[19:55:40.966] Build status: STARTED
[19:56:05.656] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868156770752993728:2:0)
[19:56:05.738] Build status: STARTED
[19:56:05.738] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868156770752993728:5:0) after 6m22s
[20:02:27.844] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868156770752993728:5:0)
[20:02:27.863] Build status: STARTED
[20:02:27.863] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868156770752993728:6:0) after 5m48s
[20:08:15.964] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868156770752993728:6:0)
[20:08:15.989] Build status: STARTED
[20:08:15.989] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868156770752993728:7:0) after 8m13s
[20:16:29.009] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868156770752993728:7:0)
[20:16:29.025] Build status: STARTED
[20:16:29.025] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868156770752993728:8:0) after 6m23s
[20:22:52.023] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868156770752993728:8:0)
[20:22:52.052] Build status: STARTED
[20:22:52.052] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868156770752993728:9:0) after 3m40s
[20:26:32.067] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868156770752993728:9:0)
[20:26:32.083] Build status: STARTED
[20:26:32.083] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868156770752993728:10:0) after 5m22s
[20:31:54.150] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868156770752993728:10:0)
[20:31:54.307] Build status: STARTED
[20:31:54.307] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868156770752993728:11:0) after 5m7s
[20:37:01.378] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868156770752993728:11:0)
[20:37:01.393] Build status: STARTED
[20:37:01.393] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868156770752993728:12:0) after 6m33s
[20:43:34.632] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868156770752993728:12:0)
[20:43:34.771] Build status: STARTED
[20:43:34.771] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868156770752993728:13:0) after 1m3s
[20:44:37.842] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868156770752993728:13:0)
[20:44:37.860] Build status: STARTED
[20:44:37.860] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868156770752993728:14:0) after 4m45s
[20:49:22.990] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868156770752993728:14:0)
[20:49:23.006] Build status: STARTED
[20:49:23.006] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868156770752993728:15:0) after 3m31s
[20:52:54.123] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868156770752993728:15:0)
[20:52:54.143] Build status: STARTED
[20:52:54.143] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868156770752993728:16:0) after 6m55s
[20:59:49.254] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868156770752993728:16:0)
[20:59:49.270] Build status: STARTED
[20:59:49.270] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868156770752993728:17:0) after 9m58s
[21:09:47.288] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868156770752993728:17:0)
[21:09:47.308] Build status: STARTED
[21:09:47.308] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868156770752993728:18:0) after 6m14s
[21:16:01.371] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868156770752993728:18:0)
[21:16:01.445] Build status: STARTED
[21:16:01.445] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868156770752993728:19:0) after 9m58s
[21:25:59.510] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868156770752993728:19:0)
[21:25:59.522] Build status: STARTED
[21:25:59.522] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868156770752993728:20:0) after 8m38s
[21:34:37.711] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868156770752993728:20:0)
[21:34:37.726] Build status: STARTED
[21:34:37.726] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868156770752993728:21:0) after 4m59s
[21:39:36.948] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868156770752993728:21:0)
[21:39:36.966] Build status: STARTED
[21:39:36.966] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868156770752993728:22:0) after 9m48s
[21:49:24.988] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868156770752993728:22:0)
[21:49:25.005] Build status: STARTED
[21:49:25.005] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868156770752993728:23:0) after 5m30s
[21:54:55.040] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868156770752993728:23:0)
[21:54:55.056] Build status: STARTED
[21:54:55.056] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868156770752993728:24:0) after 1m2s
[21:55:57.037] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868156770752993728:24:0)
[21:55:57.089] Build status: STARTED
[21:55:57.089] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868156770752993728:25:0) after 6m40s
[22:02:37.267] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868156770752993728:25:0)
[22:02:37.282] Build status: STARTED
[22:02:37.282] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868156770752993728:26:0) after 4m16s
[22:06:53.401] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868156770752993728:26:0)
[22:06:53.427] Build status: STARTED
[22:06:53.427] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868156770752993728:27:0) after 5m49s
[22:12:42.510] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868156770752993728:27:0)
[22:12:42.535] Build status: STARTED
[22:12:42.535] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868156770752993728:28:0) after 7m18s
[22:18:33.663] Received PubSub notification, asking Buildbucket for the build status
[22:18:33.677] Build:
{
"id": "8702726708834144561",
"builder": {
"project": "fuchsia",
"bucket": "global.ci",
"builder": "core.x64-kubsan"
},
"createdBy": "project:fuchsia",
"createTime": "2025-09-25T19:54:37.290035494Z",
"startTime": "2025-09-25T19:55:40.634200391Z",
"endTime": "2025-09-25T22:18:33.372076160Z",
"updateTime": "2025-09-25T22:18:33.372076160Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "fuchsia.googlesource.com",
"project": "integration",
"id": "9e9a6ff05388ba7159a4e49d5fe7456009761952",
"ref": "refs/heads/main"
}
}
}
[22:18:33.677] Invocation finished in 2h23m57.60103s with status FAILED