[21:31:44.465] New invocation is queued and will start shortly
[21:31:44.465] Triggered by user:rerunner@pigweed-service-accounts.iam.gserviceaccount.com
[21:31:45.565] Starting the invocation (attempt 1)
[21:31:45.590] Ignoring gitiles_ref tag without the buildset tag
[21:31:45.590] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[21:31:45.590] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[21:31:45.590] Buildbucket request:
{
"requestId": "8851843205303239552",
"builder": {
"project": "pigweed",
"bucket": "pigweed.dev.ci",
"builder": "pigweed-linux-bazel-rust"
},
"properties": {
"$recipe_engine/scheduler": {
"hostname": "luci-scheduler.appspot.com",
"invocation": "8851843205303239552",
"job": "pigweed/pigweed.dev.ci-pigweed-linux-bazel-rust",
"triggers": [
{
"buildbucket": {
"tags": [
"parent_buildername:rerunner",
"user_agent:rerunner"
]
},
"id": "c0198a5d-afe9-47fb-b3b3-5992a08eb46a",
"title": "rerunner/0",
"url": "https://cr-buildbucket.appspot.com/build/8686413371176204993"
}
]
}
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8851843205303239552"
},
{
"key": "scheduler_job_id",
"value": "pigweed/pigweed.dev.ci-pigweed-linux-bazel-rust"
},
{
"key": "user_agent",
"value": "luci-scheduler"
},
{
"key": "parent_buildername",
"value": "rerunner"
},
{
"key": "user_agent",
"value": "rerunner"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[21:31:46.015] Scheduled build:
{
"id": "8686413143407853201",
"builder": {
"project": "pigweed",
"bucket": "pigweed.dev.ci",
"builder": "pigweed-linux-bazel-rust"
},
"createdBy": "project:pigweed",
"createTime": "2026-03-24T21:31:45.646826225Z",
"updateTime": "2026-03-24T21:31:45.646826225Z",
"status": "SCHEDULED",
"input": {
}
}
[21:31:46.015] Task URL: https://cr-buildbucket.appspot.com/build/8686413143407853201
[21:31:46.015] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-rust:8851843205303239552:2:0) after 6m38s
[21:31:46.264] Received PubSub notification, asking Buildbucket for the build status
[21:31:46.380] Build status: SCHEDULED
[21:38:24.116] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-rust:8851843205303239552:2:0)
[21:38:24.133] Build status: SCHEDULED
[21:38:24.133] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-rust:8851843205303239552:4:0) after 8m6s
[21:46:30.185] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-rust:8851843205303239552:4:0)
[21:46:30.213] Build status: SCHEDULED
[21:46:30.213] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-rust:8851843205303239552:5:0) after 4m19s
[21:50:49.269] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-rust:8851843205303239552:5:0)
[21:50:49.289] Build status: SCHEDULED
[21:50:49.290] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-rust:8851843205303239552:6:0) after 3m32s
[21:54:21.308] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-rust:8851843205303239552:6:0)
[21:54:21.324] Build status: SCHEDULED
[21:54:21.324] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-rust:8851843205303239552:7:0) after 3m12s
[21:57:33.361] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-rust:8851843205303239552:7:0)
[21:57:33.380] Build status: SCHEDULED
[21:57:33.380] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-rust:8851843205303239552:8:0) after 5m25s
[22:02:58.401] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-rust:8851843205303239552:8:0)
[22:02:58.419] Build status: SCHEDULED
[22:02:58.419] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-rust:8851843205303239552:9:0) after 9m55s
[22:12:53.434] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-rust:8851843205303239552:9:0)
[22:12:53.501] Build status: SCHEDULED
[22:12:53.501] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-rust:8851843205303239552:10:0) after 9m26s
[22:22:19.516] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-rust:8851843205303239552:10:0)
[22:22:19.537] Build status: SCHEDULED
[22:22:19.537] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-rust:8851843205303239552:11:0) after 9m30s
[22:31:49.583] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-rust:8851843205303239552:11:0)
[22:31:49.599] Build status: SCHEDULED
[22:31:49.599] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-rust:8851843205303239552:12:0) after 3m19s
[22:35:08.567] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-rust:8851843205303239552:12:0)
[22:35:08.654] Build status: SCHEDULED
[22:35:08.654] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-rust:8851843205303239552:13:0) after 8m54s
[22:44:02.717] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-rust:8851843205303239552:13:0)
[22:44:02.777] Build status: SCHEDULED
[22:44:02.777] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-rust:8851843205303239552:14:0) after 1m41s
[22:45:43.795] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-rust:8851843205303239552:14:0)
[22:45:43.816] Build status: SCHEDULED
[22:45:43.816] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-rust:8851843205303239552:15:0) after 3m19s
[22:49:02.927] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-rust:8851843205303239552:15:0)
[22:49:02.942] Build status: SCHEDULED
[22:49:02.942] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-rust:8851843205303239552:16:0) after 1m29s
[22:50:31.999] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-rust:8851843205303239552:16:0)
[22:50:32.022] Build status: SCHEDULED
[22:50:32.022] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-rust:8851843205303239552:17:0) after 1m59s
[22:52:31.072] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-rust:8851843205303239552:17:0)
[22:52:31.088] Build status: SCHEDULED
[22:52:31.088] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-rust:8851843205303239552:18:0) after 6m0s
[22:58:31.165] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-rust:8851843205303239552:18:0)
[22:58:31.180] Build status: SCHEDULED
[22:58:31.180] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-rust:8851843205303239552:19:0) after 6m9s
[23:04:40.152] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-rust:8851843205303239552:19:0)
[23:04:40.172] Build status: SCHEDULED
[23:04:40.172] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-rust:8851843205303239552:20:0) after 2m28s
[23:07:08.184] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-rust:8851843205303239552:20:0)
[23:07:08.197] Build status: SCHEDULED
[23:07:08.197] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-rust:8851843205303239552:21:0) after 4m46s
[23:11:54.292] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-rust:8851843205303239552:21:0)
[23:11:54.309] Build status: SCHEDULED
[23:11:54.309] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-rust:8851843205303239552:22:0) after 2m7s
[23:14:01.373] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-rust:8851843205303239552:22:0)
[23:14:01.393] Build status: SCHEDULED
[23:14:01.393] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-rust:8851843205303239552:23:0) after 3m50s
[23:17:51.407] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-rust:8851843205303239552:23:0)
[23:17:51.426] Build status: SCHEDULED
[23:17:51.426] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-rust:8851843205303239552:24:0) after 3m56s
[23:21:47.521] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-rust:8851843205303239552:24:0)
[23:21:47.551] Build status: SCHEDULED
[23:21:47.551] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-rust:8851843205303239552:25:0) after 9m2s
[23:30:49.565] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-rust:8851843205303239552:25:0)
[23:30:49.596] Build status: SCHEDULED
[23:30:49.596] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-rust:8851843205303239552:26:0) after 9m42s
[23:40:31.606] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-rust:8851843205303239552:26:0)
[23:40:31.622] Build status: SCHEDULED
[23:40:31.622] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-rust:8851843205303239552:27:0) after 5m15s
[23:45:46.685] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-rust:8851843205303239552:27:0)
[23:45:46.703] Build status: SCHEDULED
[23:45:46.703] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-rust:8851843205303239552:28:0) after 4m55s
[23:50:41.756] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-rust:8851843205303239552:28:0)
[23:50:41.772] Build status: SCHEDULED
[23:50:41.772] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-rust:8851843205303239552:29:0) after 5m30s
[23:56:11.836] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-rust:8851843205303239552:29:0)
[23:56:11.858] Build status: SCHEDULED
[23:56:11.858] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-rust:8851843205303239552:30:0) after 9m49s
[00:06:00.960] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-rust:8851843205303239552:30:0)
[00:06:00.981] Build status: SCHEDULED
[00:06:00.981] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-rust:8851843205303239552:31:0) after 6m0s
[00:12:00.948] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-rust:8851843205303239552:31:0)
[00:12:00.967] Build status: SCHEDULED
[00:12:00.967] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-rust:8851843205303239552:32:0) after 4m36s
[00:14:26.554] Received PubSub notification, asking Buildbucket for the build status
[00:14:26.601] Build status: STARTED
[00:16:36.984] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-rust:8851843205303239552:32:0)
[00:16:37.006] Build status: STARTED
[00:16:37.006] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-rust:8851843205303239552:34:0) after 1m0s
[00:17:37.143] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-rust:8851843205303239552:34:0)
[00:17:37.239] Build status: STARTED
[00:17:37.240] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-rust:8851843205303239552:35:0) after 4m20s
[00:19:41.932] Received PubSub notification, asking Buildbucket for the build status
[00:19:41.990] Build:
{
"id": "8686413143407853201",
"builder": {
"project": "pigweed",
"bucket": "pigweed.dev.ci",
"builder": "pigweed-linux-bazel-rust"
},
"createdBy": "project:pigweed",
"createTime": "2026-03-24T21:31:45.646826225Z",
"startTime": "2026-03-25T00:14:26.103485445Z",
"endTime": "2026-03-25T00:19:41.568587511Z",
"updateTime": "2026-03-25T00:19:41.568587511Z",
"status": "FAILURE",
"input": {
}
}
[00:19:41.990] Invocation finished in 2h47m57.535273054s with status FAILED