[07:21:52.813] New invocation is queued and will start shortly
[07:21:52.813] Triggered by user:rerunner@pigweed-service-accounts.iam.gserviceaccount.com
[07:21:53.981] Starting the invocation (attempt 1)
[07:21:54.010] Ignoring gitiles_ref tag without the buildset tag
[07:21:54.010] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[07:21:54.013] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[07:21:54.013] Buildbucket request:
{
"requestId": "8836585786600399344",
"builder": {
"project": "pigweed",
"bucket": "pigweed.dev.ci",
"builder": "pigweed-mac-arm-bazel-rpc"
},
"properties": {
"$recipe_engine/scheduler": {
"hostname": "luci-scheduler.appspot.com",
"invocation": "8836585786600399344",
"job": "pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rpc",
"triggers": [
{
"buildbucket": {
"tags": [
"parent_buildername:rerunner",
"user_agent:rerunner"
]
},
"id": "907c3da1-2270-4897-881c-7614c50becd4",
"title": "rerunner/0",
"url": "https://cr-buildbucket.appspot.com/build/8671156145503560017"
}
]
}
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8836585786600399344"
},
{
"key": "scheduler_job_id",
"value": "pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rpc"
},
{
"key": "user_agent",
"value": "luci-scheduler"
},
{
"key": "parent_buildername",
"value": "rerunner"
},
{
"key": "user_agent",
"value": "rerunner"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[07:21:54.552] Scheduled build:
{
"id": "8671155724561943409",
"builder": {
"project": "pigweed",
"bucket": "pigweed.dev.ci",
"builder": "pigweed-mac-arm-bazel-rpc"
},
"createdBy": "project:pigweed",
"createTime": "2026-09-09T07:21:54.134684908Z",
"updateTime": "2026-09-09T07:21:54.134684908Z",
"status": "SCHEDULED",
"input": {
}
}
[07:21:54.552] Task URL: https://cr-buildbucket.appspot.com/build/8671155724561943409
[07:21:54.552] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rpc:8836585786600399344:2:0) after 7m10s
[07:21:54.717] Received PubSub notification, asking Buildbucket for the build status
[07:21:54.734] Build status: SCHEDULED
[07:29:04.621] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rpc:8836585786600399344:2:0)
[07:29:04.694] Build status: SCHEDULED
[07:29:04.694] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rpc:8836585786600399344:4:0) after 7m50s
[07:36:54.713] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rpc:8836585786600399344:4:0)
[07:36:54.807] Build status: SCHEDULED
[07:36:54.807] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rpc:8836585786600399344:5:0) after 9m34s
[07:46:28.956] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rpc:8836585786600399344:5:0)
[07:46:28.983] Build status: SCHEDULED
[07:46:28.983] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rpc:8836585786600399344:6:0) after 3m26s
[07:49:55.132] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rpc:8836585786600399344:6:0)
[07:49:55.151] Build status: SCHEDULED
[07:49:55.151] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rpc:8836585786600399344:7:0) after 8m59s
[07:58:54.163] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rpc:8836585786600399344:7:0)
[07:58:54.181] Build status: SCHEDULED
[07:58:54.181] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rpc:8836585786600399344:8:0) after 7m11s
[08:06:05.187] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rpc:8836585786600399344:8:0)
[08:06:05.210] Build status: SCHEDULED
[08:06:05.210] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rpc:8836585786600399344:9:0) after 3m1s
[08:09:06.225] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rpc:8836585786600399344:9:0)
[08:09:06.244] Build status: SCHEDULED
[08:09:06.244] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rpc:8836585786600399344:10:0) after 4m31s
[08:13:37.356] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rpc:8836585786600399344:10:0)
[08:13:37.374] Build status: SCHEDULED
[08:13:37.374] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rpc:8836585786600399344:11:0) after 8m50s
[08:22:27.363] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rpc:8836585786600399344:11:0)
[08:22:27.389] Build status: SCHEDULED
[08:22:27.389] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rpc:8836585786600399344:12:0) after 1m30s
[08:23:57.378] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rpc:8836585786600399344:12:0)
[08:23:57.400] Build status: SCHEDULED
[08:23:57.400] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rpc:8836585786600399344:13:0) after 1m37s
[08:25:34.512] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rpc:8836585786600399344:13:0)
[08:25:34.539] Build status: SCHEDULED
[08:25:34.539] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rpc:8836585786600399344:14:0) after 2m56s
[08:28:30.556] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rpc:8836585786600399344:14:0)
[08:28:30.586] Build status: SCHEDULED
[08:28:30.586] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rpc:8836585786600399344:15:0) after 8m39s
[08:37:09.602] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rpc:8836585786600399344:15:0)
[08:37:09.670] Build status: SCHEDULED
[08:37:09.670] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rpc:8836585786600399344:16:0) after 2m42s
[08:39:51.687] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rpc:8836585786600399344:16:0)
[08:39:51.706] Build status: SCHEDULED
[08:39:51.706] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rpc:8836585786600399344:17:0) after 3m21s
[08:43:12.721] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rpc:8836585786600399344:17:0)
[08:43:12.751] Build status: SCHEDULED
[08:43:12.751] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rpc:8836585786600399344:18:0) after 7m14s
[08:50:26.816] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rpc:8836585786600399344:18:0)
[08:50:26.832] Build status: SCHEDULED
[08:50:26.832] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rpc:8836585786600399344:19:0) after 9m15s
[08:59:41.888] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rpc:8836585786600399344:19:0)
[08:59:41.906] Build status: SCHEDULED
[08:59:41.906] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rpc:8836585786600399344:20:0) after 3m4s
[09:02:45.942] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rpc:8836585786600399344:20:0)
[09:02:45.971] Build status: SCHEDULED
[09:02:45.971] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rpc:8836585786600399344:21:0) after 7m49s
[09:10:34.985] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rpc:8836585786600399344:21:0)
[09:10:35.004] Build status: SCHEDULED
[09:10:35.004] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rpc:8836585786600399344:22:0) after 1m16s
[09:11:51.013] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rpc:8836585786600399344:22:0)
[09:11:51.038] Build status: SCHEDULED
[09:11:51.038] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rpc:8836585786600399344:23:0) after 9m41s
[09:21:32.111] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rpc:8836585786600399344:23:0)
[09:21:32.132] Build status: SCHEDULED
[09:21:32.132] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rpc:8836585786600399344:24:0) after 1m2s
[09:22:34.194] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rpc:8836585786600399344:24:0)
[09:22:34.215] Build status: SCHEDULED
[09:22:34.215] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rpc:8836585786600399344:25:0) after 8m6s
[09:30:40.453] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rpc:8836585786600399344:25:0)
[09:30:40.475] Build status: SCHEDULED
[09:30:40.475] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rpc:8836585786600399344:26:0) after 4m37s
[09:33:25.451] Received PubSub notification, asking Buildbucket for the build status
[09:33:25.475] Build status: STARTED
[09:35:17.605] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rpc:8836585786600399344:26:0)
[09:35:17.624] Build status: STARTED
[09:35:17.624] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rpc:8836585786600399344:28:0) after 6m15s
[09:41:18.806] Received PubSub notification, asking Buildbucket for the build status
[09:41:18.826] Build:
{
"id": "8671155724561943409",
"builder": {
"project": "pigweed",
"bucket": "pigweed.dev.ci",
"builder": "pigweed-mac-arm-bazel-rpc"
},
"createdBy": "project:pigweed",
"createTime": "2026-09-09T07:21:54.134684908Z",
"startTime": "2026-09-09T09:33:07.980700158Z",
"endTime": "2026-09-09T09:41:18.498982015Z",
"updateTime": "2026-09-09T09:41:18.498982015Z",
"status": "FAILURE",
"input": {
}
}
[09:41:18.826] Invocation finished in 2h19m26.020349744s with status FAILED