[08:55:48.638] New invocation is queued and will start shortly
[08:55:48.638] Triggered by user:rerunner@pigweed-service-accounts.iam.gserviceaccount.com
[08:55:50.779] Starting the invocation (attempt 1)
[08:55:50.805] Ignoring gitiles_ref tag without the buildset tag
[08:55:50.805] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[08:55:50.805] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[08:55:50.805] Buildbucket request:
{
"requestId": "8838482413304290400",
"builder": {
"project": "pigweed",
"bucket": "pigweed.dev.ci",
"builder": "pigweed-mac-arm-bazel-host-cpp17-v9"
},
"properties": {
"$recipe_engine/scheduler": {
"hostname": "luci-scheduler.appspot.com",
"invocation": "8838482413304290400",
"job": "pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host-cpp17-v9",
"triggers": [
{
"buildbucket": {
"tags": [
"parent_buildername:rerunner",
"user_agent:rerunner"
]
},
"id": "4e7c715b-ce55-401d-92de-56ad377e14d6",
"title": "rerunner/0",
"url": "https://cr-buildbucket.appspot.com/build/8673052735007136625"
}
]
}
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8838482413304290400"
},
{
"key": "scheduler_job_id",
"value": "pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host-cpp17-v9"
},
{
"key": "user_agent",
"value": "luci-scheduler"
},
{
"key": "parent_buildername",
"value": "rerunner"
},
{
"key": "user_agent",
"value": "rerunner"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[08:55:51.157] Scheduled build:
{
"id": "8673052350294103249",
"builder": {
"project": "pigweed",
"bucket": "pigweed.dev.ci",
"builder": "pigweed-mac-arm-bazel-host-cpp17-v9"
},
"createdBy": "project:pigweed",
"createTime": "2026-08-19T08:55:50.885702935Z",
"updateTime": "2026-08-19T08:55:50.885702935Z",
"status": "SCHEDULED",
"input": {
}
}
[08:55:51.157] Task URL: https://cr-buildbucket.appspot.com/build/8673052350294103249
[08:55:51.157] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host-cpp17-v9:8838482413304290400:2:0) after 1m18s
[08:55:52.144] Received PubSub notification, asking Buildbucket for the build status
[08:55:52.162] Build status: SCHEDULED
[08:57:09.242] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host-cpp17-v9:8838482413304290400:2:0)
[08:57:09.309] Build status: SCHEDULED
[08:57:09.309] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host-cpp17-v9:8838482413304290400:4:0) after 5m45s
[09:02:54.381] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host-cpp17-v9:8838482413304290400:4:0)
[09:02:54.408] Build status: SCHEDULED
[09:02:54.409] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host-cpp17-v9:8838482413304290400:5:0) after 3m45s
[09:06:39.428] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host-cpp17-v9:8838482413304290400:5:0)
[09:06:39.458] Build status: SCHEDULED
[09:06:39.458] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host-cpp17-v9:8838482413304290400:6:0) after 9m47s
[09:16:26.460] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host-cpp17-v9:8838482413304290400:6:0)
[09:16:26.641] Build status: SCHEDULED
[09:16:26.641] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host-cpp17-v9:8838482413304290400:7:0) after 9m35s
[09:26:01.682] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host-cpp17-v9:8838482413304290400:7:0)
[09:26:01.704] Build status: SCHEDULED
[09:26:01.704] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host-cpp17-v9:8838482413304290400:8:0) after 3m8s
[09:29:09.695] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host-cpp17-v9:8838482413304290400:8:0)
[09:29:09.716] Build status: SCHEDULED
[09:29:09.717] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host-cpp17-v9:8838482413304290400:9:0) after 8m58s
[09:38:07.793] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host-cpp17-v9:8838482413304290400:9:0)
[09:38:07.812] Build status: SCHEDULED
[09:38:07.812] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host-cpp17-v9:8838482413304290400:10:0) after 3m55s
[09:42:02.852] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host-cpp17-v9:8838482413304290400:10:0)
[09:42:02.874] Build status: SCHEDULED
[09:42:02.874] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host-cpp17-v9:8838482413304290400:11:0) after 9m35s
[09:51:37.891] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host-cpp17-v9:8838482413304290400:11:0)
[09:51:37.919] Build status: SCHEDULED
[09:51:37.919] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host-cpp17-v9:8838482413304290400:12:0) after 8m37s
[10:00:14.937] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host-cpp17-v9:8838482413304290400:12:0)
[10:00:14.986] Build status: SCHEDULED
[10:00:14.987] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host-cpp17-v9:8838482413304290400:13:0) after 1m29s
[10:01:44.050] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host-cpp17-v9:8838482413304290400:13:0)
[10:01:44.194] Build status: SCHEDULED
[10:01:44.194] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host-cpp17-v9:8838482413304290400:14:0) after 3m39s
[10:05:23.263] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host-cpp17-v9:8838482413304290400:14:0)
[10:05:23.316] Build status: SCHEDULED
[10:05:23.316] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host-cpp17-v9:8838482413304290400:15:0) after 6m56s
[10:12:19.429] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host-cpp17-v9:8838482413304290400:15:0)
[10:12:19.501] Build status: SCHEDULED
[10:12:19.501] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host-cpp17-v9:8838482413304290400:16:0) after 4m43s
[10:17:02.571] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host-cpp17-v9:8838482413304290400:16:0)
[10:17:02.590] Build status: SCHEDULED
[10:17:02.590] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host-cpp17-v9:8838482413304290400:17:0) after 6m50s
[10:23:52.652] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host-cpp17-v9:8838482413304290400:17:0)
[10:23:52.679] Build status: SCHEDULED
[10:23:52.679] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host-cpp17-v9:8838482413304290400:18:0) after 3m41s
[10:27:33.699] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host-cpp17-v9:8838482413304290400:18:0)
[10:27:33.719] Build status: SCHEDULED
[10:27:33.719] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host-cpp17-v9:8838482413304290400:19:0) after 1m5s
[10:28:38.764] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host-cpp17-v9:8838482413304290400:19:0)
[10:28:38.780] Build status: SCHEDULED
[10:28:38.780] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host-cpp17-v9:8838482413304290400:20:0) after 4m56s
[10:33:34.775] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host-cpp17-v9:8838482413304290400:20:0)
[10:33:34.815] Build status: SCHEDULED
[10:33:34.815] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host-cpp17-v9:8838482413304290400:21:0) after 9m20s
[10:42:54.878] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host-cpp17-v9:8838482413304290400:21:0)
[10:42:55.043] Build status: SCHEDULED
[10:42:55.043] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host-cpp17-v9:8838482413304290400:22:0) after 5m13s
[10:48:08.114] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host-cpp17-v9:8838482413304290400:22:0)
[10:48:08.135] Build status: SCHEDULED
[10:48:08.135] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host-cpp17-v9:8838482413304290400:23:0) after 5m53s
[10:54:01.248] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host-cpp17-v9:8838482413304290400:23:0)
[10:54:01.285] Build status: SCHEDULED
[10:54:01.285] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host-cpp17-v9:8838482413304290400:24:0) after 8m35s
[11:02:36.457] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host-cpp17-v9:8838482413304290400:24:0)
[11:02:36.481] Build status: SCHEDULED
[11:02:36.481] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host-cpp17-v9:8838482413304290400:25:0) after 5m18s
[11:07:54.515] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host-cpp17-v9:8838482413304290400:25:0)
[11:07:54.536] Build status: SCHEDULED
[11:07:54.536] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host-cpp17-v9:8838482413304290400:26:0) after 8m47s
[11:10:07.009] Received PubSub notification, asking Buildbucket for the build status
[11:10:07.030] Build status: STARTED
[11:10:34.619] Received PubSub notification, asking Buildbucket for the build status
[11:10:34.677] Build:
{
"id": "8673052350294103249",
"builder": {
"project": "pigweed",
"bucket": "pigweed.dev.ci",
"builder": "pigweed-mac-arm-bazel-host-cpp17-v9"
},
"createdBy": "project:pigweed",
"createTime": "2026-08-19T08:55:50.885702935Z",
"startTime": "2026-08-19T11:10:06.835197909Z",
"endTime": "2026-08-19T11:10:34.247831525Z",
"updateTime": "2026-08-19T11:10:34.247831525Z",
"status": "INFRA_FAILURE",
"input": {
}
}
[11:10:34.677] Invocation finished in 2h14m46.045754543s with status FAILED