[20:48:53.647] New invocation is queued and will start shortly
[20:48:53.647] Triggered by user:rerunner@pigweed-service-accounts.iam.gserviceaccount.com
[20:48:55.144] Starting the invocation (attempt 1)
[20:48:55.181] Ignoring gitiles_ref tag without the buildset tag
[20:48:55.181] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[20:48:55.181] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[20:48:55.182] Buildbucket request:
{
"requestId": "8853476646391351344",
"builder": {
"project": "pigweed",
"bucket": "pigweed.dev.ci",
"builder": "pigweed-mac-arm-bazel-host"
},
"properties": {
"$recipe_engine/scheduler": {
"hostname": "luci-scheduler.appspot.com",
"invocation": "8853476646391351344",
"job": "pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host",
"triggers": [
{
"buildbucket": {
"tags": [
"parent_buildername:rerunner",
"user_agent:rerunner"
]
},
"id": "45734134-4e9f-48c3-82d8-c7a5e71b542a",
"title": "rerunner/0",
"url": "https://cr-buildbucket.appspot.com/build/8688046807162775233"
}
]
}
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8853476646391351344"
},
{
"key": "scheduler_job_id",
"value": "pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host"
},
{
"key": "user_agent",
"value": "luci-scheduler"
},
{
"key": "parent_buildername",
"value": "rerunner"
},
{
"key": "user_agent",
"value": "rerunner"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[20:48:55.525] Scheduled build:
{
"id": "8688046584065935489",
"builder": {
"project": "pigweed",
"bucket": "pigweed.dev.ci",
"builder": "pigweed-mac-arm-bazel-host"
},
"createdBy": "project:pigweed",
"createTime": "2026-03-06T20:48:55.243147163Z",
"updateTime": "2026-03-06T20:48:55.243147163Z",
"status": "SCHEDULED",
"input": {
}
}
[20:48:55.525] Task URL: https://cr-buildbucket.appspot.com/build/8688046584065935489
[20:48:55.525] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host:8853476646391351344:2:0) after 5m1s
[20:48:56.524] Received PubSub notification, asking Buildbucket for the build status
[20:48:56.542] Build status: SCHEDULED
[20:53:56.591] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host:8853476646391351344:2:0)
[20:53:56.611] Build status: SCHEDULED
[20:53:56.611] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host:8853476646391351344:4:0) after 3m38s
[20:57:34.642] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host:8853476646391351344:4:0)
[20:57:34.661] Build status: SCHEDULED
[20:57:34.661] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host:8853476646391351344:5:0) after 8m32s
[21:06:06.725] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host:8853476646391351344:5:0)
[21:06:06.746] Build status: SCHEDULED
[21:06:06.746] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host:8853476646391351344:6:0) after 6m27s
[21:12:33.828] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host:8853476646391351344:6:0)
[21:12:33.850] Build status: SCHEDULED
[21:12:33.850] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host:8853476646391351344:7:0) after 1m19s
[21:13:52.867] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host:8853476646391351344:7:0)
[21:13:52.888] Build status: SCHEDULED
[21:13:52.888] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host:8853476646391351344:8:0) after 4m59s
[21:18:51.933] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host:8853476646391351344:8:0)
[21:18:51.951] Build status: SCHEDULED
[21:18:51.951] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host:8853476646391351344:9:0) after 1m53s
[21:20:44.976] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host:8853476646391351344:9:0)
[21:20:45.041] Build status: SCHEDULED
[21:20:45.041] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host:8853476646391351344:10:0) after 1m30s
[21:22:15.106] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host:8853476646391351344:10:0)
[21:22:15.124] Build status: SCHEDULED
[21:22:15.124] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host:8853476646391351344:11:0) after 9m32s
[21:31:47.235] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host:8853476646391351344:11:0)
[21:31:47.255] Build status: SCHEDULED
[21:31:47.255] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host:8853476646391351344:12:0) after 7m43s
[21:39:30.325] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host:8853476646391351344:12:0)
[21:39:30.350] Build status: SCHEDULED
[21:39:30.350] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host:8853476646391351344:13:0) after 1m0s
[21:40:30.574] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host:8853476646391351344:13:0)
[21:40:30.600] Build status: SCHEDULED
[21:40:30.600] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host:8853476646391351344:14:0) after 3m15s
[21:43:45.779] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host:8853476646391351344:14:0)
[21:43:45.800] Build status: SCHEDULED
[21:43:45.800] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host:8853476646391351344:15:0) after 3m0s
[21:46:45.868] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host:8853476646391351344:15:0)
[21:46:45.884] Build status: SCHEDULED
[21:46:45.884] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host:8853476646391351344:16:0) after 1m28s
[21:48:13.929] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host:8853476646391351344:16:0)
[21:48:13.945] Build status: SCHEDULED
[21:48:13.945] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host:8853476646391351344:17:0) after 3m33s
[21:51:47.110] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host:8853476646391351344:17:0)
[21:51:47.189] Build status: SCHEDULED
[21:51:47.189] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host:8853476646391351344:18:0) after 2m1s
[21:53:48.251] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host:8853476646391351344:18:0)
[21:53:48.269] Build status: SCHEDULED
[21:53:48.269] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host:8853476646391351344:19:0) after 3m13s
[21:57:01.284] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host:8853476646391351344:19:0)
[21:57:01.300] Build status: SCHEDULED
[21:57:01.300] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host:8853476646391351344:20:0) after 2m22s
[21:59:23.380] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host:8853476646391351344:20:0)
[21:59:23.396] Build status: SCHEDULED
[21:59:23.396] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host:8853476646391351344:21:0) after 2m42s
[22:02:05.427] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host:8853476646391351344:21:0)
[22:02:05.558] Build status: SCHEDULED
[22:02:05.559] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host:8853476646391351344:22:0) after 3m42s
[22:05:47.625] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host:8853476646391351344:22:0)
[22:05:47.651] Build status: SCHEDULED
[22:05:47.651] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host:8853476646391351344:23:0) after 8m5s
[22:13:52.663] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host:8853476646391351344:23:0)
[22:13:52.690] Build status: SCHEDULED
[22:13:52.690] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host:8853476646391351344:24:0) after 2m51s
[22:16:43.659] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host:8853476646391351344:24:0)
[22:16:43.699] Build status: SCHEDULED
[22:16:43.699] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host:8853476646391351344:25:0) after 2m27s
[22:19:10.709] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host:8853476646391351344:25:0)
[22:19:10.730] Build status: SCHEDULED
[22:19:10.730] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-host:8853476646391351344:26:0) after 8m5s
[22:20:58.297] Received PubSub notification, asking Buildbucket for the build status
[22:20:58.337] Build status: STARTED
[22:25:01.069] Received PubSub notification, asking Buildbucket for the build status
[22:25:01.120] Build:
{
"id": "8688046584065935489",
"builder": {
"project": "pigweed",
"bucket": "pigweed.dev.ci",
"builder": "pigweed-mac-arm-bazel-host"
},
"createdBy": "project:pigweed",
"createTime": "2026-03-06T20:48:55.243147163Z",
"startTime": "2026-03-06T22:20:58.051439815Z",
"endTime": "2026-03-06T22:24:57.641705655Z",
"updateTime": "2026-03-06T22:24:57.641705655Z",
"status": "FAILURE",
"input": {
}
}
[22:25:01.120] Invocation finished in 1h36m7.47822855s with status FAILED