[20:34:56.395] New invocation is queued and will start shortly
[20:34:56.395] Triggered by user:rerunner@pigweed-service-accounts.iam.gserviceaccount.com
[20:34:57.508] Starting the invocation (attempt 1)
[20:34:57.529] Ignoring gitiles_ref tag without the buildset tag
[20:34:57.529] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[20:34:57.529] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[20:34:57.529] Buildbucket request:
{
"requestId": "8840431561152238336",
"builder": {
"project": "pigweed",
"bucket": "pigweed.dev.ci",
"builder": "pigweed-mac-arm-bazel-rust"
},
"properties": {
"$recipe_engine/scheduler": {
"hostname": "luci-scheduler.appspot.com",
"invocation": "8840431561152238336",
"job": "pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust",
"triggers": [
{
"buildbucket": {
"tags": [
"parent_buildername:rerunner",
"user_agent:rerunner"
]
},
"id": "c0765914-2ea5-4301-9107-5157f848673a",
"title": "rerunner/0",
"url": "https://cr-buildbucket.appspot.com/build/8675001830163467329"
}
]
}
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8840431561152238336"
},
{
"key": "scheduler_job_id",
"value": "pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust"
},
{
"key": "user_agent",
"value": "luci-scheduler"
},
{
"key": "parent_buildername",
"value": "rerunner"
},
{
"key": "user_agent",
"value": "rerunner"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[20:34:57.921] Scheduled build:
{
"id": "8675001499234921617",
"builder": {
"project": "pigweed",
"bucket": "pigweed.dev.ci",
"builder": "pigweed-mac-arm-bazel-rust"
},
"createdBy": "project:pigweed",
"createTime": "2026-07-28T20:34:57.601134913Z",
"updateTime": "2026-07-28T20:34:57.601134913Z",
"status": "SCHEDULED",
"input": {
}
}
[20:34:57.921] Task URL: https://cr-buildbucket.appspot.com/build/8675001499234921617
[20:34:57.921] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:2:0) after 7m33s
[20:35:08.701] Received PubSub notification, asking Buildbucket for the build status
[20:35:08.728] Build status: SCHEDULED
[20:42:31.051] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:2:0)
[20:42:31.078] Build status: SCHEDULED
[20:42:31.078] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:4:0) after 3m34s
[20:46:05.118] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:4:0)
[20:46:05.143] Build status: SCHEDULED
[20:46:05.143] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:5:0) after 7m34s
[20:53:39.259] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:5:0)
[20:53:39.280] Build status: SCHEDULED
[20:53:39.280] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:6:0) after 3m29s
[20:57:08.372] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:6:0)
[20:57:08.573] Build status: SCHEDULED
[20:57:08.573] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:7:0) after 9m3s
[21:06:11.586] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:7:0)
[21:06:11.636] Build status: SCHEDULED
[21:06:11.636] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:8:0) after 4m16s
[21:10:27.650] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:8:0)
[21:10:27.670] Build status: SCHEDULED
[21:10:27.670] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:9:0) after 8m22s
[21:18:50.303] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:9:0)
[21:18:50.321] Build status: SCHEDULED
[21:18:50.321] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:10:0) after 6m54s
[21:25:44.332] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:10:0)
[21:25:44.397] Build status: SCHEDULED
[21:25:44.397] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:11:0) after 2m56s
[21:28:40.427] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:11:0)
[21:28:40.447] Build status: SCHEDULED
[21:28:40.447] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:12:0) after 1m36s
[21:30:16.602] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:12:0)
[21:30:16.622] Build status: SCHEDULED
[21:30:16.622] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:13:0) after 4m54s
[21:35:10.808] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:13:0)
[21:35:10.961] Build status: SCHEDULED
[21:35:10.961] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:14:0) after 2m54s
[21:38:05.057] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:14:0)
[21:38:05.103] Build status: SCHEDULED
[21:38:05.103] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:15:0) after 5m50s
[21:43:55.080] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:15:0)
[21:43:55.109] Build status: SCHEDULED
[21:43:55.109] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:16:0) after 1m55s
[21:45:50.169] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:16:0)
[21:45:50.199] Build status: SCHEDULED
[21:45:50.199] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:17:0) after 7m28s
[21:53:18.214] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:17:0)
[21:53:18.234] Build status: SCHEDULED
[21:53:18.234] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:18:0) after 9m28s
[22:02:46.253] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:18:0)
[22:02:46.272] Build status: SCHEDULED
[22:02:46.272] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:19:0) after 4m7s
[22:06:53.290] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:19:0)
[22:06:53.310] Build status: SCHEDULED
[22:06:53.310] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:20:0) after 4m47s
[22:11:40.365] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:20:0)
[22:11:40.394] Build status: SCHEDULED
[22:11:40.394] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:21:0) after 6m10s
[22:17:50.484] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:21:0)
[22:17:50.503] Build status: SCHEDULED
[22:17:50.503] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:22:0) after 4m26s
[22:22:16.677] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:22:0)
[22:22:16.718] Build status: SCHEDULED
[22:22:16.718] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:23:0) after 4m1s
[22:26:17.854] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:23:0)
[22:26:17.872] Build status: SCHEDULED
[22:26:17.872] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:24:0) after 9m32s
[22:35:50.004] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:24:0)
[22:35:50.144] Build status: SCHEDULED
[22:35:50.145] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:25:0) after 7m58s
[22:43:48.156] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:25:0)
[22:43:48.180] Build status: SCHEDULED
[22:43:48.180] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:26:0) after 5m52s
[22:49:40.193] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:26:0)
[22:49:40.211] Build status: SCHEDULED
[22:49:40.211] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:27:0) after 1m33s
[22:51:13.252] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:27:0)
[22:51:13.270] Build status: SCHEDULED
[22:51:13.270] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:28:0) after 7m11s
[22:58:24.330] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:28:0)
[22:58:24.349] Build status: SCHEDULED
[22:58:24.349] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:29:0) after 6m50s
[23:05:14.363] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:29:0)
[23:05:14.400] Build status: SCHEDULED
[23:05:14.400] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:30:0) after 9m11s
[23:14:25.484] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:30:0)
[23:14:25.504] Build status: SCHEDULED
[23:14:25.504] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:31:0) after 7m57s
[23:22:22.505] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:31:0)
[23:22:22.539] Build status: SCHEDULED
[23:22:22.539] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:32:0) after 4m2s
[23:26:24.557] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:32:0)
[23:26:24.578] Build status: SCHEDULED
[23:26:24.578] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:33:0) after 4m15s
[23:30:39.723] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:33:0)
[23:30:39.738] Build status: SCHEDULED
[23:30:39.738] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:34:0) after 2m49s
[23:33:28.750] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:34:0)
[23:33:28.776] Build status: SCHEDULED
[23:33:28.776] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:35:0) after 5m25s
[23:38:53.793] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:35:0)
[23:38:53.815] Build status: SCHEDULED
[23:38:53.815] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:36:0) after 8m15s
[23:47:08.939] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:36:0)
[23:47:09.002] Build status: SCHEDULED
[23:47:09.002] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:37:0) after 2m57s
[23:50:06.179] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:37:0)
[23:50:06.199] Build status: SCHEDULED
[23:50:06.199] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:38:0) after 7m10s
[23:57:16.242] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:38:0)
[23:57:16.264] Build status: SCHEDULED
[23:57:16.264] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:39:0) after 2m3s
[23:59:19.324] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:39:0)
[23:59:19.365] Build status: SCHEDULED
[23:59:19.366] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:40:0) after 2m43s
[00:02:02.394] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:40:0)
[00:02:02.415] Build status: SCHEDULED
[00:02:02.415] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:41:0) after 5m35s
[00:07:37.431] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:41:0)
[00:07:37.469] Build status: SCHEDULED
[00:07:37.469] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:42:0) after 2m28s
[00:10:05.485] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:42:0)
[00:10:05.527] Build status: SCHEDULED
[00:10:05.527] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:43:0) after 6m26s
[00:16:31.689] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:43:0)
[00:16:31.727] Build status: SCHEDULED
[00:16:31.727] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:44:0) after 1m54s
[00:18:25.787] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:44:0)
[00:18:25.807] Build status: SCHEDULED
[00:18:25.807] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:45:0) after 6m58s
[00:19:06.596] Received PubSub notification, asking Buildbucket for the build status
[00:19:06.613] Build status: STARTED
[00:25:23.903] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:45:0)
[00:25:23.925] Build status: STARTED
[00:25:23.925] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:47:0) after 9m7s
[00:34:31.021] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:47:0)
[00:34:31.040] Build status: STARTED
[00:34:31.040] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:48:0) after 2m6s
[00:36:37.185] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:48:0)
[00:36:37.204] Build status: STARTED
[00:36:37.204] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:49:0) after 5m54s
[00:42:31.192] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:49:0)
[00:42:31.211] Build status: STARTED
[00:42:31.211] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-rust:8840431561152238336:50:0) after 3m54s
[00:43:49.919] Received PubSub notification, asking Buildbucket for the build status
[00:43:49.942] Build:
{
"id": "8675001499234921617",
"builder": {
"project": "pigweed",
"bucket": "pigweed.dev.ci",
"builder": "pigweed-mac-arm-bazel-rust"
},
"createdBy": "project:pigweed",
"createTime": "2026-07-28T20:34:57.601134913Z",
"startTime": "2026-07-29T00:19:06.407517825Z",
"endTime": "2026-07-29T00:43:46.743410987Z",
"updateTime": "2026-07-29T00:43:46.743410987Z",
"status": "SUCCESS",
"input": {
}
}
[00:43:49.942] Invocation finished in 4h8m53.553327228s with status SUCCEEDED