[05:40:54.895] New invocation is queued and will start shortly
[05:40:54.895] Triggered by user:rerunner@pigweed-service-accounts.iam.gserviceaccount.com
[05:40:56.045] Starting the invocation (attempt 1)
[05:40:56.073] Ignoring gitiles_ref tag without the buildset tag
[05:40:56.073] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[05:40:56.074] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[05:40:56.075] Buildbucket request:
{
"requestId": "8833149454060482688",
"builder": {
"project": "pigweed",
"bucket": "pigweed.dev.ci",
"builder": "pigweed-linux-bazel-device"
},
"properties": {
"$recipe_engine/scheduler": {
"hostname": "luci-scheduler.appspot.com",
"invocation": "8833149454060482688",
"job": "pigweed/pigweed.dev.ci-pigweed-linux-bazel-device",
"triggers": [
{
"buildbucket": {
"tags": [
"parent_buildername:rerunner",
"user_agent:rerunner"
]
},
"id": "30296bc1-b3e0-4f40-9701-701f5d9505a5",
"title": "rerunner/0",
"url": "https://cr-buildbucket.appspot.com/build/8667719824166608241"
}
]
}
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8833149454060482688"
},
{
"key": "scheduler_job_id",
"value": "pigweed/pigweed.dev.ci-pigweed-linux-bazel-device"
},
{
"key": "user_agent",
"value": "luci-scheduler"
},
{
"key": "parent_buildername",
"value": "rerunner"
},
{
"key": "user_agent",
"value": "rerunner"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[05:40:56.447] Scheduled build:
{
"id": "8667719392104173281",
"builder": {
"project": "pigweed",
"bucket": "pigweed.dev.ci",
"builder": "pigweed-linux-bazel-device"
},
"createdBy": "project:pigweed",
"createTime": "2026-10-17T05:40:56.141598606Z",
"updateTime": "2026-10-17T05:40:56.141598606Z",
"status": "SCHEDULED",
"input": {
}
}
[05:40:56.448] Task URL: https://cr-buildbucket.appspot.com/build/8667719392104173281
[05:40:56.448] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-device:8833149454060482688:2:0) after 5m16s
[05:40:57.387] Received PubSub notification, asking Buildbucket for the build status
[05:40:57.404] Build status: SCHEDULED
[05:46:12.465] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-device:8833149454060482688:2:0)
[05:46:12.588] Build status: SCHEDULED
[05:46:12.588] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-device:8833149454060482688:4:0) after 8m7s
[05:54:19.706] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-device:8833149454060482688:4:0)
[05:54:19.843] Build status: SCHEDULED
[05:54:19.843] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-device:8833149454060482688:5:0) after 5m28s
[05:59:47.856] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-device:8833149454060482688:5:0)
[05:59:47.891] Build status: SCHEDULED
[05:59:47.891] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-device:8833149454060482688:6:0) after 7m11s
[06:06:58.939] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-device:8833149454060482688:6:0)
[06:06:58.963] Build status: SCHEDULED
[06:06:58.963] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-device:8833149454060482688:7:0) after 2m58s
[06:09:56.979] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-device:8833149454060482688:7:0)
[06:09:57.032] Build status: SCHEDULED
[06:09:57.032] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-device:8833149454060482688:8:0) after 2m50s
[06:12:47.097] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-device:8833149454060482688:8:0)
[06:12:47.129] Build status: SCHEDULED
[06:12:47.129] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-device:8833149454060482688:9:0) after 2m40s
[06:15:27.198] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-device:8833149454060482688:9:0)
[06:15:27.233] Build status: SCHEDULED
[06:15:27.233] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-device:8833149454060482688:10:0) after 2m2s
[06:17:29.250] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-device:8833149454060482688:10:0)
[06:17:29.267] Build status: SCHEDULED
[06:17:29.267] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-device:8833149454060482688:11:0) after 3m12s
[06:20:41.285] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-device:8833149454060482688:11:0)
[06:20:41.346] Build status: SCHEDULED
[06:20:41.346] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-device:8833149454060482688:12:0) after 8m53s
[06:29:34.412] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-device:8833149454060482688:12:0)
[06:29:34.473] Build status: SCHEDULED
[06:29:34.473] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-device:8833149454060482688:13:0) after 1m0s
[06:30:34.487] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-device:8833149454060482688:13:0)
[06:30:34.510] Build status: SCHEDULED
[06:30:34.510] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-device:8833149454060482688:14:0) after 7m29s
[06:38:03.485] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-device:8833149454060482688:14:0)
[06:38:03.657] Build status: SCHEDULED
[06:38:03.657] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-device:8833149454060482688:15:0) after 1m48s
[06:39:51.710] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-device:8833149454060482688:15:0)
[06:39:51.728] Build status: SCHEDULED
[06:39:51.728] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-device:8833149454060482688:16:0) after 6m1s
[06:45:52.743] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-device:8833149454060482688:16:0)
[06:45:52.824] Build status: SCHEDULED
[06:45:52.824] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-device:8833149454060482688:17:0) after 4m31s
[06:50:23.835] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-device:8833149454060482688:17:0)
[06:50:23.860] Build status: SCHEDULED
[06:50:23.860] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-device:8833149454060482688:18:0) after 3m17s
[06:53:40.877] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-device:8833149454060482688:18:0)
[06:53:40.893] Build status: SCHEDULED
[06:53:40.893] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-device:8833149454060482688:19:0) after 7m51s
[07:01:31.922] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-device:8833149454060482688:19:0)
[07:01:31.956] Build status: SCHEDULED
[07:01:31.956] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-device:8833149454060482688:20:0) after 3m3s
[07:04:34.932] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-device:8833149454060482688:20:0)
[07:04:35.037] Build status: SCHEDULED
[07:04:35.037] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-device:8833149454060482688:21:0) after 4m56s
[07:09:31.053] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-device:8833149454060482688:21:0)
[07:09:31.074] Build status: SCHEDULED
[07:09:31.074] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-device:8833149454060482688:22:0) after 5m11s
[07:14:42.088] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-device:8833149454060482688:22:0)
[07:14:42.138] Build status: SCHEDULED
[07:14:42.138] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-device:8833149454060482688:23:0) after 6m2s
[07:20:44.156] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-device:8833149454060482688:23:0)
[07:20:44.196] Build status: SCHEDULED
[07:20:44.196] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-device:8833149454060482688:24:0) after 1m2s
[07:21:46.312] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-device:8833149454060482688:24:0)
[07:21:46.337] Build status: SCHEDULED
[07:21:46.337] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-device:8833149454060482688:25:0) after 3m42s
[07:25:28.322] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-device:8833149454060482688:25:0)
[07:25:28.346] Build status: SCHEDULED
[07:25:28.346] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-device:8833149454060482688:26:0) after 4m40s
[07:30:08.440] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-device:8833149454060482688:26:0)
[07:30:08.456] Build status: SCHEDULED
[07:30:08.456] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-device:8833149454060482688:27:0) after 3m27s
[07:33:35.503] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-device:8833149454060482688:27:0)
[07:33:35.526] Build status: SCHEDULED
[07:33:35.526] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-device:8833149454060482688:28:0) after 6m34s
[07:40:09.506] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-device:8833149454060482688:28:0)
[07:40:09.531] Build status: SCHEDULED
[07:40:09.532] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-device:8833149454060482688:29:0) after 5m2s
[07:45:11.561] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-device:8833149454060482688:29:0)
[07:45:11.634] Build status: SCHEDULED
[07:45:11.635] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-device:8833149454060482688:30:0) after 5m48s
[07:45:59.424] Received PubSub notification, asking Buildbucket for the build status
[07:45:59.569] Build status: STARTED
[07:50:59.650] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-device:8833149454060482688:30:0)
[07:50:59.680] Build status: STARTED
[07:50:59.680] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-device:8833149454060482688:32:0) after 2m59s
[07:53:58.690] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-device:8833149454060482688:32:0)
[07:53:58.708] Build status: STARTED
[07:53:58.708] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-device:8833149454060482688:33:0) after 9m9s
[07:56:29.904] Received PubSub notification, asking Buildbucket for the build status
[07:56:29.934] Build:
{
"id": "8667719392104173281",
"builder": {
"project": "pigweed",
"bucket": "pigweed.dev.ci",
"builder": "pigweed-linux-bazel-device"
},
"createdBy": "project:pigweed",
"createTime": "2026-10-17T05:40:56.141598606Z",
"startTime": "2026-10-17T07:45:59.240585341Z",
"endTime": "2026-10-17T07:56:29.659442090Z",
"updateTime": "2026-10-17T07:56:29.659442090Z",
"status": "FAILURE",
"input": {
}
}
[07:56:29.934] Invocation finished in 2h15m35.042580517s with status FAILED