[07:23:22.053] New invocation is queued and will start shortly
[07:23:22.053] Triggered by user:rerunner@pigweed-service-accounts.iam.gserviceaccount.com
[07:23:23.125] Starting the invocation (attempt 1)
[07:23:23.157] Ignoring gitiles_ref tag without the buildset tag
[07:23:23.157] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[07:23:23.157] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[07:23:23.157] Buildbucket request:
{
"requestId": "8854252101473361184",
"builder": {
"project": "pigweed",
"bucket": "pigweed.dev.ci",
"builder": "pigweed-linux-bazel-host"
},
"properties": {
"$recipe_engine/scheduler": {
"hostname": "luci-scheduler.appspot.com",
"invocation": "8854252101473361184",
"job": "pigweed/pigweed.dev.ci-pigweed-linux-bazel-host",
"triggers": [
{
"buildbucket": {
"tags": [
"parent_buildername:rerunner",
"user_agent:rerunner"
]
},
"id": "8d53d266-db4a-4c68-aad1-282df504385f",
"title": "rerunner/0",
"url": "https://cr-buildbucket.appspot.com/build/8688822237542930065"
}
]
}
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8854252101473361184"
},
{
"key": "scheduler_job_id",
"value": "pigweed/pigweed.dev.ci-pigweed-linux-bazel-host"
},
{
"key": "user_agent",
"value": "luci-scheduler"
},
{
"key": "parent_buildername",
"value": "rerunner"
},
{
"key": "user_agent",
"value": "rerunner"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[07:23:23.601] Scheduled build:
{
"id": "8688822039608091617",
"builder": {
"project": "pigweed",
"bucket": "pigweed.dev.ci",
"builder": "pigweed-linux-bazel-host"
},
"createdBy": "project:pigweed",
"createTime": "2026-02-26T07:23:23.209100442Z",
"updateTime": "2026-02-26T07:23:23.209100442Z",
"status": "SCHEDULED",
"input": {
}
}
[07:23:23.601] Task URL: https://cr-buildbucket.appspot.com/build/8688822039608091617
[07:23:23.601] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:2:0) after 8m16s
[07:23:24.498] Received PubSub notification, asking Buildbucket for the build status
[07:23:24.526] Build status: SCHEDULED
[07:31:39.625] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:2:0)
[07:31:39.652] Build status: SCHEDULED
[07:31:39.652] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:4:0) after 2m19s
[07:33:58.669] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:4:0)
[07:33:58.692] Build status: SCHEDULED
[07:33:58.692] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:5:0) after 4m56s
[07:38:54.709] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:5:0)
[07:38:54.726] Build status: SCHEDULED
[07:38:54.726] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:6:0) after 8m57s
[07:47:51.739] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:6:0)
[07:47:51.754] Build status: SCHEDULED
[07:47:51.754] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:7:0) after 6m49s
[07:54:40.770] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:7:0)
[07:54:40.869] Build status: SCHEDULED
[07:54:40.869] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:8:0) after 4m52s
[07:59:32.884] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:8:0)
[07:59:32.905] Build status: SCHEDULED
[07:59:32.906] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:9:0) after 8m16s
[08:07:48.918] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:9:0)
[08:07:48.933] Build status: SCHEDULED
[08:07:48.933] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:10:0) after 9m21s
[08:17:10.002] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:10:0)
[08:17:10.026] Build status: SCHEDULED
[08:17:10.026] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:11:0) after 8m20s
[08:25:30.177] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:11:0)
[08:25:30.197] Build status: SCHEDULED
[08:25:30.197] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:12:0) after 5m46s
[08:31:16.323] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:12:0)
[08:31:16.388] Build status: SCHEDULED
[08:31:16.388] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:13:0) after 2m30s
[08:33:46.402] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:13:0)
[08:33:46.430] Build status: SCHEDULED
[08:33:46.430] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:14:0) after 3m27s
[08:37:13.477] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:14:0)
[08:37:13.494] Build status: SCHEDULED
[08:37:13.494] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:15:0) after 8m38s
[08:45:51.654] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:15:0)
[08:45:51.678] Build status: SCHEDULED
[08:45:51.678] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:16:0) after 9m24s
[08:55:15.794] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:16:0)
[08:55:15.812] Build status: SCHEDULED
[08:55:15.812] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:17:0) after 5m10s
[09:00:25.811] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:17:0)
[09:00:25.831] Build status: SCHEDULED
[09:00:25.832] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:18:0) after 6m27s
[09:06:52.864] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:18:0)
[09:06:52.883] Build status: SCHEDULED
[09:06:52.883] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:19:0) after 1m11s
[09:08:03.904] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:19:0)
[09:08:03.919] Build status: SCHEDULED
[09:08:03.919] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:20:0) after 3m48s
[09:11:52.062] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:20:0)
[09:11:52.090] Build status: SCHEDULED
[09:11:52.090] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:21:0) after 5m5s
[09:16:57.104] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:21:0)
[09:16:57.156] Build status: SCHEDULED
[09:16:57.156] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:22:0) after 8m5s
[09:25:02.212] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:22:0)
[09:25:02.330] Build status: SCHEDULED
[09:25:02.330] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:23:0) after 8m45s
[09:33:47.380] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:23:0)
[09:33:47.484] Build status: SCHEDULED
[09:33:47.484] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:24:0) after 8m54s
[09:42:41.549] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:24:0)
[09:42:41.575] Build status: SCHEDULED
[09:42:41.575] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:25:0) after 5m25s
[09:48:06.658] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:25:0)
[09:48:06.682] Build status: SCHEDULED
[09:48:06.682] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:26:0) after 4m32s
[09:52:38.750] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:26:0)
[09:52:38.846] Build status: SCHEDULED
[09:52:38.847] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:27:0) after 6m25s
[09:59:03.865] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:27:0)
[09:59:03.882] Build status: SCHEDULED
[09:59:03.882] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:28:0) after 1m45s
[10:00:48.897] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:28:0)
[10:00:48.983] Build status: SCHEDULED
[10:00:48.983] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:29:0) after 6m16s
[10:07:05.098] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:29:0)
[10:07:05.125] Build status: SCHEDULED
[10:07:05.125] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:30:0) after 6m41s
[10:13:46.276] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:30:0)
[10:13:46.295] Build status: SCHEDULED
[10:13:46.295] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:31:0) after 3m59s
[10:17:45.309] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:31:0)
[10:17:45.345] Build status: SCHEDULED
[10:17:45.345] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:32:0) after 5m4s
[10:22:49.410] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:32:0)
[10:22:49.435] Build status: SCHEDULED
[10:22:49.435] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:33:0) after 6m50s
[10:29:39.453] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:33:0)
[10:29:39.473] Build status: SCHEDULED
[10:29:39.473] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:34:0) after 7m23s
[10:37:02.538] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:34:0)
[10:37:02.574] Build status: SCHEDULED
[10:37:02.574] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:35:0) after 2m31s
[10:39:33.639] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:35:0)
[10:39:33.653] Build status: SCHEDULED
[10:39:33.653] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:36:0) after 9m2s
[10:48:35.741] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:36:0)
[10:48:35.763] Build status: SCHEDULED
[10:48:35.763] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:37:0) after 6m28s
[10:55:03.850] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:37:0)
[10:55:03.870] Build status: SCHEDULED
[10:55:03.870] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:38:0) after 9m7s
[11:04:10.887] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:38:0)
[11:04:10.917] Build status: SCHEDULED
[11:04:10.917] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:39:0) after 2m7s
[11:06:17.941] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:39:0)
[11:06:17.958] Build status: SCHEDULED
[11:06:17.958] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:40:0) after 5m1s
[11:11:18.977] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:40:0)
[11:11:19.004] Build status: SCHEDULED
[11:11:19.004] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:41:0) after 4m58s
[11:16:17.094] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:41:0)
[11:16:17.196] Build status: SCHEDULED
[11:16:17.196] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:42:0) after 9m58s
[11:26:15.233] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:42:0)
[11:26:15.248] Build status: SCHEDULED
[11:26:15.249] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:43:0) after 4m16s
[11:30:31.278] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:43:0)
[11:30:31.298] Build status: SCHEDULED
[11:30:31.298] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:44:0) after 9m39s
[11:40:10.333] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:44:0)
[11:40:10.391] Build status: SCHEDULED
[11:40:10.391] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:45:0) after 1m7s
[11:41:17.362] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:45:0)
[11:41:17.426] Build status: SCHEDULED
[11:41:17.426] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:46:0) after 1m29s
[11:42:46.401] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:46:0)
[11:42:46.485] Build status: SCHEDULED
[11:42:46.485] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:47:0) after 2m0s
[11:44:46.608] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:47:0)
[11:44:46.627] Build status: SCHEDULED
[11:44:46.628] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:48:0) after 3m44s
[11:48:30.645] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:48:0)
[11:48:30.660] Build status: SCHEDULED
[11:48:30.660] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:49:0) after 3m35s
[11:52:05.677] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:49:0)
[11:52:05.694] Build status: SCHEDULED
[11:52:05.694] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:50:0) after 6m20s
[11:58:25.678] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:50:0)
[11:58:25.693] Build status: SCHEDULED
[11:58:25.693] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:51:0) after 7m57s
[12:06:22.759] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:51:0)
[12:06:22.775] Build status: SCHEDULED
[12:06:22.775] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:52:0) after 4m19s
[12:08:44.981] Received PubSub notification, asking Buildbucket for the build status
[12:08:45.032] Build status: STARTED
[12:10:41.877] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:52:0)
[12:10:41.900] Build status: STARTED
[12:10:41.900] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-linux-bazel-host:8854252101473361184:54:0) after 9m6s
[12:19:12.132] Received PubSub notification, asking Buildbucket for the build status
[12:19:12.161] Build:
{
"id": "8688822039608091617",
"builder": {
"project": "pigweed",
"bucket": "pigweed.dev.ci",
"builder": "pigweed-linux-bazel-host"
},
"createdBy": "project:pigweed",
"createTime": "2026-02-26T07:23:23.209100442Z",
"startTime": "2026-02-26T12:08:44.783169317Z",
"endTime": "2026-02-26T12:19:11.898830940Z",
"updateTime": "2026-02-26T12:19:11.898830940Z",
"status": "SUCCESS",
"input": {
}
}
[12:19:12.161] Invocation finished in 4h55m50.114805097s with status SUCCEEDED