[07:32:06.477] New invocation is queued and will start shortly
[07:32:06.477] Triggered by user:rerunner@pigweed-service-accounts.iam.gserviceaccount.com
[07:32:07.837] Starting the invocation (attempt 1)
[07:32:07.859] Ignoring gitiles_ref tag without the buildset tag
[07:32:07.859] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[07:32:07.860] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[07:32:07.860] Buildbucket request:
{
"requestId": "8854160954606208288",
"builder": {
"project": "pigweed",
"bucket": "kudzu.dev.ci",
"builder": "kudzu-full"
},
"properties": {
"$recipe_engine/scheduler": {
"hostname": "luci-scheduler.appspot.com",
"invocation": "8854160954606208288",
"job": "pigweed/kudzu.dev.ci-kudzu-full",
"triggers": [
{
"buildbucket": {
"tags": [
"parent_buildername:rerunner",
"user_agent:rerunner"
]
},
"id": "82f0aca2-4e08-4e40-b807-42453f92bc1e",
"title": "rerunner/0",
"url": "https://cr-buildbucket.appspot.com/build/8688731184389094321"
}
]
}
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8854160954606208288"
},
{
"key": "scheduler_job_id",
"value": "pigweed/kudzu.dev.ci-kudzu-full"
},
{
"key": "user_agent",
"value": "luci-scheduler"
},
{
"key": "parent_buildername",
"value": "rerunner"
},
{
"key": "user_agent",
"value": "rerunner"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[07:32:08.214] Scheduled build:
{
"id": "8688730892450550465",
"builder": {
"project": "pigweed",
"bucket": "kudzu.dev.ci",
"builder": "kudzu-full"
},
"createdBy": "project:pigweed",
"createTime": "2026-02-27T07:32:07.912428200Z",
"updateTime": "2026-02-27T07:32:07.912428200Z",
"status": "SCHEDULED",
"input": {
}
}
[07:32:08.214] Task URL: https://cr-buildbucket.appspot.com/build/8688730892450550465
[07:32:08.214] Scheduling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8854160954606208288:2:0) after 4m38s
[07:32:09.250] Received PubSub notification, asking Buildbucket for the build status
[07:32:09.289] Build status: SCHEDULED
[07:36:46.201] Handling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8854160954606208288:2:0)
[07:36:46.279] Build status: SCHEDULED
[07:36:46.279] Scheduling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8854160954606208288:4:0) after 5m8s
[07:41:54.306] Handling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8854160954606208288:4:0)
[07:41:54.374] Build status: SCHEDULED
[07:41:54.374] Scheduling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8854160954606208288:5:0) after 2m59s
[07:44:53.468] Handling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8854160954606208288:5:0)
[07:44:53.483] Build status: SCHEDULED
[07:44:53.483] Scheduling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8854160954606208288:6:0) after 4m45s
[07:49:38.497] Handling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8854160954606208288:6:0)
[07:49:38.514] Build status: SCHEDULED
[07:49:38.514] Scheduling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8854160954606208288:7:0) after 3m13s
[07:52:51.589] Handling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8854160954606208288:7:0)
[07:52:51.632] Build status: SCHEDULED
[07:52:51.632] Scheduling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8854160954606208288:8:0) after 8m4s
[08:00:55.647] Handling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8854160954606208288:8:0)
[08:00:55.668] Build status: SCHEDULED
[08:00:55.668] Scheduling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8854160954606208288:9:0) after 2m43s
[08:03:38.724] Handling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8854160954606208288:9:0)
[08:03:38.756] Build status: SCHEDULED
[08:03:38.756] Scheduling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8854160954606208288:10:0) after 2m24s
[08:06:02.758] Handling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8854160954606208288:10:0)
[08:06:02.781] Build status: SCHEDULED
[08:06:02.781] Scheduling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8854160954606208288:11:0) after 5m53s
[08:11:55.852] Handling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8854160954606208288:11:0)
[08:11:55.880] Build status: SCHEDULED
[08:11:55.880] Scheduling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8854160954606208288:12:0) after 9m38s
[08:21:34.055] Handling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8854160954606208288:12:0)
[08:21:34.090] Build status: SCHEDULED
[08:21:34.090] Scheduling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8854160954606208288:13:0) after 6m37s
[08:28:11.117] Handling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8854160954606208288:13:0)
[08:28:11.133] Build status: SCHEDULED
[08:28:11.133] Scheduling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8854160954606208288:14:0) after 2m57s
[08:31:08.109] Handling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8854160954606208288:14:0)
[08:31:08.137] Build status: SCHEDULED
[08:31:08.137] Scheduling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8854160954606208288:15:0) after 8m21s
[08:39:29.266] Handling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8854160954606208288:15:0)
[08:39:29.306] Build status: SCHEDULED
[08:39:29.306] Scheduling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8854160954606208288:16:0) after 5m26s
[08:44:55.319] Handling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8854160954606208288:16:0)
[08:44:55.350] Build status: SCHEDULED
[08:44:55.350] Scheduling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8854160954606208288:17:0) after 8m44s
[08:53:39.415] Handling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8854160954606208288:17:0)
[08:53:39.492] Build status: SCHEDULED
[08:53:39.492] Scheduling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8854160954606208288:18:0) after 1m15s
[08:54:54.508] Handling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8854160954606208288:18:0)
[08:54:54.536] Build status: SCHEDULED
[08:54:54.536] Scheduling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8854160954606208288:19:0) after 8m13s
[09:03:07.637] Handling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8854160954606208288:19:0)
[09:03:07.708] Build status: SCHEDULED
[09:03:07.708] Scheduling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8854160954606208288:20:0) after 7m27s
[09:10:34.817] Handling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8854160954606208288:20:0)
[09:10:34.838] Build status: SCHEDULED
[09:10:34.838] Scheduling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8854160954606208288:21:0) after 7m29s
[09:18:03.855] Handling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8854160954606208288:21:0)
[09:18:03.873] Build status: SCHEDULED
[09:18:03.873] Scheduling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8854160954606208288:22:0) after 7m43s
[09:25:46.893] Handling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8854160954606208288:22:0)
[09:25:46.912] Build status: SCHEDULED
[09:25:46.912] Scheduling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8854160954606208288:23:0) after 7m53s
[09:33:39.929] Handling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8854160954606208288:23:0)
[09:33:39.945] Build status: SCHEDULED
[09:33:39.945] Scheduling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8854160954606208288:24:0) after 1m0s
[09:34:39.958] Handling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8854160954606208288:24:0)
[09:34:39.989] Build status: SCHEDULED
[09:34:39.989] Scheduling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8854160954606208288:25:0) after 9m44s
[09:44:24.257] Handling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8854160954606208288:25:0)
[09:44:24.306] Build status: SCHEDULED
[09:44:24.306] Scheduling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8854160954606208288:26:0) after 9m15s
[09:53:39.318] Handling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8854160954606208288:26:0)
[09:53:39.353] Build status: SCHEDULED
[09:53:39.353] Scheduling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8854160954606208288:27:0) after 6m22s
[10:00:01.340] Handling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8854160954606208288:27:0)
[10:00:01.376] Build status: SCHEDULED
[10:00:01.376] Scheduling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8854160954606208288:28:0) after 6m19s
[10:06:20.501] Handling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8854160954606208288:28:0)
[10:06:20.529] Build status: SCHEDULED
[10:06:20.529] Scheduling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8854160954606208288:29:0) after 3m28s
[10:09:48.590] Handling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8854160954606208288:29:0)
[10:09:48.691] Build status: SCHEDULED
[10:09:48.691] Scheduling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8854160954606208288:30:0) after 2m24s
[10:12:12.678] Handling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8854160954606208288:30:0)
[10:12:12.703] Build status: SCHEDULED
[10:12:12.703] Scheduling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8854160954606208288:31:0) after 1m18s
[10:13:30.738] Handling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8854160954606208288:31:0)
[10:13:30.753] Build status: SCHEDULED
[10:13:30.753] Scheduling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8854160954606208288:32:0) after 3m46s
[10:17:16.768] Handling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8854160954606208288:32:0)
[10:17:16.793] Build status: SCHEDULED
[10:17:16.793] Scheduling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8854160954606208288:33:0) after 5m38s
[10:18:15.901] Received PubSub notification, asking Buildbucket for the build status
[10:18:15.919] Build status: STARTED
[10:18:44.128] Received PubSub notification, asking Buildbucket for the build status
[10:18:44.144] Build:
{
"id": "8688730892450550465",
"builder": {
"project": "pigweed",
"bucket": "kudzu.dev.ci",
"builder": "kudzu-full"
},
"createdBy": "project:pigweed",
"createTime": "2026-02-27T07:32:07.912428200Z",
"startTime": "2026-02-27T10:18:15.647905005Z",
"endTime": "2026-02-27T10:18:43.744075745Z",
"updateTime": "2026-02-27T10:18:43.744075745Z",
"status": "INFRA_FAILURE",
"input": {
}
}
[10:18:44.144] Invocation finished in 2h46m37.671593767s with status FAILED