[22:42:28.353] New invocation is queued and will start shortly
[22:42:28.353] Triggered by user:rerunner@pigweed-service-accounts.iam.gserviceaccount.com
[22:42:29.405] Starting the invocation (attempt 1)
[22:42:29.438] Ignoring gitiles_ref tag without the buildset tag
[22:42:29.438] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[22:42:29.439] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[22:42:29.439] Buildbucket request:
{
"requestId": "8864884718423610960",
"builder": {
"project": "pigweed",
"bucket": "kudzu.dev.ci",
"builder": "kudzu-full"
},
"properties": {
"$recipe_engine/scheduler": {
"hostname": "luci-scheduler.appspot.com",
"invocation": "8864884718423610960",
"job": "pigweed/kudzu.dev.ci-kudzu-full",
"triggers": [
{
"buildbucket": {
"tags": [
"parent_buildername:rerunner",
"user_agent:rerunner"
]
},
"id": "a30a647d-5c6c-4eda-b2fc-bf17ad1a4ea0",
"title": "rerunner/0",
"url": "https://cr-buildbucket.appspot.com/build/8699454871797051873"
}
]
}
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8864884718423610960"
},
{
"key": "scheduler_job_id",
"value": "pigweed/kudzu.dev.ci-kudzu-full"
},
{
"key": "user_agent",
"value": "luci-scheduler"
},
{
"key": "parent_buildername",
"value": "rerunner"
},
{
"key": "user_agent",
"value": "rerunner"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[22:42:29.760] Scheduled build:
{
"id": "8699454656563744049",
"builder": {
"project": "pigweed",
"bucket": "kudzu.dev.ci",
"builder": "kudzu-full"
},
"createdBy": "project:pigweed",
"createTime": "2025-10-31T22:42:29.502073643Z",
"updateTime": "2025-10-31T22:42:29.502073643Z",
"status": "SCHEDULED",
"input": {
}
}
[22:42:29.760] Task URL: https://cr-buildbucket.appspot.com/build/8699454656563744049
[22:42:29.760] Scheduling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:2:0) after 4m5s
[22:42:30.758] Received PubSub notification, asking Buildbucket for the build status
[22:42:30.780] Build status: SCHEDULED
[22:46:34.805] Handling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:2:0)
[22:46:34.860] Build status: SCHEDULED
[22:46:34.860] Scheduling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:4:0) after 3m40s
[22:50:14.977] Handling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:4:0)
[22:50:14.993] Build status: SCHEDULED
[22:50:14.993] Scheduling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:5:0) after 1m22s
[22:51:37.006] Handling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:5:0)
[22:51:37.066] Build status: SCHEDULED
[22:51:37.066] Scheduling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:6:0) after 4m51s
[22:56:28.140] Handling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:6:0)
[22:56:28.169] Build status: SCHEDULED
[22:56:28.169] Scheduling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:7:0) after 3m34s
[23:00:02.183] Handling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:7:0)
[23:00:02.353] Build status: SCHEDULED
[23:00:02.353] Scheduling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:8:0) after 1m23s
[23:01:25.367] Handling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:8:0)
[23:01:25.399] Build status: SCHEDULED
[23:01:25.399] Scheduling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:9:0) after 4m24s
[23:05:49.415] Handling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:9:0)
[23:05:49.436] Build status: SCHEDULED
[23:05:49.436] Scheduling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:10:0) after 4m48s
[23:10:37.453] Handling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:10:0)
[23:10:37.466] Build status: SCHEDULED
[23:10:37.466] Scheduling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:11:0) after 6m16s
[23:16:53.478] Handling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:11:0)
[23:16:53.497] Build status: SCHEDULED
[23:16:53.497] Scheduling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:12:0) after 8m23s
[23:25:16.509] Handling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:12:0)
[23:25:16.529] Build status: SCHEDULED
[23:25:16.529] Scheduling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:13:0) after 9m11s
[23:34:27.641] Handling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:13:0)
[23:34:27.666] Build status: SCHEDULED
[23:34:27.666] Scheduling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:14:0) after 7m59s
[23:42:26.679] Handling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:14:0)
[23:42:26.712] Build status: SCHEDULED
[23:42:26.712] Scheduling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:15:0) after 1m38s
[23:44:04.690] Handling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:15:0)
[23:44:04.725] Build status: SCHEDULED
[23:44:04.725] Scheduling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:16:0) after 2m38s
[23:46:42.736] Handling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:16:0)
[23:46:42.767] Build status: SCHEDULED
[23:46:42.767] Scheduling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:17:0) after 5m39s
[23:52:21.779] Handling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:17:0)
[23:52:21.795] Build status: SCHEDULED
[23:52:21.795] Scheduling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:18:0) after 3m27s
[23:55:48.807] Handling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:18:0)
[23:55:48.821] Build status: SCHEDULED
[23:55:48.821] Scheduling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:19:0) after 2m58s
[23:58:46.864] Handling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:19:0)
[23:58:46.925] Build status: SCHEDULED
[23:58:46.925] Scheduling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:20:0) after 5m20s
[00:04:06.943] Handling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:20:0)
[00:04:06.975] Build status: SCHEDULED
[00:04:06.975] Scheduling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:21:0) after 2m27s
[00:06:34.007] Handling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:21:0)
[00:06:34.036] Build status: SCHEDULED
[00:06:34.036] Scheduling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:22:0) after 5m40s
[00:12:14.049] Handling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:22:0)
[00:12:14.079] Build status: SCHEDULED
[00:12:14.079] Scheduling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:23:0) after 7m4s
[00:19:18.125] Handling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:23:0)
[00:19:18.302] Build status: SCHEDULED
[00:19:18.302] Scheduling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:24:0) after 6m7s
[00:25:25.358] Handling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:24:0)
[00:25:25.420] Build status: SCHEDULED
[00:25:25.420] Scheduling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:25:0) after 3m45s
[00:29:10.439] Handling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:25:0)
[00:29:10.455] Build status: SCHEDULED
[00:29:10.455] Scheduling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:26:0) after 8m20s
[00:37:30.517] Handling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:26:0)
[00:37:30.568] Build status: SCHEDULED
[00:37:30.568] Scheduling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:27:0) after 3m39s
[00:41:09.571] Handling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:27:0)
[00:41:09.588] Build status: SCHEDULED
[00:41:09.588] Scheduling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:28:0) after 5m18s
[00:46:27.591] Handling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:28:0)
[00:46:27.616] Build status: SCHEDULED
[00:46:27.616] Scheduling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:29:0) after 7m45s
[00:54:12.641] Handling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:29:0)
[00:54:12.667] Build status: SCHEDULED
[00:54:12.667] Scheduling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:30:0) after 6m14s
[01:00:26.683] Handling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:30:0)
[01:00:26.699] Build status: SCHEDULED
[01:00:26.699] Scheduling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:31:0) after 5m37s
[01:06:03.712] Handling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:31:0)
[01:06:03.740] Build status: SCHEDULED
[01:06:03.740] Scheduling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:32:0) after 6m3s
[01:12:08.129] Handling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:32:0)
[01:12:08.144] Build status: SCHEDULED
[01:12:08.144] Scheduling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:33:0) after 1m7s
[01:13:15.160] Handling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:33:0)
[01:13:15.194] Build status: SCHEDULED
[01:13:15.194] Scheduling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:34:0) after 7m0s
[01:20:15.209] Handling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:34:0)
[01:20:15.285] Build status: SCHEDULED
[01:20:15.285] Scheduling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:35:0) after 7m10s
[01:27:25.297] Handling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:35:0)
[01:27:25.479] Build status: SCHEDULED
[01:27:25.479] Scheduling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:36:0) after 6m11s
[01:33:36.499] Handling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:36:0)
[01:33:36.523] Build status: SCHEDULED
[01:33:36.523] Scheduling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:37:0) after 2m22s
[01:35:58.540] Handling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:37:0)
[01:35:58.607] Build status: SCHEDULED
[01:35:58.607] Scheduling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:38:0) after 6m56s
[01:42:54.675] Handling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:38:0)
[01:42:54.700] Build status: SCHEDULED
[01:42:54.700] Scheduling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:39:0) after 6m19s
[01:49:13.724] Handling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:39:0)
[01:49:13.748] Build status: SCHEDULED
[01:49:13.748] Scheduling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:40:0) after 4m11s
[01:53:24.761] Handling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:40:0)
[01:53:24.790] Build status: SCHEDULED
[01:53:24.790] Scheduling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:41:0) after 2m14s
[01:55:38.856] Handling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:41:0)
[01:55:38.872] Build status: SCHEDULED
[01:55:38.872] Scheduling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:42:0) after 2m43s
[01:58:21.997] Handling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:42:0)
[01:58:22.022] Build status: SCHEDULED
[01:58:22.022] Scheduling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:43:0) after 8m18s
[02:06:40.037] Handling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:43:0)
[02:06:40.064] Build status: SCHEDULED
[02:06:40.064] Scheduling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:44:0) after 3m13s
[02:09:53.154] Handling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:44:0)
[02:09:53.181] Build status: SCHEDULED
[02:09:53.181] Scheduling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:45:0) after 4m1s
[02:13:54.196] Handling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:45:0)
[02:13:54.221] Build status: SCHEDULED
[02:13:54.221] Scheduling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:46:0) after 3m55s
[02:17:49.238] Handling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:46:0)
[02:17:49.293] Build status: SCHEDULED
[02:17:49.293] Scheduling timer "check-buildbucket-build-status" (pigweed/kudzu.dev.ci-kudzu-full:8864884718423610960:47:0) after 6m44s
[02:20:20.089] Received PubSub notification, asking Buildbucket for the build status
[02:20:20.112] Build status: STARTED
[02:20:45.464] Received PubSub notification, asking Buildbucket for the build status
[02:20:45.495] Build:
{
"id": "8699454656563744049",
"builder": {
"project": "pigweed",
"bucket": "kudzu.dev.ci",
"builder": "kudzu-full"
},
"createdBy": "project:pigweed",
"createTime": "2025-10-31T22:42:29.502073643Z",
"startTime": "2025-11-01T02:20:19.697917339Z",
"endTime": "2025-11-01T02:20:44.740371604Z",
"updateTime": "2025-11-01T02:20:44.740371604Z",
"status": "INFRA_FAILURE",
"input": {
}
}
[02:20:45.495] Invocation finished in 3h38m17.149894839s with status FAILED