[04:50:51.755] New invocation is queued and will start shortly
[04:50:51.755] Triggered by user:rerunner@pigweed-service-accounts.iam.gserviceaccount.com
[04:50:52.892] Starting the invocation (attempt 1)
[04:50:52.923] Ignoring gitiles_ref tag without the buildset tag
[04:50:52.923] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[04:50:52.923] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[04:50:52.924] Buildbucket request:
{
"requestId": "8852540353899349520",
"builder": {
"project": "pigweed",
"bucket": "gonk.dev.ci",
"builder": "gonk-envtest"
},
"properties": {
"$recipe_engine/scheduler": {
"hostname": "luci-scheduler.appspot.com",
"invocation": "8852540353899349520",
"job": "pigweed/gonk.dev.ci-gonk-envtest",
"triggers": [
{
"buildbucket": {
"tags": [
"parent_buildername:rerunner",
"user_agent:rerunner"
]
},
"id": "11303e57-c31c-41d1-a359-e5b645b227d1",
"title": "rerunner/0",
"url": "https://cr-buildbucket.appspot.com/build/8687110458383579441"
}
]
}
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8852540353899349520"
},
{
"key": "scheduler_job_id",
"value": "pigweed/gonk.dev.ci-gonk-envtest"
},
{
"key": "user_agent",
"value": "luci-scheduler"
},
{
"key": "parent_buildername",
"value": "rerunner"
},
{
"key": "user_agent",
"value": "rerunner"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[04:50:53.564] Scheduled build:
{
"id": "8687110291968745233",
"builder": {
"project": "pigweed",
"bucket": "gonk.dev.ci",
"builder": "gonk-envtest"
},
"createdBy": "project:pigweed",
"createTime": "2026-03-17T04:50:52.969194355Z",
"updateTime": "2026-03-17T04:50:52.969194355Z",
"status": "SCHEDULED",
"input": {
}
}
[04:50:53.564] Task URL: https://cr-buildbucket.appspot.com/build/8687110291968745233
[04:50:53.564] Scheduling timer "check-buildbucket-build-status" (pigweed/gonk.dev.ci-gonk-envtest:8852540353899349520:2:0) after 3m15s
[04:50:54.301] Received PubSub notification, asking Buildbucket for the build status
[04:50:54.324] Build status: SCHEDULED
[04:54:08.578] Handling timer "check-buildbucket-build-status" (pigweed/gonk.dev.ci-gonk-envtest:8852540353899349520:2:0)
[04:54:08.657] Build status: SCHEDULED
[04:54:08.657] Scheduling timer "check-buildbucket-build-status" (pigweed/gonk.dev.ci-gonk-envtest:8852540353899349520:4:0) after 3m36s
[04:57:44.742] Handling timer "check-buildbucket-build-status" (pigweed/gonk.dev.ci-gonk-envtest:8852540353899349520:4:0)
[04:57:44.775] Build status: SCHEDULED
[04:57:44.775] Scheduling timer "check-buildbucket-build-status" (pigweed/gonk.dev.ci-gonk-envtest:8852540353899349520:5:0) after 6m54s
[05:04:38.837] Handling timer "check-buildbucket-build-status" (pigweed/gonk.dev.ci-gonk-envtest:8852540353899349520:5:0)
[05:04:38.864] Build status: SCHEDULED
[05:04:38.864] Scheduling timer "check-buildbucket-build-status" (pigweed/gonk.dev.ci-gonk-envtest:8852540353899349520:6:0) after 5m37s
[05:10:15.895] Handling timer "check-buildbucket-build-status" (pigweed/gonk.dev.ci-gonk-envtest:8852540353899349520:6:0)
[05:10:15.911] Build status: SCHEDULED
[05:10:15.911] Scheduling timer "check-buildbucket-build-status" (pigweed/gonk.dev.ci-gonk-envtest:8852540353899349520:7:0) after 4m59s
[05:15:15.010] Handling timer "check-buildbucket-build-status" (pigweed/gonk.dev.ci-gonk-envtest:8852540353899349520:7:0)
[05:15:15.025] Build status: SCHEDULED
[05:15:15.026] Scheduling timer "check-buildbucket-build-status" (pigweed/gonk.dev.ci-gonk-envtest:8852540353899349520:8:0) after 8m55s
[05:24:10.193] Handling timer "check-buildbucket-build-status" (pigweed/gonk.dev.ci-gonk-envtest:8852540353899349520:8:0)
[05:24:10.211] Build status: SCHEDULED
[05:24:10.211] Scheduling timer "check-buildbucket-build-status" (pigweed/gonk.dev.ci-gonk-envtest:8852540353899349520:9:0) after 6m8s
[05:30:18.224] Handling timer "check-buildbucket-build-status" (pigweed/gonk.dev.ci-gonk-envtest:8852540353899349520:9:0)
[05:30:18.242] Build status: SCHEDULED
[05:30:18.242] Scheduling timer "check-buildbucket-build-status" (pigweed/gonk.dev.ci-gonk-envtest:8852540353899349520:10:0) after 5m15s
[05:35:33.213] Handling timer "check-buildbucket-build-status" (pigweed/gonk.dev.ci-gonk-envtest:8852540353899349520:10:0)
[05:35:33.232] Build status: SCHEDULED
[05:35:33.232] Scheduling timer "check-buildbucket-build-status" (pigweed/gonk.dev.ci-gonk-envtest:8852540353899349520:11:0) after 5m48s
[05:41:21.293] Handling timer "check-buildbucket-build-status" (pigweed/gonk.dev.ci-gonk-envtest:8852540353899349520:11:0)
[05:41:21.316] Build status: SCHEDULED
[05:41:21.316] Scheduling timer "check-buildbucket-build-status" (pigweed/gonk.dev.ci-gonk-envtest:8852540353899349520:12:0) after 1m9s
[05:42:30.329] Handling timer "check-buildbucket-build-status" (pigweed/gonk.dev.ci-gonk-envtest:8852540353899349520:12:0)
[05:42:30.431] Build status: SCHEDULED
[05:42:30.431] Scheduling timer "check-buildbucket-build-status" (pigweed/gonk.dev.ci-gonk-envtest:8852540353899349520:13:0) after 5m46s
[05:48:16.444] Handling timer "check-buildbucket-build-status" (pigweed/gonk.dev.ci-gonk-envtest:8852540353899349520:13:0)
[05:48:16.459] Build status: SCHEDULED
[05:48:16.459] Scheduling timer "check-buildbucket-build-status" (pigweed/gonk.dev.ci-gonk-envtest:8852540353899349520:14:0) after 1m51s
[05:50:07.474] Handling timer "check-buildbucket-build-status" (pigweed/gonk.dev.ci-gonk-envtest:8852540353899349520:14:0)
[05:50:07.505] Build status: SCHEDULED
[05:50:07.505] Scheduling timer "check-buildbucket-build-status" (pigweed/gonk.dev.ci-gonk-envtest:8852540353899349520:15:0) after 3m28s
[05:53:35.517] Handling timer "check-buildbucket-build-status" (pigweed/gonk.dev.ci-gonk-envtest:8852540353899349520:15:0)
[05:53:35.538] Build status: SCHEDULED
[05:53:35.538] Scheduling timer "check-buildbucket-build-status" (pigweed/gonk.dev.ci-gonk-envtest:8852540353899349520:16:0) after 2m46s
[05:56:21.594] Handling timer "check-buildbucket-build-status" (pigweed/gonk.dev.ci-gonk-envtest:8852540353899349520:16:0)
[05:56:21.616] Build status: SCHEDULED
[05:56:21.616] Scheduling timer "check-buildbucket-build-status" (pigweed/gonk.dev.ci-gonk-envtest:8852540353899349520:17:0) after 5m57s
[06:02:18.656] Handling timer "check-buildbucket-build-status" (pigweed/gonk.dev.ci-gonk-envtest:8852540353899349520:17:0)
[06:02:18.747] Build status: SCHEDULED
[06:02:18.747] Scheduling timer "check-buildbucket-build-status" (pigweed/gonk.dev.ci-gonk-envtest:8852540353899349520:18:0) after 9m6s
[06:11:24.862] Handling timer "check-buildbucket-build-status" (pigweed/gonk.dev.ci-gonk-envtest:8852540353899349520:18:0)
[06:11:24.914] Build status: SCHEDULED
[06:11:24.914] Scheduling timer "check-buildbucket-build-status" (pigweed/gonk.dev.ci-gonk-envtest:8852540353899349520:19:0) after 6m9s
[06:17:33.982] Handling timer "check-buildbucket-build-status" (pigweed/gonk.dev.ci-gonk-envtest:8852540353899349520:19:0)
[06:17:34.072] Build status: SCHEDULED
[06:17:34.072] Scheduling timer "check-buildbucket-build-status" (pigweed/gonk.dev.ci-gonk-envtest:8852540353899349520:20:0) after 2m9s
[06:19:43.083] Handling timer "check-buildbucket-build-status" (pigweed/gonk.dev.ci-gonk-envtest:8852540353899349520:20:0)
[06:19:43.101] Build status: SCHEDULED
[06:19:43.101] Scheduling timer "check-buildbucket-build-status" (pigweed/gonk.dev.ci-gonk-envtest:8852540353899349520:21:0) after 8m48s
[06:28:31.214] Handling timer "check-buildbucket-build-status" (pigweed/gonk.dev.ci-gonk-envtest:8852540353899349520:21:0)
[06:28:31.242] Build status: SCHEDULED
[06:28:31.242] Scheduling timer "check-buildbucket-build-status" (pigweed/gonk.dev.ci-gonk-envtest:8852540353899349520:22:0) after 6m34s
[06:35:05.220] Handling timer "check-buildbucket-build-status" (pigweed/gonk.dev.ci-gonk-envtest:8852540353899349520:22:0)
[06:35:05.241] Build status: SCHEDULED
[06:35:05.241] Scheduling timer "check-buildbucket-build-status" (pigweed/gonk.dev.ci-gonk-envtest:8852540353899349520:23:0) after 9m48s
[06:44:53.223] Handling timer "check-buildbucket-build-status" (pigweed/gonk.dev.ci-gonk-envtest:8852540353899349520:23:0)
[06:44:53.267] Build status: SCHEDULED
[06:44:53.267] Scheduling timer "check-buildbucket-build-status" (pigweed/gonk.dev.ci-gonk-envtest:8852540353899349520:24:0) after 4m57s
[06:49:50.289] Handling timer "check-buildbucket-build-status" (pigweed/gonk.dev.ci-gonk-envtest:8852540353899349520:24:0)
[06:49:50.316] Build status: SCHEDULED
[06:49:50.316] Scheduling timer "check-buildbucket-build-status" (pigweed/gonk.dev.ci-gonk-envtest:8852540353899349520:25:0) after 3m22s
[06:53:12.373] Handling timer "check-buildbucket-build-status" (pigweed/gonk.dev.ci-gonk-envtest:8852540353899349520:25:0)
[06:53:12.459] Build status: SCHEDULED
[06:53:12.459] Scheduling timer "check-buildbucket-build-status" (pigweed/gonk.dev.ci-gonk-envtest:8852540353899349520:26:0) after 9m13s
[07:02:25.476] Handling timer "check-buildbucket-build-status" (pigweed/gonk.dev.ci-gonk-envtest:8852540353899349520:26:0)
[07:02:25.503] Build status: SCHEDULED
[07:02:25.503] Scheduling timer "check-buildbucket-build-status" (pigweed/gonk.dev.ci-gonk-envtest:8852540353899349520:27:0) after 4m8s
[07:06:33.696] Handling timer "check-buildbucket-build-status" (pigweed/gonk.dev.ci-gonk-envtest:8852540353899349520:27:0)
[07:06:33.720] Build status: SCHEDULED
[07:06:33.720] Scheduling timer "check-buildbucket-build-status" (pigweed/gonk.dev.ci-gonk-envtest:8852540353899349520:28:0) after 8m22s
[07:14:55.816] Handling timer "check-buildbucket-build-status" (pigweed/gonk.dev.ci-gonk-envtest:8852540353899349520:28:0)
[07:14:55.832] Build status: SCHEDULED
[07:14:55.832] Scheduling timer "check-buildbucket-build-status" (pigweed/gonk.dev.ci-gonk-envtest:8852540353899349520:29:0) after 4m12s
[07:19:07.905] Handling timer "check-buildbucket-build-status" (pigweed/gonk.dev.ci-gonk-envtest:8852540353899349520:29:0)
[07:19:07.929] Build status: SCHEDULED
[07:19:07.929] Scheduling timer "check-buildbucket-build-status" (pigweed/gonk.dev.ci-gonk-envtest:8852540353899349520:30:0) after 6m16s
[07:25:23.915] Handling timer "check-buildbucket-build-status" (pigweed/gonk.dev.ci-gonk-envtest:8852540353899349520:30:0)
[07:25:23.977] Build status: SCHEDULED
[07:25:23.977] Scheduling timer "check-buildbucket-build-status" (pigweed/gonk.dev.ci-gonk-envtest:8852540353899349520:31:0) after 6m5s
[07:31:28.992] Handling timer "check-buildbucket-build-status" (pigweed/gonk.dev.ci-gonk-envtest:8852540353899349520:31:0)
[07:31:29.086] Build status: SCHEDULED
[07:31:29.086] Scheduling timer "check-buildbucket-build-status" (pigweed/gonk.dev.ci-gonk-envtest:8852540353899349520:32:0) after 6m11s
[07:37:40.145] Handling timer "check-buildbucket-build-status" (pigweed/gonk.dev.ci-gonk-envtest:8852540353899349520:32:0)
[07:37:40.165] Build status: SCHEDULED
[07:37:40.165] Scheduling timer "check-buildbucket-build-status" (pigweed/gonk.dev.ci-gonk-envtest:8852540353899349520:33:0) after 6m54s
[07:44:34.273] Handling timer "check-buildbucket-build-status" (pigweed/gonk.dev.ci-gonk-envtest:8852540353899349520:33:0)
[07:44:34.340] Build status: SCHEDULED
[07:44:34.340] Scheduling timer "check-buildbucket-build-status" (pigweed/gonk.dev.ci-gonk-envtest:8852540353899349520:34:0) after 6m24s
[07:50:58.355] Handling timer "check-buildbucket-build-status" (pigweed/gonk.dev.ci-gonk-envtest:8852540353899349520:34:0)
[07:50:58.370] Build status: SCHEDULED
[07:50:58.370] Scheduling timer "check-buildbucket-build-status" (pigweed/gonk.dev.ci-gonk-envtest:8852540353899349520:35:0) after 8m35s
[07:59:33.384] Handling timer "check-buildbucket-build-status" (pigweed/gonk.dev.ci-gonk-envtest:8852540353899349520:35:0)
[07:59:33.511] Build status: SCHEDULED
[07:59:33.511] Scheduling timer "check-buildbucket-build-status" (pigweed/gonk.dev.ci-gonk-envtest:8852540353899349520:36:0) after 6m49s
[08:06:22.522] Handling timer "check-buildbucket-build-status" (pigweed/gonk.dev.ci-gonk-envtest:8852540353899349520:36:0)
[08:06:22.556] Build status: SCHEDULED
[08:06:22.556] Scheduling timer "check-buildbucket-build-status" (pigweed/gonk.dev.ci-gonk-envtest:8852540353899349520:37:0) after 7m12s
[08:13:34.592] Handling timer "check-buildbucket-build-status" (pigweed/gonk.dev.ci-gonk-envtest:8852540353899349520:37:0)
[08:13:34.617] Build status: SCHEDULED
[08:13:34.617] Scheduling timer "check-buildbucket-build-status" (pigweed/gonk.dev.ci-gonk-envtest:8852540353899349520:38:0) after 7m58s
[08:19:19.587] Received PubSub notification, asking Buildbucket for the build status
[08:19:19.606] Build status: STARTED
[08:19:35.015] Received PubSub notification, asking Buildbucket for the build status
[08:19:35.070] Build:
{
"id": "8687110291968745233",
"builder": {
"project": "pigweed",
"bucket": "gonk.dev.ci",
"builder": "gonk-envtest"
},
"createdBy": "project:pigweed",
"createTime": "2026-03-17T04:50:52.969194355Z",
"startTime": "2026-03-17T08:19:17.848544594Z",
"endTime": "2026-03-17T08:19:34.762770636Z",
"updateTime": "2026-03-17T08:19:34.762770636Z",
"status": "INFRA_FAILURE",
"input": {
}
}
[08:19:35.070] Invocation finished in 3h28m43.325897154s with status FAILED