[02:51:18.711] New invocation is queued and will start shortly
[02:51:18.711] Triggered by user:rerunner@pigweed-service-accounts.iam.gserviceaccount.com
[02:51:19.772] Starting the invocation (attempt 1)
[02:51:19.804] Ignoring gitiles_ref tag without the buildset tag
[02:51:19.804] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[02:51:19.804] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[02:51:19.804] Buildbucket request:
{
"requestId": "8863963093149290368",
"builder": {
"project": "pigweed",
"bucket": "examples.dev.ci",
"builder": "examples-envtest-linux"
},
"properties": {
"$recipe_engine/scheduler": {
"hostname": "luci-scheduler.appspot.com",
"invocation": "8863963093149290368",
"job": "pigweed/examples.dev.ci-examples-envtest-linux",
"triggers": [
{
"buildbucket": {
"tags": [
"parent_buildername:rerunner",
"user_agent:rerunner"
]
},
"id": "dcf7bbc7-ab66-43b4-b57f-7f1b9a5dff3f",
"title": "rerunner/0",
"url": "https://cr-buildbucket.appspot.com/build/8698533226831647713"
}
]
}
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8863963093149290368"
},
{
"key": "scheduler_job_id",
"value": "pigweed/examples.dev.ci-examples-envtest-linux"
},
{
"key": "user_agent",
"value": "luci-scheduler"
},
{
"key": "parent_buildername",
"value": "rerunner"
},
{
"key": "user_agent",
"value": "rerunner"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[02:51:20.310] Scheduled build:
{
"id": "8698533031282868913",
"builder": {
"project": "pigweed",
"bucket": "examples.dev.ci",
"builder": "examples-envtest-linux"
},
"createdBy": "project:pigweed",
"createTime": "2025-11-11T02:51:19.862809852Z",
"updateTime": "2025-11-11T02:51:19.862809852Z",
"status": "SCHEDULED",
"input": {
}
}
[02:51:20.310] Task URL: https://cr-buildbucket.appspot.com/build/8698533031282868913
[02:51:20.310] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:2:0) after 1m6s
[02:51:21.172] Received PubSub notification, asking Buildbucket for the build status
[02:51:21.200] Build status: SCHEDULED
[02:52:26.325] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:2:0)
[02:52:26.416] Build status: SCHEDULED
[02:52:26.416] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:4:0) after 8m13s
[03:00:39.478] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:4:0)
[03:00:39.493] Build status: SCHEDULED
[03:00:39.493] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:5:0) after 5m50s
[03:06:29.469] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:5:0)
[03:06:29.525] Build status: SCHEDULED
[03:06:29.525] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:6:0) after 6m27s
[03:12:56.541] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:6:0)
[03:12:56.589] Build status: SCHEDULED
[03:12:56.589] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:7:0) after 1m21s
[03:14:17.602] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:7:0)
[03:14:17.615] Build status: SCHEDULED
[03:14:17.616] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:8:0) after 6m49s
[03:21:06.706] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:8:0)
[03:21:06.732] Build status: SCHEDULED
[03:21:06.732] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:9:0) after 6m4s
[03:27:10.744] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:9:0)
[03:27:10.818] Build status: SCHEDULED
[03:27:10.818] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:10:0) after 1m19s
[03:28:29.878] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:10:0)
[03:28:29.892] Build status: SCHEDULED
[03:28:29.892] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:11:0) after 7m29s
[03:35:58.908] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:11:0)
[03:35:59.055] Build status: SCHEDULED
[03:35:59.055] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:12:0) after 4m55s
[03:40:54.168] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:12:0)
[03:40:54.187] Build status: SCHEDULED
[03:40:54.187] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:13:0) after 1m51s
[03:42:45.199] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:13:0)
[03:42:45.233] Build status: SCHEDULED
[03:42:45.233] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:14:0) after 7m10s
[03:49:55.249] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:14:0)
[03:49:55.263] Build status: SCHEDULED
[03:49:55.263] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:15:0) after 3m50s
[03:53:45.239] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:15:0)
[03:53:45.275] Build status: SCHEDULED
[03:53:45.276] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:16:0) after 2m35s
[03:56:20.290] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:16:0)
[03:56:20.318] Build status: SCHEDULED
[03:56:20.318] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:17:0) after 7m26s
[04:03:46.331] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:17:0)
[04:03:46.349] Build status: SCHEDULED
[04:03:46.349] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:18:0) after 6m0s
[04:09:46.324] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:18:0)
[04:09:46.368] Build status: SCHEDULED
[04:09:46.369] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:19:0) after 3m15s
[04:13:01.433] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:19:0)
[04:13:01.456] Build status: SCHEDULED
[04:13:01.456] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:20:0) after 3m58s
[04:16:59.529] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:20:0)
[04:16:59.549] Build status: SCHEDULED
[04:16:59.549] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:21:0) after 2m20s
[04:19:19.550] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:21:0)
[04:19:19.565] Build status: SCHEDULED
[04:19:19.565] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:22:0) after 7m30s
[04:26:49.578] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:22:0)
[04:26:49.732] Build status: SCHEDULED
[04:26:49.732] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:23:0) after 9m8s
[04:35:57.784] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:23:0)
[04:35:57.886] Build status: SCHEDULED
[04:35:57.886] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:24:0) after 3m35s
[04:39:32.940] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:24:0)
[04:39:32.983] Build status: SCHEDULED
[04:39:32.983] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:25:0) after 3m47s
[04:43:19.995] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:25:0)
[04:43:20.027] Build status: SCHEDULED
[04:43:20.027] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:26:0) after 7m4s
[04:50:24.092] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:26:0)
[04:50:24.136] Build status: SCHEDULED
[04:50:24.136] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:27:0) after 9m44s
[05:00:08.149] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:27:0)
[05:00:08.231] Build status: SCHEDULED
[05:00:08.231] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:28:0) after 4m34s
[05:04:42.247] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:28:0)
[05:04:42.443] Build status: SCHEDULED
[05:04:42.443] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:29:0) after 5m43s
[05:10:25.458] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:29:0)
[05:10:25.483] Build status: SCHEDULED
[05:10:25.483] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:30:0) after 2m45s
[05:13:10.496] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:30:0)
[05:13:10.612] Build status: SCHEDULED
[05:13:10.612] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:31:0) after 5m21s
[05:18:31.628] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:31:0)
[05:18:31.645] Build status: SCHEDULED
[05:18:31.645] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:32:0) after 2m45s
[05:21:16.712] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:32:0)
[05:21:16.741] Build status: SCHEDULED
[05:21:16.741] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:33:0) after 1m46s
[05:23:02.753] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:33:0)
[05:23:02.880] Build status: SCHEDULED
[05:23:02.880] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:34:0) after 5m48s
[05:28:50.938] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:34:0)
[05:28:50.956] Build status: SCHEDULED
[05:28:50.956] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:35:0) after 1m20s
[05:30:11.181] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:35:0)
[05:30:11.197] Build status: SCHEDULED
[05:30:11.197] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:36:0) after 6m50s
[05:37:01.215] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:36:0)
[05:37:01.243] Build status: SCHEDULED
[05:37:01.243] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:37:0) after 6m4s
[05:43:05.289] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:37:0)
[05:43:05.308] Build status: SCHEDULED
[05:43:05.308] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:38:0) after 6m28s
[05:49:33.331] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:38:0)
[05:49:33.382] Build status: SCHEDULED
[05:49:33.382] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:39:0) after 8m22s
[05:57:55.400] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:39:0)
[05:57:55.415] Build status: SCHEDULED
[05:57:55.415] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:40:0) after 2m8s
[06:00:03.428] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:40:0)
[06:00:03.456] Build status: SCHEDULED
[06:00:03.456] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:41:0) after 3m8s
[06:03:11.465] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:41:0)
[06:03:11.583] Build status: SCHEDULED
[06:03:11.583] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:42:0) after 8m19s
[06:11:30.726] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:42:0)
[06:11:30.793] Build status: SCHEDULED
[06:11:30.793] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:43:0) after 4m39s
[06:16:09.807] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:43:0)
[06:16:09.874] Build status: SCHEDULED
[06:16:09.874] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-linux:8863963093149290368:44:0) after 9m25s
[06:21:03.331] Received PubSub notification, asking Buildbucket for the build status
[06:21:03.346] Build status: STARTED
[06:21:37.819] Received PubSub notification, asking Buildbucket for the build status
[06:21:37.835] Build:
{
"id": "8698533031282868913",
"builder": {
"project": "pigweed",
"bucket": "examples.dev.ci",
"builder": "examples-envtest-linux"
},
"createdBy": "project:pigweed",
"createTime": "2025-11-11T02:51:19.862809852Z",
"startTime": "2025-11-11T06:21:03.102996930Z",
"endTime": "2025-11-11T06:21:37.055121944Z",
"updateTime": "2025-11-11T06:21:37.055121944Z",
"status": "INFRA_FAILURE",
"input": {
}
}
[06:21:37.835] Invocation finished in 3h30m19.137099104s with status FAILED