[03:29:42.244] New invocation is queued and will start shortly
[03:29:43.369] Starting the invocation (attempt 1)
[03:29:43.392] Ignoring gitiles_ref tag without the buildset tag
[03:29:43.392] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[03:29:43.392] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[03:29:43.392] Buildbucket request:
{
"requestId": "8876916043913049792",
"builder": {
"project": "pigweed",
"bucket": "infra.dev.ci",
"builder": "bisector"
},
"properties": {
"$recipe_engine/scheduler": {
"hostname": "luci-scheduler.appspot.com",
"invocation": "8876916043913049792",
"job": "pigweed/infra.dev.ci-bisector",
"triggers": [
{
"cron": {
"generation": "3"
},
"id": "cron:v1:3"
}
]
}
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8876916043913049792"
},
{
"key": "scheduler_job_id",
"value": "pigweed/infra.dev.ci-bisector"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[03:29:43.742] Scheduled build:
{
"id": "8711485981996019217",
"builder": {
"project": "pigweed",
"bucket": "infra.dev.ci",
"builder": "bisector"
},
"createdBy": "project:pigweed",
"createTime": "2025-06-21T03:29:43.445213614Z",
"updateTime": "2025-06-21T03:29:43.445213614Z",
"status": "SCHEDULED",
"input": {
}
}
[03:29:43.742] Task URL: https://cr-buildbucket.appspot.com/build/8711485981996019217
[03:29:43.742] Scheduling timer "check-buildbucket-build-status" (pigweed/infra.dev.ci-bisector:8876916043913049792:2:0) after 1m34s
[03:29:44.777] Received PubSub notification, asking Buildbucket for the build status
[03:29:44.804] Build status: SCHEDULED
[03:31:17.762] Handling timer "check-buildbucket-build-status" (pigweed/infra.dev.ci-bisector:8876916043913049792:2:0)
[03:31:17.801] Build status: SCHEDULED
[03:31:17.801] Scheduling timer "check-buildbucket-build-status" (pigweed/infra.dev.ci-bisector:8876916043913049792:4:0) after 1m37s
[03:32:54.981] Handling timer "check-buildbucket-build-status" (pigweed/infra.dev.ci-bisector:8876916043913049792:4:0)
[03:32:55.020] Build status: SCHEDULED
[03:32:55.020] Scheduling timer "check-buildbucket-build-status" (pigweed/infra.dev.ci-bisector:8876916043913049792:5:0) after 1m13s
[03:34:08.481] Handling timer "check-buildbucket-build-status" (pigweed/infra.dev.ci-bisector:8876916043913049792:5:0)
[03:34:08.517] Build status: SCHEDULED
[03:34:08.517] Scheduling timer "check-buildbucket-build-status" (pigweed/infra.dev.ci-bisector:8876916043913049792:6:0) after 1m24s
[03:35:32.587] Handling timer "check-buildbucket-build-status" (pigweed/infra.dev.ci-bisector:8876916043913049792:6:0)
[03:35:32.610] Build status: SCHEDULED
[03:35:32.610] Scheduling timer "check-buildbucket-build-status" (pigweed/infra.dev.ci-bisector:8876916043913049792:7:0) after 8m22s
[03:43:54.634] Handling timer "check-buildbucket-build-status" (pigweed/infra.dev.ci-bisector:8876916043913049792:7:0)
[03:43:54.664] Build status: SCHEDULED
[03:43:54.664] Scheduling timer "check-buildbucket-build-status" (pigweed/infra.dev.ci-bisector:8876916043913049792:8:0) after 3m20s
[03:47:14.786] Handling timer "check-buildbucket-build-status" (pigweed/infra.dev.ci-bisector:8876916043913049792:8:0)
[03:47:14.825] Build status: SCHEDULED
[03:47:14.825] Scheduling timer "check-buildbucket-build-status" (pigweed/infra.dev.ci-bisector:8876916043913049792:9:0) after 3m17s
[03:50:32.004] Handling timer "check-buildbucket-build-status" (pigweed/infra.dev.ci-bisector:8876916043913049792:9:0)
[03:50:32.038] Build status: SCHEDULED
[03:50:32.038] Scheduling timer "check-buildbucket-build-status" (pigweed/infra.dev.ci-bisector:8876916043913049792:10:0) after 9m45s
[04:00:17.062] Handling timer "check-buildbucket-build-status" (pigweed/infra.dev.ci-bisector:8876916043913049792:10:0)
[04:00:17.079] Build status: SCHEDULED
[04:00:17.079] Scheduling timer "check-buildbucket-build-status" (pigweed/infra.dev.ci-bisector:8876916043913049792:11:0) after 8m29s
[04:08:46.103] Handling timer "check-buildbucket-build-status" (pigweed/infra.dev.ci-bisector:8876916043913049792:11:0)
[04:08:46.137] Build status: SCHEDULED
[04:08:46.137] Scheduling timer "check-buildbucket-build-status" (pigweed/infra.dev.ci-bisector:8876916043913049792:12:0) after 5m17s
[04:14:03.553] Handling timer "check-buildbucket-build-status" (pigweed/infra.dev.ci-bisector:8876916043913049792:12:0)
[04:14:03.632] Build status: SCHEDULED
[04:14:03.632] Scheduling timer "check-buildbucket-build-status" (pigweed/infra.dev.ci-bisector:8876916043913049792:13:0) after 3m42s
[04:17:46.066] Handling timer "check-buildbucket-build-status" (pigweed/infra.dev.ci-bisector:8876916043913049792:13:0)
[04:17:46.097] Build status: SCHEDULED
[04:17:46.097] Scheduling timer "check-buildbucket-build-status" (pigweed/infra.dev.ci-bisector:8876916043913049792:14:0) after 4m49s
[04:22:35.396] Handling timer "check-buildbucket-build-status" (pigweed/infra.dev.ci-bisector:8876916043913049792:14:0)
[04:22:35.438] Build status: SCHEDULED
[04:22:35.438] Scheduling timer "check-buildbucket-build-status" (pigweed/infra.dev.ci-bisector:8876916043913049792:15:0) after 6m26s
[04:29:01.558] Handling timer "check-buildbucket-build-status" (pigweed/infra.dev.ci-bisector:8876916043913049792:15:0)
[04:29:01.587] Build status: SCHEDULED
[04:29:01.587] Scheduling timer "check-buildbucket-build-status" (pigweed/infra.dev.ci-bisector:8876916043913049792:16:0) after 4m21s
[04:33:22.733] Handling timer "check-buildbucket-build-status" (pigweed/infra.dev.ci-bisector:8876916043913049792:16:0)
[04:33:22.816] Build status: SCHEDULED
[04:33:22.816] Scheduling timer "check-buildbucket-build-status" (pigweed/infra.dev.ci-bisector:8876916043913049792:17:0) after 2m11s
[04:35:33.830] Handling timer "check-buildbucket-build-status" (pigweed/infra.dev.ci-bisector:8876916043913049792:17:0)
[04:35:34.032] Build status: SCHEDULED
[04:35:34.033] Scheduling timer "check-buildbucket-build-status" (pigweed/infra.dev.ci-bisector:8876916043913049792:18:0) after 6m42s
[04:42:16.171] Handling timer "check-buildbucket-build-status" (pigweed/infra.dev.ci-bisector:8876916043913049792:18:0)
[04:42:16.205] Build status: SCHEDULED
[04:42:16.205] Scheduling timer "check-buildbucket-build-status" (pigweed/infra.dev.ci-bisector:8876916043913049792:19:0) after 5m32s
[04:47:48.227] Handling timer "check-buildbucket-build-status" (pigweed/infra.dev.ci-bisector:8876916043913049792:19:0)
[04:47:48.264] Build status: SCHEDULED
[04:47:48.264] Scheduling timer "check-buildbucket-build-status" (pigweed/infra.dev.ci-bisector:8876916043913049792:20:0) after 7m14s
[04:55:02.390] Handling timer "check-buildbucket-build-status" (pigweed/infra.dev.ci-bisector:8876916043913049792:20:0)
[04:55:02.432] Build status: SCHEDULED
[04:55:02.432] Scheduling timer "check-buildbucket-build-status" (pigweed/infra.dev.ci-bisector:8876916043913049792:21:0) after 2m53s
[04:57:55.519] Handling timer "check-buildbucket-build-status" (pigweed/infra.dev.ci-bisector:8876916043913049792:21:0)
[04:57:55.631] Build status: SCHEDULED
[04:57:55.631] Scheduling timer "check-buildbucket-build-status" (pigweed/infra.dev.ci-bisector:8876916043913049792:22:0) after 7m46s
[05:05:41.705] Handling timer "check-buildbucket-build-status" (pigweed/infra.dev.ci-bisector:8876916043913049792:22:0)
[05:05:41.741] Build status: SCHEDULED
[05:05:41.741] Scheduling timer "check-buildbucket-build-status" (pigweed/infra.dev.ci-bisector:8876916043913049792:23:0) after 4m23s
[05:10:04.757] Handling timer "check-buildbucket-build-status" (pigweed/infra.dev.ci-bisector:8876916043913049792:23:0)
[05:10:04.799] Build status: SCHEDULED
[05:10:04.799] Scheduling timer "check-buildbucket-build-status" (pigweed/infra.dev.ci-bisector:8876916043913049792:24:0) after 4m42s
[05:14:47.018] Handling timer "check-buildbucket-build-status" (pigweed/infra.dev.ci-bisector:8876916043913049792:24:0)
[05:14:47.056] Build status: SCHEDULED
[05:14:47.056] Scheduling timer "check-buildbucket-build-status" (pigweed/infra.dev.ci-bisector:8876916043913049792:25:0) after 1m23s
[05:16:10.207] Handling timer "check-buildbucket-build-status" (pigweed/infra.dev.ci-bisector:8876916043913049792:25:0)
[05:16:10.243] Build status: SCHEDULED
[05:16:10.243] Scheduling timer "check-buildbucket-build-status" (pigweed/infra.dev.ci-bisector:8876916043913049792:26:0) after 5m1s
[05:21:11.265] Handling timer "check-buildbucket-build-status" (pigweed/infra.dev.ci-bisector:8876916043913049792:26:0)
[05:21:11.297] Build status: SCHEDULED
[05:21:11.297] Scheduling timer "check-buildbucket-build-status" (pigweed/infra.dev.ci-bisector:8876916043913049792:27:0) after 9m42s
[05:30:53.545] Handling timer "check-buildbucket-build-status" (pigweed/infra.dev.ci-bisector:8876916043913049792:27:0)
[05:30:53.573] Build status: SCHEDULED
[05:30:53.573] Scheduling timer "check-buildbucket-build-status" (pigweed/infra.dev.ci-bisector:8876916043913049792:28:0) after 5m3s
[05:35:56.541] Handling timer "check-buildbucket-build-status" (pigweed/infra.dev.ci-bisector:8876916043913049792:28:0)
[05:35:56.581] Build status: SCHEDULED
[05:35:56.581] Scheduling timer "check-buildbucket-build-status" (pigweed/infra.dev.ci-bisector:8876916043913049792:29:0) after 3m15s
[05:39:11.605] Handling timer "check-buildbucket-build-status" (pigweed/infra.dev.ci-bisector:8876916043913049792:29:0)
[05:39:11.639] Build status: SCHEDULED
[05:39:11.639] Scheduling timer "check-buildbucket-build-status" (pigweed/infra.dev.ci-bisector:8876916043913049792:30:0) after 8m24s
[05:47:36.138] Handling timer "check-buildbucket-build-status" (pigweed/infra.dev.ci-bisector:8876916043913049792:30:0)
[05:47:36.174] Build status: SCHEDULED
[05:47:36.174] Scheduling timer "check-buildbucket-build-status" (pigweed/infra.dev.ci-bisector:8876916043913049792:31:0) after 5m10s
[05:52:46.196] Handling timer "check-buildbucket-build-status" (pigweed/infra.dev.ci-bisector:8876916043913049792:31:0)
[05:52:46.246] Build status: SCHEDULED
[05:52:46.246] Scheduling timer "check-buildbucket-build-status" (pigweed/infra.dev.ci-bisector:8876916043913049792:32:0) after 7m59s
[06:00:45.293] Handling timer "check-buildbucket-build-status" (pigweed/infra.dev.ci-bisector:8876916043913049792:32:0)
[06:00:45.311] Build status: SCHEDULED
[06:00:45.311] Scheduling timer "check-buildbucket-build-status" (pigweed/infra.dev.ci-bisector:8876916043913049792:33:0) after 9m30s
[06:10:15.329] Handling timer "check-buildbucket-build-status" (pigweed/infra.dev.ci-bisector:8876916043913049792:33:0)
[06:10:15.354] Build status: SCHEDULED
[06:10:15.354] Scheduling timer "check-buildbucket-build-status" (pigweed/infra.dev.ci-bisector:8876916043913049792:34:0) after 4m16s
[06:14:31.366] Handling timer "check-buildbucket-build-status" (pigweed/infra.dev.ci-bisector:8876916043913049792:34:0)
[06:14:31.393] Build status: SCHEDULED
[06:14:31.393] Scheduling timer "check-buildbucket-build-status" (pigweed/infra.dev.ci-bisector:8876916043913049792:35:0) after 5m4s
[06:19:35.423] Handling timer "check-buildbucket-build-status" (pigweed/infra.dev.ci-bisector:8876916043913049792:35:0)
[06:19:35.591] Build status: SCHEDULED
[06:19:35.591] Scheduling timer "check-buildbucket-build-status" (pigweed/infra.dev.ci-bisector:8876916043913049792:36:0) after 2m34s
[06:22:09.611] Handling timer "check-buildbucket-build-status" (pigweed/infra.dev.ci-bisector:8876916043913049792:36:0)
[06:22:09.692] Build status: SCHEDULED
[06:22:09.692] Scheduling timer "check-buildbucket-build-status" (pigweed/infra.dev.ci-bisector:8876916043913049792:37:0) after 3m16s
[06:25:25.823] Handling timer "check-buildbucket-build-status" (pigweed/infra.dev.ci-bisector:8876916043913049792:37:0)
[06:25:25.894] Build status: SCHEDULED
[06:25:25.894] Scheduling timer "check-buildbucket-build-status" (pigweed/infra.dev.ci-bisector:8876916043913049792:38:0) after 9m51s
[06:35:16.917] Handling timer "check-buildbucket-build-status" (pigweed/infra.dev.ci-bisector:8876916043913049792:38:0)
[06:35:17.011] Build status: SCHEDULED
[06:35:17.011] Scheduling timer "check-buildbucket-build-status" (pigweed/infra.dev.ci-bisector:8876916043913049792:39:0) after 8m4s
[06:43:21.226] Handling timer "check-buildbucket-build-status" (pigweed/infra.dev.ci-bisector:8876916043913049792:39:0)
[06:43:21.258] Build status: SCHEDULED
[06:43:21.258] Scheduling timer "check-buildbucket-build-status" (pigweed/infra.dev.ci-bisector:8876916043913049792:40:0) after 6m9s
[06:49:30.378] Handling timer "check-buildbucket-build-status" (pigweed/infra.dev.ci-bisector:8876916043913049792:40:0)
[06:49:30.412] Build status: SCHEDULED
[06:49:30.412] Scheduling timer "check-buildbucket-build-status" (pigweed/infra.dev.ci-bisector:8876916043913049792:41:0) after 2m45s
[06:49:39.419] Received PubSub notification, asking Buildbucket for the build status
[06:49:39.558] Build status: STARTED
[06:49:53.443] Received PubSub notification, asking Buildbucket for the build status
[06:49:53.459] Build:
{
"id": "8711485981996019217",
"builder": {
"project": "pigweed",
"bucket": "infra.dev.ci",
"builder": "bisector"
},
"createdBy": "project:pigweed",
"createTime": "2025-06-21T03:29:43.445213614Z",
"startTime": "2025-06-21T06:49:39.205180818Z",
"endTime": "2025-06-21T06:49:53.184488800Z",
"updateTime": "2025-06-21T06:49:53.184488800Z",
"status": "INFRA_FAILURE",
"input": {
}
}
[06:49:53.459] Invocation finished in 3h20m11.226928531s with status FAILED