1. All projects
  2. pigweed
  3. pigweed.dev.ci-pigweed-mac-x86-gn-platform
  4. 8869216841252993952
Status: FAILED
Triggered by: -
Duration: 8 hours
Actions:

Definition (rev 575f56d3bcf68ea407b7d04b48f5487de4eb2d8f) 

buildbucket: <
  server: "cr-buildbucket.appspot.com"
  bucket: "pigweed.dev.ci"
  builder: "pigweed-mac-x86-gn-platform"
>

Incoming triggers

Incoming properties

{
  "branch": "refs/heads/main",
  "repository": "https://pigweed.googlesource.com/pigweed/pigweed",
  "revision": "fdebd4b4c44d8323bf6e64213c151743ef25e0ff"
}

Incoming tags

  • buildset:commit/gitiles/pigweed.googlesource.com/pigweed/pigweed/+/fdebd4b4c44d8323bf6e64213c151743ef25e0ff
  • gitiles_ref:refs/heads/main

Debug log (UTC)

[03:05:14.079] New invocation is queued and will start shortly
[03:05:17.621] Starting the invocation (attempt 1)
[03:05:17.661] Popped buildset tag "buildset:commit/gitiles/pigweed.googlesource.com/pigweed/pigweed/+/fdebd4b4c44d8323bf6e64213c151743ef25e0ff"
[03:05:17.661] Popped gitiles commit info from properties and tags
[03:05:17.661] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[03:05:17.662] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[03:05:17.662] Buildbucket request:
{
  "requestId": "8869216841252993952",
  "builder": {
    "project": "pigweed",
    "bucket": "pigweed.dev.ci",
    "builder": "pigweed-mac-x86-gn-platform"
  },
  "properties": {
      "$recipe_engine/scheduler": {
            "hostname": "luci-scheduler.appspot.com",
            "invocation": "8869216841252993952",
            "job": "pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform",
            "triggers": [
                  {
                        "gitiles": {
                              "ref": "refs/heads/main",
                              "repo": "https://pigweed.googlesource.com/pigweed/pigweed",
                              "revision": "fdebd4b4c44d8323bf6e64213c151743ef25e0ff"
                            },
                        "id": "https://pigweed.googlesource.com/pigweed/pigweed/+/refs/heads/main@fdebd4b4c44d8323bf6e64213c151743ef25e0ff",
                        "title": "fdebd4b4c44d8323bf6e64213c151743ef25e0ff",
                        "url": "https://pigweed.googlesource.com/pigweed/pigweed/+/fdebd4b4c44d8323bf6e64213c151743ef25e0ff"
                      }
                ]
          }
    },
  "gitilesCommit": {
    "host": "pigweed.googlesource.com",
    "project": "pigweed/pigweed",
    "id": "fdebd4b4c44d8323bf6e64213c151743ef25e0ff",
    "ref": "refs/heads/main"
  },
  "tags": [
    {
      "key": "scheduler_invocation_id",
      "value": "8869216841252993952"
    },
    {
      "key": "scheduler_job_id",
      "value": "pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform"
    },
    {
      "key": "user_agent",
      "value": "luci-scheduler"
    }
  ],
  "notify": {
    "pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
  }
}
[03:05:17.998] Scheduled build:
{
  "id": "8703786776776754785",
  "builder": {
    "project": "pigweed",
    "bucket": "pigweed.dev.ci",
    "builder": "pigweed-mac-x86-gn-platform"
  },
  "createdBy": "project:pigweed",
  "createTime": "2025-09-14T03:05:17.719743902Z",
  "updateTime": "2025-09-14T03:05:17.719743902Z",
  "status": "SCHEDULED",
  "input": {
    "gitilesCommit": {
      "host": "pigweed.googlesource.com",
      "project": "pigweed/pigweed",
      "id": "fdebd4b4c44d8323bf6e64213c151743ef25e0ff",
      "ref": "refs/heads/main"
    }
  }
}
[03:05:17.998] Task URL: https://cr-buildbucket.appspot.com/build/8703786776776754785
[03:05:17.998] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:2:0) after 2m59s
[03:05:19.017] Received PubSub notification, asking Buildbucket for the build status
[03:05:19.056] Build status: SCHEDULED
[03:08:17.179] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:2:0)
[03:08:17.220] Build status: SCHEDULED
[03:08:17.220] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:4:0) after 8m11s
[03:16:28.514] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:4:0)
[03:16:28.530] Build status: SCHEDULED
[03:16:28.530] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:5:0) after 2m4s
[03:18:32.589] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:5:0)
[03:18:32.604] Build status: SCHEDULED
[03:18:32.604] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:6:0) after 1m51s
[03:20:23.629] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:6:0)
[03:20:23.645] Build status: SCHEDULED
[03:20:23.645] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:7:0) after 8m34s
[03:28:57.689] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:7:0)
[03:28:57.714] Build status: SCHEDULED
[03:28:57.714] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:8:0) after 9m39s
[03:38:36.884] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:8:0)
[03:38:36.902] Build status: SCHEDULED
[03:38:36.902] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:9:0) after 3m2s
[03:41:38.947] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:9:0)
[03:41:38.968] Build status: SCHEDULED
[03:41:38.968] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:10:0) after 5m17s
[03:46:56.076] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:10:0)
[03:46:56.104] Build status: SCHEDULED
[03:46:56.105] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:11:0) after 5m52s
[03:52:48.159] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:11:0)
[03:52:48.179] Build status: SCHEDULED
[03:52:48.179] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:12:0) after 3m55s
[03:56:43.194] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:12:0)
[03:56:43.210] Build status: SCHEDULED
[03:56:43.210] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:13:0) after 1m20s
[03:58:03.347] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:13:0)
[03:58:03.392] Build status: SCHEDULED
[03:58:03.392] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:14:0) after 1m38s
[03:59:41.461] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:14:0)
[03:59:41.488] Build status: SCHEDULED
[03:59:41.488] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:15:0) after 6m14s
[04:05:55.642] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:15:0)
[04:05:55.666] Build status: SCHEDULED
[04:05:55.666] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:16:0) after 5m56s
[04:11:51.776] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:16:0)
[04:11:51.797] Build status: SCHEDULED
[04:11:51.797] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:17:0) after 1m31s
[04:13:22.930] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:17:0)
[04:13:22.953] Build status: SCHEDULED
[04:13:22.953] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:18:0) after 5m36s
[04:18:59.014] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:18:0)
[04:18:59.069] Build status: SCHEDULED
[04:18:59.069] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:19:0) after 9m21s
[04:28:20.094] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:19:0)
[04:28:20.201] Build status: SCHEDULED
[04:28:20.201] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:20:0) after 3m17s
[04:31:37.251] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:20:0)
[04:31:37.267] Build status: SCHEDULED
[04:31:37.267] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:21:0) after 1m8s
[04:32:45.438] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:21:0)
[04:32:45.457] Build status: SCHEDULED
[04:32:45.457] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:22:0) after 4m58s
[04:37:43.616] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:22:0)
[04:37:43.712] Build status: SCHEDULED
[04:37:43.712] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:23:0) after 3m31s
[04:41:14.742] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:23:0)
[04:41:14.762] Build status: SCHEDULED
[04:41:14.762] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:24:0) after 8m53s
[04:50:07.775] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:24:0)
[04:50:07.795] Build status: SCHEDULED
[04:50:07.795] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:25:0) after 4m45s
[04:54:52.903] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:25:0)
[04:54:52.982] Build status: SCHEDULED
[04:54:52.982] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:26:0) after 4m42s
[04:59:34.998] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:26:0)
[04:59:35.011] Build status: SCHEDULED
[04:59:35.011] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:27:0) after 4m12s
[05:03:47.026] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:27:0)
[05:03:47.047] Build status: SCHEDULED
[05:03:47.047] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:28:0) after 4m58s
[05:08:45.060] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:28:0)
[05:08:45.078] Build status: SCHEDULED
[05:08:45.078] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:29:0) after 2m45s
[05:11:30.143] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:29:0)
[05:11:30.169] Build status: SCHEDULED
[05:11:30.169] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:30:0) after 6m41s
[05:18:11.185] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:30:0)
[05:18:11.248] Build status: SCHEDULED
[05:18:11.248] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:31:0) after 8m44s
[05:26:55.261] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:31:0)
[05:26:55.275] Build status: SCHEDULED
[05:26:55.275] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:32:0) after 2m5s
[05:29:00.290] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:32:0)
[05:29:00.316] Build status: SCHEDULED
[05:29:00.316] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:33:0) after 4m45s
[05:33:45.335] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:33:0)
[05:33:45.400] Build status: SCHEDULED
[05:33:45.400] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:34:0) after 5m32s
[05:39:17.449] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:34:0)
[05:39:17.468] Build status: SCHEDULED
[05:39:17.468] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:35:0) after 5m28s
[05:44:45.488] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:35:0)
[05:44:45.506] Build status: SCHEDULED
[05:44:45.506] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:36:0) after 6m6s
[05:50:51.662] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:36:0)
[05:50:51.707] Build status: SCHEDULED
[05:50:51.722] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:37:0) after 7m36s
[05:58:28.183] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:37:0)
[05:58:28.213] Build status: SCHEDULED
[05:58:28.213] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:38:0) after 7m55s
[06:06:23.182] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:38:0)
[06:06:23.199] Build status: SCHEDULED
[06:06:23.199] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:39:0) after 2m56s
[06:09:19.219] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:39:0)
[06:09:19.343] Build status: SCHEDULED
[06:09:19.343] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:40:0) after 4m18s
[06:13:37.558] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:40:0)
[06:13:37.639] Build status: SCHEDULED
[06:13:37.639] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:41:0) after 9m44s
[06:23:21.786] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:41:0)
[06:23:21.810] Build status: SCHEDULED
[06:23:21.810] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:42:0) after 7m56s
[06:31:17.823] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:42:0)
[06:31:17.842] Build status: SCHEDULED
[06:31:17.842] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:43:0) after 6m4s
[06:37:21.860] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:43:0)
[06:37:21.877] Build status: SCHEDULED
[06:37:21.877] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:44:0) after 2m56s
[06:40:17.893] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:44:0)
[06:40:17.931] Build status: SCHEDULED
[06:40:17.931] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:45:0) after 5m23s
[06:45:40.958] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:45:0)
[06:45:40.978] Build status: SCHEDULED
[06:45:40.978] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:46:0) after 6m17s
[06:51:57.994] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:46:0)
[06:51:58.012] Build status: SCHEDULED
[06:51:58.012] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:47:0) after 7m6s
[06:59:04.173] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:47:0)
[06:59:04.222] Build status: SCHEDULED
[06:59:04.222] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:48:0) after 9m46s
[07:08:50.225] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:48:0)
[07:08:50.307] Build status: SCHEDULED
[07:08:50.307] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:49:0) after 5m10s
[07:14:00.475] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:49:0)
[07:14:00.490] Build status: SCHEDULED
[07:14:00.490] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:50:0) after 4m55s
[07:18:55.510] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:50:0)
[07:18:55.541] Build status: SCHEDULED
[07:18:55.541] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:51:0) after 4m17s
[07:23:12.556] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:51:0)
[07:23:12.570] Build status: SCHEDULED
[07:23:12.570] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:52:0) after 5m0s
[07:28:12.806] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:52:0)
[07:28:12.829] Build status: SCHEDULED
[07:28:12.829] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:53:0) after 6m22s
[07:34:34.844] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:53:0)
[07:34:34.869] Build status: SCHEDULED
[07:34:34.869] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:54:0) after 1m5s
[07:35:39.992] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:54:0)
[07:35:40.094] Build status: SCHEDULED
[07:35:40.094] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:55:0) after 1m42s
[07:37:22.110] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:55:0)
[07:37:22.129] Build status: SCHEDULED
[07:37:22.129] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:56:0) after 4m53s
[07:42:15.409] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:56:0)
[07:42:15.427] Build status: SCHEDULED
[07:42:15.427] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:57:0) after 3m34s
[07:45:49.442] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:57:0)
[07:45:49.467] Build status: SCHEDULED
[07:45:49.467] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:58:0) after 4m34s
[07:50:23.437] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:58:0)
[07:50:23.458] Build status: SCHEDULED
[07:50:23.458] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:59:0) after 3m2s
[07:53:25.560] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:59:0)
[07:53:25.590] Build status: SCHEDULED
[07:53:25.590] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:60:0) after 7m22s
[08:00:47.618] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:60:0)
[08:00:47.685] Build status: SCHEDULED
[08:00:47.685] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:61:0) after 1m23s
[08:02:10.697] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:61:0)
[08:02:10.717] Build status: SCHEDULED
[08:02:10.717] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:62:0) after 2m51s
[08:05:01.840] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:62:0)
[08:05:01.873] Build status: SCHEDULED
[08:05:01.873] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:63:0) after 7m46s
[08:12:47.889] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:63:0)
[08:12:47.912] Build status: SCHEDULED
[08:12:47.912] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:64:0) after 2m57s
[08:15:44.914] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:64:0)
[08:15:44.929] Build status: SCHEDULED
[08:15:44.930] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:65:0) after 7m33s
[08:23:18.048] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:65:0)
[08:23:18.065] Build status: SCHEDULED
[08:23:18.065] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:66:0) after 5m11s
[08:28:29.187] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:66:0)
[08:28:29.207] Build status: SCHEDULED
[08:28:29.207] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:67:0) after 9m19s
[08:37:48.224] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:67:0)
[08:37:48.254] Build status: SCHEDULED
[08:37:48.254] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:68:0) after 8m31s
[08:46:19.272] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:68:0)
[08:46:19.294] Build status: SCHEDULED
[08:46:19.294] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:69:0) after 8m55s
[08:55:14.434] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:69:0)
[08:55:14.454] Build status: SCHEDULED
[08:55:14.454] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:70:0) after 7m45s
[09:02:59.513] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:70:0)
[09:02:59.535] Build status: SCHEDULED
[09:02:59.535] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:71:0) after 3m9s
[09:06:08.706] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:71:0)
[09:06:08.726] Build status: SCHEDULED
[09:06:08.726] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:72:0) after 5m25s
[09:11:33.869] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:72:0)
[09:11:33.888] Build status: SCHEDULED
[09:11:33.888] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:73:0) after 7m49s
[09:19:23.027] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:73:0)
[09:19:23.044] Build status: SCHEDULED
[09:19:23.044] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:74:0) after 3m27s
[09:22:50.070] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:74:0)
[09:22:50.110] Build status: SCHEDULED
[09:22:50.110] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:75:0) after 7m17s
[09:30:07.126] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:75:0)
[09:30:07.153] Build status: SCHEDULED
[09:30:07.153] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:76:0) after 3m25s
[09:33:32.184] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:76:0)
[09:33:32.202] Build status: SCHEDULED
[09:33:32.202] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:77:0) after 8m45s
[09:42:17.302] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:77:0)
[09:42:17.322] Build status: SCHEDULED
[09:42:17.322] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:78:0) after 4m19s
[09:46:36.460] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:78:0)
[09:46:36.489] Build status: SCHEDULED
[09:46:36.489] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:79:0) after 9m55s
[09:56:31.544] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:79:0)
[09:56:31.561] Build status: SCHEDULED
[09:56:31.561] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:80:0) after 2m19s
[09:58:50.686] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:80:0)
[09:58:50.718] Build status: SCHEDULED
[09:58:50.718] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:81:0) after 8m10s
[10:07:00.740] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:81:0)
[10:07:00.756] Build status: SCHEDULED
[10:07:00.756] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:82:0) after 4m27s
[10:11:27.774] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:82:0)
[10:11:27.857] Build status: SCHEDULED
[10:11:27.857] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:83:0) after 3m13s
[10:14:40.915] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:83:0)
[10:14:40.932] Build status: SCHEDULED
[10:14:40.932] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:84:0) after 6m38s
[10:21:18.948] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:84:0)
[10:21:18.967] Build status: SCHEDULED
[10:21:18.967] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:85:0) after 8m42s
[10:30:01.007] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:85:0)
[10:30:01.055] Build status: SCHEDULED
[10:30:01.055] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:86:0) after 8m2s
[10:38:03.137] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:86:0)
[10:38:03.260] Build status: SCHEDULED
[10:38:03.260] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:87:0) after 2m37s
[10:40:40.285] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:87:0)
[10:40:40.316] Build status: SCHEDULED
[10:40:40.316] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:88:0) after 6m56s
[10:47:36.333] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:88:0)
[10:47:36.359] Build status: SCHEDULED
[10:47:36.359] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:89:0) after 7m41s
[10:55:17.396] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:89:0)
[10:55:17.415] Build status: SCHEDULED
[10:55:17.415] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:90:0) after 1m22s
[10:56:39.437] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:90:0)
[10:56:39.453] Build status: SCHEDULED
[10:56:39.453] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-platform:8869216841252993952:91:0) after 9m6s
[11:05:28.307] Received PubSub notification, asking Buildbucket for the build status
[11:05:28.333] Build:
{
  "id": "8703786776776754785",
  "builder": {
    "project": "pigweed",
    "bucket": "pigweed.dev.ci",
    "builder": "pigweed-mac-x86-gn-platform"
  },
  "createdBy": "project:pigweed",
  "createTime": "2025-09-14T03:05:17.719743902Z",
  "endTime": "2025-09-14T11:05:25.285450318Z",
  "updateTime": "2025-09-14T11:05:25.285450318Z",
  "status": "INFRA_FAILURE",
  "statusDetails": {
    "resourceExhaustion": {

    },
    "timeout": {

    }
  },
  "input": {
    "gitilesCommit": {
      "host": "pigweed.googlesource.com",
      "project": "pigweed/pigweed",
      "id": "fdebd4b4c44d8323bf6e64213c151743ef25e0ff",
      "ref": "refs/heads/main"
    }
  }
}
[11:05:28.333] Invocation finished in 8h0m14.2660937s with status FAILED