1. All projects
  2. pigweed
  3. pigweed.dev.ci-pigweed-mac-x86-zephyr
  4. 8868994269387690944
Status: FAILED
Triggered by: -
Duration: 8 hours
Actions:

Definition (rev 4c9983091ab9999abc5d04968bb40ccf57e06244) 

buildbucket: <
  server: "cr-buildbucket.appspot.com"
  bucket: "pigweed.dev.ci"
  builder: "pigweed-mac-x86-zephyr"
>

Incoming triggers

Incoming properties

{
  "branch": "refs/heads/main",
  "repository": "https://pigweed.googlesource.com/pigweed/pigweed",
  "revision": "769a062730c0d17de49bcf1733bebfbb78c8ac04"
}

Incoming tags

  • buildset:commit/gitiles/pigweed.googlesource.com/pigweed/pigweed/+/769a062730c0d17de49bcf1733bebfbb78c8ac04
  • gitiles_ref:refs/heads/main

Debug log (UTC)

[14:02:55.148] New invocation is queued and will start shortly
[14:02:56.299] Starting the invocation (attempt 1)
[14:02:56.326] Popped buildset tag "buildset:commit/gitiles/pigweed.googlesource.com/pigweed/pigweed/+/769a062730c0d17de49bcf1733bebfbb78c8ac04"
[14:02:56.326] Popped gitiles commit info from properties and tags
[14:02:56.326] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[14:02:56.326] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[14:02:56.327] Buildbucket request:
{
  "requestId": "8868994269387690944",
  "builder": {
    "project": "pigweed",
    "bucket": "pigweed.dev.ci",
    "builder": "pigweed-mac-x86-zephyr"
  },
  "properties": {
      "$recipe_engine/scheduler": {
            "hostname": "luci-scheduler.appspot.com",
            "invocation": "8868994269387690944",
            "job": "pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr",
            "triggers": [
                  {
                        "gitiles": {
                              "ref": "refs/heads/main",
                              "repo": "https://pigweed.googlesource.com/pigweed/pigweed",
                              "revision": "769a062730c0d17de49bcf1733bebfbb78c8ac04"
                            },
                        "id": "https://pigweed.googlesource.com/pigweed/pigweed/+/refs/heads/main@769a062730c0d17de49bcf1733bebfbb78c8ac04",
                        "title": "769a062730c0d17de49bcf1733bebfbb78c8ac04",
                        "url": "https://pigweed.googlesource.com/pigweed/pigweed/+/769a062730c0d17de49bcf1733bebfbb78c8ac04"
                      }
                ]
          }
    },
  "gitilesCommit": {
    "host": "pigweed.googlesource.com",
    "project": "pigweed/pigweed",
    "id": "769a062730c0d17de49bcf1733bebfbb78c8ac04",
    "ref": "refs/heads/main"
  },
  "tags": [
    {
      "key": "scheduler_invocation_id",
      "value": "8868994269387690944"
    },
    {
      "key": "scheduler_job_id",
      "value": "pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr"
    },
    {
      "key": "user_agent",
      "value": "luci-scheduler"
    }
  ],
  "notify": {
    "pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
  }
}
[14:02:57.110] Scheduled build:
{
  "id": "8703564207384628385",
  "builder": {
    "project": "pigweed",
    "bucket": "pigweed.dev.ci",
    "builder": "pigweed-mac-x86-zephyr"
  },
  "createdBy": "project:pigweed",
  "createTime": "2025-09-16T14:02:56.432876974Z",
  "updateTime": "2025-09-16T14:02:56.432876974Z",
  "status": "SCHEDULED",
  "input": {
    "gitilesCommit": {
      "host": "pigweed.googlesource.com",
      "project": "pigweed/pigweed",
      "id": "769a062730c0d17de49bcf1733bebfbb78c8ac04",
      "ref": "refs/heads/main"
    }
  }
}
[14:02:57.110] Task URL: https://cr-buildbucket.appspot.com/build/8703564207384628385
[14:02:57.110] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:2:0) after 4m19s
[14:02:58.072] Received PubSub notification, asking Buildbucket for the build status
[14:02:58.100] Build status: SCHEDULED
[14:07:16.200] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:2:0)
[14:07:16.219] Build status: SCHEDULED
[14:07:16.220] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:4:0) after 1m7s
[14:08:23.235] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:4:0)
[14:08:23.475] Build status: SCHEDULED
[14:08:23.475] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:5:0) after 1m54s
[14:10:17.491] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:5:0)
[14:10:17.521] Build status: SCHEDULED
[14:10:17.521] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:6:0) after 9m22s
[14:19:39.491] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:6:0)
[14:19:39.514] Build status: SCHEDULED
[14:19:39.514] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:7:0) after 9m38s
[14:29:17.570] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:7:0)
[14:29:17.590] Build status: SCHEDULED
[14:29:17.590] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:8:0) after 8m24s
[14:37:41.657] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:8:0)
[14:37:41.701] Build status: SCHEDULED
[14:37:41.701] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:9:0) after 3m51s
[14:41:32.713] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:9:0)
[14:41:32.740] Build status: SCHEDULED
[14:41:32.740] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:10:0) after 7m52s
[14:49:24.807] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:10:0)
[14:49:24.875] Build status: SCHEDULED
[14:49:24.876] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:11:0) after 1m14s
[14:50:38.891] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:11:0)
[14:50:38.907] Build status: SCHEDULED
[14:50:38.907] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:12:0) after 4m28s
[14:55:07.013] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:12:0)
[14:55:07.058] Build status: SCHEDULED
[14:55:07.059] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:13:0) after 9m2s
[15:04:09.074] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:13:0)
[15:04:09.092] Build status: SCHEDULED
[15:04:09.092] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:14:0) after 1m56s
[15:06:05.109] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:14:0)
[15:06:05.146] Build status: SCHEDULED
[15:06:05.146] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:15:0) after 4m42s
[15:10:47.220] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:15:0)
[15:10:47.241] Build status: SCHEDULED
[15:10:47.241] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:16:0) after 9m37s
[15:20:24.369] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:16:0)
[15:20:24.403] Build status: SCHEDULED
[15:20:24.403] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:17:0) after 3m27s
[15:23:51.462] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:17:0)
[15:23:51.486] Build status: SCHEDULED
[15:23:51.487] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:18:0) after 7m36s
[15:31:27.503] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:18:0)
[15:31:27.573] Build status: SCHEDULED
[15:31:27.573] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:19:0) after 5m2s
[15:36:29.588] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:19:0)
[15:36:29.607] Build status: SCHEDULED
[15:36:29.607] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:20:0) after 3m51s
[15:40:20.586] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:20:0)
[15:40:20.603] Build status: SCHEDULED
[15:40:20.603] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:21:0) after 3m43s
[15:44:03.617] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:21:0)
[15:44:03.647] Build status: SCHEDULED
[15:44:03.647] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:22:0) after 2m19s
[15:46:22.727] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:22:0)
[15:46:23.220] Build status: SCHEDULED
[15:46:23.220] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:23:0) after 9m43s
[15:56:06.244] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:23:0)
[15:56:06.260] Build status: SCHEDULED
[15:56:06.260] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:24:0) after 6m10s
[16:02:16.325] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:24:0)
[16:02:16.346] Build status: SCHEDULED
[16:02:16.346] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:25:0) after 5m30s
[16:07:46.358] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:25:0)
[16:07:46.377] Build status: SCHEDULED
[16:07:46.377] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:26:0) after 7m38s
[16:15:24.452] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:26:0)
[16:15:24.468] Build status: SCHEDULED
[16:15:24.468] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:27:0) after 5m9s
[16:20:33.541] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:27:0)
[16:20:33.556] Build status: SCHEDULED
[16:20:33.556] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:28:0) after 2m48s
[16:23:21.554] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:28:0)
[16:23:21.589] Build status: SCHEDULED
[16:23:21.589] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:29:0) after 7m28s
[16:30:49.635] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:29:0)
[16:30:49.659] Build status: SCHEDULED
[16:30:49.659] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:30:0) after 2m34s
[16:33:23.697] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:30:0)
[16:33:23.726] Build status: SCHEDULED
[16:33:23.726] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:31:0) after 7m40s
[16:41:03.727] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:31:0)
[16:41:03.784] Build status: SCHEDULED
[16:41:03.784] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:32:0) after 5m36s
[16:46:39.970] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:32:0)
[16:46:40.051] Build status: SCHEDULED
[16:46:40.051] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:33:0) after 3m22s
[16:50:02.124] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:33:0)
[16:50:02.149] Build status: SCHEDULED
[16:50:02.149] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:34:0) after 9m7s
[16:59:09.209] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:34:0)
[16:59:09.257] Build status: SCHEDULED
[16:59:09.257] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:35:0) after 9m58s
[17:09:07.294] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:35:0)
[17:09:07.309] Build status: SCHEDULED
[17:09:07.309] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:36:0) after 2m30s
[17:11:37.415] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:36:0)
[17:11:37.448] Build status: SCHEDULED
[17:11:37.448] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:37:0) after 3m2s
[17:14:39.518] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:37:0)
[17:14:39.534] Build status: SCHEDULED
[17:14:39.534] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:38:0) after 3m27s
[17:18:06.530] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:38:0)
[17:18:06.547] Build status: SCHEDULED
[17:18:06.547] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:39:0) after 4m31s
[17:22:37.640] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:39:0)
[17:22:37.660] Build status: SCHEDULED
[17:22:37.660] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:40:0) after 2m36s
[17:25:13.773] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:40:0)
[17:25:13.791] Build status: SCHEDULED
[17:25:13.791] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:41:0) after 9m22s
[17:34:35.837] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:41:0)
[17:34:35.864] Build status: SCHEDULED
[17:34:35.864] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:42:0) after 2m38s
[17:37:14.017] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:42:0)
[17:37:14.082] Build status: SCHEDULED
[17:37:14.082] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:43:0) after 3m14s
[17:40:28.155] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:43:0)
[17:40:28.195] Build status: SCHEDULED
[17:40:28.195] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:44:0) after 4m40s
[17:45:08.262] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:44:0)
[17:45:08.386] Build status: SCHEDULED
[17:45:08.386] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:45:0) after 7m37s
[17:52:45.455] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:45:0)
[17:52:45.529] Build status: SCHEDULED
[17:52:45.529] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:46:0) after 1m5s
[17:53:50.572] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:46:0)
[17:53:50.600] Build status: SCHEDULED
[17:53:50.600] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:47:0) after 7m33s
[18:01:23.647] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:47:0)
[18:01:23.707] Build status: SCHEDULED
[18:01:23.707] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:48:0) after 4m58s
[18:06:21.725] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:48:0)
[18:06:21.790] Build status: SCHEDULED
[18:06:21.790] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:49:0) after 7m53s
[18:14:14.830] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:49:0)
[18:14:14.911] Build status: SCHEDULED
[18:14:14.911] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:50:0) after 6m59s
[18:21:13.940] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:50:0)
[18:21:13.972] Build status: SCHEDULED
[18:21:13.972] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:51:0) after 1m23s
[18:22:37.115] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:51:0)
[18:22:37.148] Build status: SCHEDULED
[18:22:37.148] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:52:0) after 6m59s
[18:29:36.210] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:52:0)
[18:29:36.228] Build status: SCHEDULED
[18:29:36.228] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:53:0) after 2m38s
[18:32:14.298] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:53:0)
[18:32:14.317] Build status: SCHEDULED
[18:32:14.317] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:54:0) after 8m6s
[18:40:20.369] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:54:0)
[18:40:20.391] Build status: SCHEDULED
[18:40:20.391] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:55:0) after 8m27s
[18:48:47.640] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:55:0)
[18:48:47.660] Build status: SCHEDULED
[18:48:47.660] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:56:0) after 2m33s
[18:51:20.709] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:56:0)
[18:51:20.796] Build status: SCHEDULED
[18:51:20.796] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:57:0) after 2m42s
[18:54:02.797] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:57:0)
[18:54:02.870] Build status: SCHEDULED
[18:54:02.870] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:58:0) after 7m39s
[19:01:41.854] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:58:0)
[19:01:41.876] Build status: SCHEDULED
[19:01:41.876] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:59:0) after 8m33s
[19:10:14.896] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:59:0)
[19:10:14.948] Build status: SCHEDULED
[19:10:14.948] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:60:0) after 5m48s
[19:16:03.018] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:60:0)
[19:16:03.082] Build status: SCHEDULED
[19:16:03.082] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:61:0) after 8m12s
[19:24:15.158] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:61:0)
[19:24:15.190] Build status: SCHEDULED
[19:24:15.190] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:62:0) after 8m43s
[19:32:58.217] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:62:0)
[19:32:58.236] Build status: SCHEDULED
[19:32:58.236] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:63:0) after 6m50s
[19:39:48.303] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:63:0)
[19:39:48.347] Build status: SCHEDULED
[19:39:48.347] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:64:0) after 4m50s
[19:44:38.397] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:64:0)
[19:44:38.437] Build status: SCHEDULED
[19:44:38.437] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:65:0) after 8m54s
[19:53:32.457] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:65:0)
[19:53:32.480] Build status: SCHEDULED
[19:53:32.480] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:66:0) after 3m26s
[19:56:58.645] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:66:0)
[19:56:58.698] Build status: SCHEDULED
[19:56:58.698] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:67:0) after 2m24s
[19:59:22.800] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:67:0)
[19:59:22.828] Build status: SCHEDULED
[19:59:22.828] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:68:0) after 2m40s
[20:02:02.844] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:68:0)
[20:02:02.892] Build status: SCHEDULED
[20:02:02.892] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:69:0) after 5m15s
[20:07:17.931] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:69:0)
[20:07:17.949] Build status: SCHEDULED
[20:07:17.949] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:70:0) after 8m16s
[20:15:33.967] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:70:0)
[20:15:34.001] Build status: SCHEDULED
[20:15:34.001] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:71:0) after 2m23s
[20:17:57.021] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:71:0)
[20:17:57.040] Build status: SCHEDULED
[20:17:57.040] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:72:0) after 3m37s
[20:21:34.070] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:72:0)
[20:21:34.086] Build status: SCHEDULED
[20:21:34.086] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:73:0) after 3m31s
[20:25:05.154] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:73:0)
[20:25:05.174] Build status: SCHEDULED
[20:25:05.174] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:74:0) after 3m34s
[20:28:39.214] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:74:0)
[20:28:39.234] Build status: SCHEDULED
[20:28:39.234] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:75:0) after 8m59s
[20:37:38.312] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:75:0)
[20:37:38.328] Build status: SCHEDULED
[20:37:38.328] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:76:0) after 3m36s
[20:41:14.449] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:76:0)
[20:41:14.581] Build status: SCHEDULED
[20:41:14.581] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:77:0) after 2m13s
[20:43:27.615] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:77:0)
[20:43:27.635] Build status: SCHEDULED
[20:43:27.635] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:78:0) after 3m11s
[20:46:38.729] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:78:0)
[20:46:38.748] Build status: SCHEDULED
[20:46:38.748] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:79:0) after 9m26s
[20:56:04.773] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:79:0)
[20:56:04.896] Build status: SCHEDULED
[20:56:04.896] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:80:0) after 5m46s
[21:01:50.920] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:80:0)
[21:01:50.937] Build status: SCHEDULED
[21:01:50.937] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:81:0) after 8m5s
[21:09:56.079] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:81:0)
[21:09:56.167] Build status: SCHEDULED
[21:09:56.167] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:82:0) after 2m41s
[21:12:37.200] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:82:0)
[21:12:37.302] Build status: SCHEDULED
[21:12:37.302] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:83:0) after 1m24s
[21:14:01.314] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:83:0)
[21:14:01.330] Build status: SCHEDULED
[21:14:01.330] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:84:0) after 1m1s
[21:15:02.497] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:84:0)
[21:15:02.517] Build status: SCHEDULED
[21:15:02.517] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:85:0) after 3m48s
[21:18:50.770] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:85:0)
[21:18:50.787] Build status: SCHEDULED
[21:18:50.787] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:86:0) after 4m11s
[21:23:01.803] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:86:0)
[21:23:01.837] Build status: SCHEDULED
[21:23:01.838] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:87:0) after 2m23s
[21:25:24.960] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:87:0)
[21:25:24.975] Build status: SCHEDULED
[21:25:24.975] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:88:0) after 2m19s
[21:27:44.019] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:88:0)
[21:27:44.041] Build status: SCHEDULED
[21:27:44.041] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:89:0) after 6m26s
[21:34:10.153] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:89:0)
[21:34:10.172] Build status: SCHEDULED
[21:34:10.172] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:90:0) after 4m23s
[21:38:33.197] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:90:0)
[21:38:33.219] Build status: SCHEDULED
[21:38:33.219] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:91:0) after 6m39s
[21:45:12.311] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:91:0)
[21:45:12.331] Build status: SCHEDULED
[21:45:12.331] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:92:0) after 1m9s
[21:46:21.399] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:92:0)
[21:46:21.418] Build status: SCHEDULED
[21:46:21.419] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:93:0) after 5m58s
[21:52:19.432] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:93:0)
[21:52:19.450] Build status: SCHEDULED
[21:52:19.450] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:94:0) after 4m22s
[21:56:41.458] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:94:0)
[21:56:41.475] Build status: SCHEDULED
[21:56:41.475] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:95:0) after 4m19s
[22:01:00.473] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:95:0)
[22:01:00.508] Build status: SCHEDULED
[22:01:00.509] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-zephyr:8868994269387690944:96:0) after 6m38s
[22:03:04.544] Received PubSub notification, asking Buildbucket for the build status
[22:03:04.654] Build:
{
  "id": "8703564207384628385",
  "builder": {
    "project": "pigweed",
    "bucket": "pigweed.dev.ci",
    "builder": "pigweed-mac-x86-zephyr"
  },
  "createdBy": "project:pigweed",
  "createTime": "2025-09-16T14:02:56.432876974Z",
  "endTime": "2025-09-16T22:03:03.026593139Z",
  "updateTime": "2025-09-16T22:03:03.026593139Z",
  "status": "INFRA_FAILURE",
  "statusDetails": {
    "resourceExhaustion": {

    },
    "timeout": {

    }
  },
  "input": {
    "gitilesCommit": {
      "host": "pigweed.googlesource.com",
      "project": "pigweed/pigweed",
      "id": "769a062730c0d17de49bcf1733bebfbb78c8ac04",
      "ref": "refs/heads/main"
    }
  }
}
[22:03:04.655] Invocation finished in 8h0m9.517034338s with status FAILED