1. All projects
  2. pigweed
  3. pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico
  4. 8859507833199109584
Status: FAILED
Triggered by: -
Duration: 7 hours
Actions:

Definition (rev 4c9983091ab9999abc5d04968bb40ccf57e06244) 

buildbucket: <
  server: "cr-buildbucket.appspot.com"
  bucket: "pigweed.dev.ci"
  builder: "pigweed-mac-x86-gn-arduino-pico"
>

Incoming triggers

Incoming properties

{
  "branch": "refs/heads/main",
  "repository": "https://pigweed.googlesource.com/pigweed/pigweed",
  "revision": "96f4e8746c4c4fb1575dcebb1d60fb2561680d7e"
}

Incoming tags

  • buildset:commit/gitiles/pigweed.googlesource.com/pigweed/pigweed/+/96f4e8746c4c4fb1575dcebb1d60fb2561680d7e
  • gitiles_ref:refs/heads/main

Debug log (UTC)

[07:05:45.693] New invocation is queued and will start shortly
[07:05:46.744] Starting the invocation (attempt 1)
[07:05:46.766] Popped buildset tag "buildset:commit/gitiles/pigweed.googlesource.com/pigweed/pigweed/+/96f4e8746c4c4fb1575dcebb1d60fb2561680d7e"
[07:05:46.766] Popped gitiles commit info from properties and tags
[07:05:46.766] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[07:05:46.766] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[07:05:46.766] Buildbucket request:
{
  "requestId": "8859507833199109584",
  "builder": {
    "project": "pigweed",
    "bucket": "pigweed.dev.ci",
    "builder": "pigweed-mac-x86-gn-arduino-pico"
  },
  "properties": {
      "$recipe_engine/scheduler": {
            "hostname": "luci-scheduler.appspot.com",
            "invocation": "8859507833199109584",
            "job": "pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico",
            "triggers": [
                  {
                        "gitiles": {
                              "ref": "refs/heads/main",
                              "repo": "https://pigweed.googlesource.com/pigweed/pigweed",
                              "revision": "96f4e8746c4c4fb1575dcebb1d60fb2561680d7e"
                            },
                        "id": "https://pigweed.googlesource.com/pigweed/pigweed/+/refs/heads/main@96f4e8746c4c4fb1575dcebb1d60fb2561680d7e",
                        "title": "96f4e8746c4c4fb1575dcebb1d60fb2561680d7e",
                        "url": "https://pigweed.googlesource.com/pigweed/pigweed/+/96f4e8746c4c4fb1575dcebb1d60fb2561680d7e"
                      }
                ]
          }
    },
  "gitilesCommit": {
    "host": "pigweed.googlesource.com",
    "project": "pigweed/pigweed",
    "id": "96f4e8746c4c4fb1575dcebb1d60fb2561680d7e",
    "ref": "refs/heads/main"
  },
  "tags": [
    {
      "key": "scheduler_invocation_id",
      "value": "8859507833199109584"
    },
    {
      "key": "scheduler_job_id",
      "value": "pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico"
    },
    {
      "key": "user_agent",
      "value": "luci-scheduler"
    }
  ],
  "notify": {
    "pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
  }
}
[07:05:47.105] Scheduled build:
{
  "id": "8694077771361495313",
  "builder": {
    "project": "pigweed",
    "bucket": "pigweed.dev.ci",
    "builder": "pigweed-mac-x86-gn-arduino-pico"
  },
  "createdBy": "project:pigweed",
  "createTime": "2025-12-30T07:05:46.822441276Z",
  "updateTime": "2025-12-30T07:05:46.822441276Z",
  "status": "SCHEDULED",
  "input": {
    "gitilesCommit": {
      "host": "pigweed.googlesource.com",
      "project": "pigweed/pigweed",
      "id": "96f4e8746c4c4fb1575dcebb1d60fb2561680d7e",
      "ref": "refs/heads/main"
    }
  },
  "canary": true
}
[07:05:47.105] Task URL: https://cr-buildbucket.appspot.com/build/8694077771361495313
[07:05:47.105] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:2:0) after 9m41s
[07:05:48.085] Received PubSub notification, asking Buildbucket for the build status
[07:05:48.103] Build status: SCHEDULED
[07:15:28.150] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:2:0)
[07:15:28.199] Build status: SCHEDULED
[07:15:28.199] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:4:0) after 1m2s
[07:16:30.229] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:4:0)
[07:16:30.254] Build status: SCHEDULED
[07:16:30.254] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:5:0) after 5m54s
[07:22:24.246] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:5:0)
[07:22:24.273] Build status: SCHEDULED
[07:22:24.273] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:6:0) after 9m43s
[07:32:07.287] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:6:0)
[07:32:07.312] Build status: SCHEDULED
[07:32:07.312] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:7:0) after 9m20s
[07:41:27.327] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:7:0)
[07:41:27.353] Build status: SCHEDULED
[07:41:27.354] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:8:0) after 6m37s
[07:48:04.366] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:8:0)
[07:48:04.388] Build status: SCHEDULED
[07:48:04.389] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:9:0) after 3m14s
[07:51:18.528] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:9:0)
[07:51:18.554] Build status: SCHEDULED
[07:51:18.554] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:10:0) after 9m45s
[08:01:04.185] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:10:0)
[08:01:04.210] Build status: SCHEDULED
[08:01:04.210] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:11:0) after 4m45s
[08:05:49.402] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:11:0)
[08:05:49.451] Build status: SCHEDULED
[08:05:49.451] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:12:0) after 5m41s
[08:11:30.565] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:12:0)
[08:11:30.955] Build status: SCHEDULED
[08:11:30.955] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:13:0) after 2m20s
[08:13:51.128] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:13:0)
[08:13:51.153] Build status: SCHEDULED
[08:13:51.153] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:14:0) after 4m17s
[08:18:08.166] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:14:0)
[08:18:08.181] Build status: SCHEDULED
[08:18:08.181] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:15:0) after 3m19s
[08:21:27.766] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:15:0)
[08:21:27.789] Build status: SCHEDULED
[08:21:27.789] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:16:0) after 7m8s
[08:28:35.802] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:16:0)
[08:28:35.824] Build status: SCHEDULED
[08:28:35.824] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:17:0) after 1m42s
[08:30:18.057] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:17:0)
[08:30:18.077] Build status: SCHEDULED
[08:30:18.077] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:18:0) after 1m58s
[08:32:16.057] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:18:0)
[08:32:16.076] Build status: SCHEDULED
[08:32:16.076] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:19:0) after 6m32s
[08:38:48.110] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:19:0)
[08:38:48.126] Build status: SCHEDULED
[08:38:48.126] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:20:0) after 9m41s
[08:48:29.302] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:20:0)
[08:48:29.453] Build status: SCHEDULED
[08:48:29.453] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:21:0) after 7m31s
[08:56:00.464] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:21:0)
[08:56:00.482] Build status: SCHEDULED
[08:56:00.482] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:22:0) after 4m38s
[09:00:38.499] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:22:0)
[09:00:38.515] Build status: SCHEDULED
[09:00:38.515] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:23:0) after 9m29s
[09:10:07.888] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:23:0)
[09:10:07.941] Build status: SCHEDULED
[09:10:07.941] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:24:0) after 1m6s
[09:11:14.306] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:24:0)
[09:11:14.334] Build status: SCHEDULED
[09:11:14.334] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:25:0) after 9m8s
[09:20:22.401] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:25:0)
[09:20:22.432] Build status: SCHEDULED
[09:20:22.432] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:26:0) after 8m56s
[09:29:18.522] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:26:0)
[09:29:18.540] Build status: SCHEDULED
[09:29:18.540] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:27:0) after 3m46s
[09:33:04.527] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:27:0)
[09:33:04.596] Build status: SCHEDULED
[09:33:04.597] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:28:0) after 3m18s
[09:36:22.562] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:28:0)
[09:36:22.580] Build status: SCHEDULED
[09:36:22.580] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:29:0) after 5m6s
[09:41:28.582] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:29:0)
[09:41:28.598] Build status: SCHEDULED
[09:41:28.598] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:30:0) after 4m59s
[09:46:27.634] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:30:0)
[09:46:27.647] Build status: SCHEDULED
[09:46:27.647] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:31:0) after 4m40s
[09:51:07.662] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:31:0)
[09:51:07.727] Build status: SCHEDULED
[09:51:07.727] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:32:0) after 7m43s
[09:58:51.076] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:32:0)
[09:58:51.120] Build status: SCHEDULED
[09:58:51.120] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:33:0) after 6m39s
[10:05:30.202] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:33:0)
[10:05:30.219] Build status: SCHEDULED
[10:05:30.219] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:34:0) after 3m17s
[10:08:48.590] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:34:0)
[10:08:48.612] Build status: SCHEDULED
[10:08:48.612] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:35:0) after 3m13s
[10:12:01.728] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:35:0)
[10:12:01.755] Build status: SCHEDULED
[10:12:01.756] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:36:0) after 2m29s
[10:14:30.787] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:36:0)
[10:14:30.843] Build status: SCHEDULED
[10:14:30.843] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:37:0) after 7m11s
[10:21:41.856] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:37:0)
[10:21:41.869] Build status: SCHEDULED
[10:21:41.869] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:38:0) after 5m38s
[10:27:19.880] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:38:0)
[10:27:19.895] Build status: SCHEDULED
[10:27:19.895] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:39:0) after 2m5s
[10:29:25.409] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:39:0)
[10:29:25.438] Build status: SCHEDULED
[10:29:25.438] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:40:0) after 9m12s
[10:38:37.450] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:40:0)
[10:38:37.468] Build status: SCHEDULED
[10:38:37.469] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:41:0) after 2m37s
[10:41:14.502] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:41:0)
[10:41:14.529] Build status: SCHEDULED
[10:41:14.529] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:42:0) after 2m4s
[10:43:18.548] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:42:0)
[10:43:18.561] Build status: SCHEDULED
[10:43:18.561] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:43:0) after 1m20s
[10:44:38.628] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:43:0)
[10:44:38.649] Build status: SCHEDULED
[10:44:38.649] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:44:0) after 8m19s
[10:52:57.845] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:44:0)
[10:52:57.866] Build status: SCHEDULED
[10:52:57.866] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:45:0) after 7m37s
[11:00:34.985] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:45:0)
[11:00:35.007] Build status: SCHEDULED
[11:00:35.007] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:46:0) after 4m13s
[11:04:48.029] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:46:0)
[11:04:48.043] Build status: SCHEDULED
[11:04:48.043] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:47:0) after 4m11s
[11:08:59.026] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:47:0)
[11:08:59.056] Build status: SCHEDULED
[11:08:59.056] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:48:0) after 9m31s
[11:18:30.139] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:48:0)
[11:18:30.165] Build status: SCHEDULED
[11:18:30.165] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:49:0) after 1m16s
[11:19:46.431] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:49:0)
[11:19:46.509] Build status: SCHEDULED
[11:19:46.509] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:50:0) after 7m49s
[11:27:35.524] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:50:0)
[11:27:35.547] Build status: SCHEDULED
[11:27:35.547] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:51:0) after 9m29s
[11:37:04.658] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:51:0)
[11:37:04.672] Build status: SCHEDULED
[11:37:04.672] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:52:0) after 4m54s
[11:41:58.696] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:52:0)
[11:41:58.714] Build status: SCHEDULED
[11:41:58.714] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:53:0) after 4m9s
[11:46:07.829] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:53:0)
[11:46:07.878] Build status: SCHEDULED
[11:46:07.878] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:54:0) after 5m10s
[11:51:17.912] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:54:0)
[11:51:17.926] Build status: SCHEDULED
[11:51:17.926] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:55:0) after 6m9s
[11:57:27.072] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:55:0)
[11:57:27.100] Build status: SCHEDULED
[11:57:27.100] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:56:0) after 6m41s
[12:04:08.119] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:56:0)
[12:04:08.137] Build status: SCHEDULED
[12:04:08.137] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:57:0) after 7m20s
[12:11:28.213] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:57:0)
[12:11:28.227] Build status: SCHEDULED
[12:11:28.227] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:58:0) after 5m29s
[12:16:57.352] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:58:0)
[12:16:57.373] Build status: SCHEDULED
[12:16:57.373] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:59:0) after 3m10s
[12:20:07.387] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:59:0)
[12:20:07.405] Build status: SCHEDULED
[12:20:07.405] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:60:0) after 2m55s
[12:23:02.426] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:60:0)
[12:23:02.444] Build status: SCHEDULED
[12:23:02.444] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:61:0) after 3m0s
[12:26:02.458] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:61:0)
[12:26:02.532] Build status: SCHEDULED
[12:26:02.532] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:62:0) after 1m25s
[12:27:27.601] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:62:0)
[12:27:27.616] Build status: SCHEDULED
[12:27:27.616] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:63:0) after 7m42s
[12:35:09.732] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:63:0)
[12:35:09.754] Build status: SCHEDULED
[12:35:09.754] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:64:0) after 5m35s
[12:40:44.770] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:64:0)
[12:40:44.801] Build status: SCHEDULED
[12:40:44.801] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:65:0) after 9m20s
[12:50:04.966] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:65:0)
[12:50:04.979] Build status: SCHEDULED
[12:50:04.979] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:66:0) after 5m10s
[12:55:15.039] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:66:0)
[12:55:15.099] Build status: SCHEDULED
[12:55:15.099] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:67:0) after 9m39s
[13:04:54.691] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:67:0)
[13:04:54.709] Build status: SCHEDULED
[13:04:54.709] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:68:0) after 7m22s
[13:12:16.957] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:68:0)
[13:12:17.004] Build status: SCHEDULED
[13:12:17.004] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:69:0) after 9m51s
[13:22:08.024] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:69:0)
[13:22:08.045] Build status: SCHEDULED
[13:22:08.045] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:70:0) after 3m40s
[13:25:48.060] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:70:0)
[13:25:48.086] Build status: SCHEDULED
[13:25:48.086] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:71:0) after 4m0s
[13:29:48.099] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:71:0)
[13:29:48.114] Build status: SCHEDULED
[13:29:48.114] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:72:0) after 8m3s
[13:37:51.610] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:72:0)
[13:37:51.809] Build status: SCHEDULED
[13:37:51.809] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:73:0) after 5m21s
[13:43:12.821] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:73:0)
[13:43:12.854] Build status: SCHEDULED
[13:43:12.854] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:74:0) after 8m0s
[13:51:12.883] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:74:0)
[13:51:12.914] Build status: SCHEDULED
[13:51:12.914] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:75:0) after 6m27s
[13:57:40.363] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:75:0)
[13:57:40.379] Build status: SCHEDULED
[13:57:40.379] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:76:0) after 8m22s
[14:06:02.396] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:76:0)
[14:06:02.416] Build status: SCHEDULED
[14:06:02.416] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:77:0) after 7m38s
[14:13:40.425] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:77:0)
[14:13:40.490] Build status: SCHEDULED
[14:13:40.490] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:78:0) after 5m11s
[14:18:51.550] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:78:0)
[14:18:51.578] Build status: SCHEDULED
[14:18:51.578] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:79:0) after 7m2s
[14:25:53.615] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:79:0)
[14:25:53.634] Build status: SCHEDULED
[14:25:53.634] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:80:0) after 4m51s
[14:30:44.651] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:80:0)
[14:30:44.666] Build status: SCHEDULED
[14:30:44.666] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:81:0) after 2m39s
[14:33:23.891] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:81:0)
[14:33:23.913] Build status: SCHEDULED
[14:33:23.913] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:82:0) after 6m27s
[14:34:49.424] Received PubSub notification, asking Buildbucket for the build status
[14:34:49.439] Build status: STARTED
[14:39:51.313] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:82:0)
[14:39:51.328] Build status: STARTED
[14:39:51.328] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:84:0) after 7m42s
[14:47:34.402] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:84:0)
[14:47:34.435] Build status: STARTED
[14:47:34.435] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:85:0) after 4m32s
[14:52:06.451] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:85:0)
[14:52:06.473] Build status: STARTED
[14:52:06.473] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:86:0) after 4m16s
[14:56:22.491] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:86:0)
[14:56:22.506] Build status: STARTED
[14:56:22.506] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-x86-gn-arduino-pico:8859507833199109584:87:0) after 7m16s
[14:58:50.510] Received PubSub notification, asking Buildbucket for the build status
[14:58:50.544] Build:
{
  "id": "8694077771361495313",
  "builder": {
    "project": "pigweed",
    "bucket": "pigweed.dev.ci",
    "builder": "pigweed-mac-x86-gn-arduino-pico"
  },
  "createdBy": "project:pigweed",
  "createTime": "2025-12-30T07:05:46.822441276Z",
  "startTime": "2025-12-30T14:34:49.255582102Z",
  "endTime": "2025-12-30T14:58:50.144092485Z",
  "updateTime": "2025-12-30T14:58:50.144092485Z",
  "status": "FAILURE",
  "input": {
    "gitilesCommit": {
      "host": "pigweed.googlesource.com",
      "project": "pigweed/pigweed",
      "id": "96f4e8746c4c4fb1575dcebb1d60fb2561680d7e",
      "ref": "refs/heads/main"
    }
  },
  "canary": true
}
[14:58:50.544] Invocation finished in 7h53m4.858009433s with status FAILED