1. All projects
  2. pigweed
  3. pigweed.ci-pigweed-mac-arm-bazel-build-host-clang
  4. 8918452318865921200
Status: FAILED
Triggered by: -
Duration: 6 hours
Actions:

Definition (rev cfd2f13d570877af640615f742b9b2cae2bca0f8) 

buildbucket: <
  server: "cr-buildbucket.appspot.com"
  bucket: "pigweed.ci"
  builder: "pigweed-mac-arm-bazel-build-host-clang"
>

Incoming triggers

Incoming properties

{
  "branch": "refs/heads/main",
  "repository": "https://pigweed.googlesource.com/pigweed/pigweed",
  "revision": "bce7ebb1cb9638e249591a27c68927c15e236193"
}

Incoming tags

  • buildset:commit/gitiles/pigweed.googlesource.com/pigweed/pigweed/+/bce7ebb1cb9638e249591a27c68927c15e236193
  • gitiles_ref:refs/heads/main

Debug log (UTC)

[16:08:23.619] New invocation is queued and will start shortly
[16:08:24.974] Starting the invocation (attempt 1)
[16:08:25.005] Popped buildset tag "buildset:commit/gitiles/pigweed.googlesource.com/pigweed/pigweed/+/bce7ebb1cb9638e249591a27c68927c15e236193"
[16:08:25.005] Popped gitiles commit info from properties and tags
[16:08:25.005] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[16:08:25.007] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[16:08:25.007] Buildbucket request:
{
  "requestId": "8918452318865921200",
  "builder": {
    "project": "pigweed",
    "bucket": "pigweed.ci",
    "builder": "pigweed-mac-arm-bazel-build-host-clang"
  },
  "properties": {
      "$recipe_engine/scheduler": {
            "hostname": "luci-scheduler.appspot.com",
            "invocation": "8918452318865921200",
            "job": "pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang",
            "triggers": [
                  {
                        "gitiles": {
                              "ref": "refs/heads/main",
                              "repo": "https://pigweed.googlesource.com/pigweed/pigweed",
                              "revision": "bce7ebb1cb9638e249591a27c68927c15e236193"
                            },
                        "id": "https://pigweed.googlesource.com/pigweed/pigweed/+/refs/heads/main@bce7ebb1cb9638e249591a27c68927c15e236193",
                        "title": "bce7ebb1cb9638e249591a27c68927c15e236193",
                        "url": "https://pigweed.googlesource.com/pigweed/pigweed/+/bce7ebb1cb9638e249591a27c68927c15e236193"
                      }
                ]
          }
    },
  "gitilesCommit": {
    "host": "pigweed.googlesource.com",
    "project": "pigweed/pigweed",
    "id": "bce7ebb1cb9638e249591a27c68927c15e236193",
    "ref": "refs/heads/main"
  },
  "tags": [
    {
      "key": "scheduler_invocation_id",
      "value": "8918452318865921200"
    },
    {
      "key": "scheduler_job_id",
      "value": "pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang"
    },
    {
      "key": "user_agent",
      "value": "luci-scheduler"
    }
  ],
  "notify": {
    "pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
  }
}
[16:08:25.940] Scheduled build:
{
  "id": "8753022256672815649",
  "builder": {
    "project": "pigweed",
    "bucket": "pigweed.ci",
    "builder": "pigweed-mac-arm-bazel-build-host-clang"
  },
  "createdBy": "project:pigweed",
  "createTime": "2024-03-19T16:08:25.086921033Z",
  "updateTime": "2024-03-19T16:08:25.086921033Z",
  "status": "SCHEDULED",
  "input": {
    "gitilesCommit": {
      "host": "pigweed.googlesource.com",
      "project": "pigweed/pigweed",
      "id": "bce7ebb1cb9638e249591a27c68927c15e236193",
      "ref": "refs/heads/main"
    }
  }
}
[16:08:25.940] Task URL: https://cr-buildbucket.appspot.com/build/8753022256672815649
[16:08:25.940] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:2:0) after 2m4s
[16:08:26.780] Received PubSub notification, asking Buildbucket for the build status
[16:08:26.815] Build status: SCHEDULED
[16:10:30.159] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:2:0)
[16:10:30.184] Build status: SCHEDULED
[16:10:30.184] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:4:0) after 1m3s
[16:11:33.261] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:4:0)
[16:11:33.337] Build status: SCHEDULED
[16:11:33.337] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:5:0) after 2m52s
[16:14:25.388] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:5:0)
[16:14:25.455] Build status: SCHEDULED
[16:14:25.455] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:6:0) after 8m16s
[16:22:41.512] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:6:0)
[16:22:41.538] Build status: SCHEDULED
[16:22:41.538] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:7:0) after 5m15s
[16:27:56.659] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:7:0)
[16:27:56.697] Build status: SCHEDULED
[16:27:56.697] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:8:0) after 6m41s
[16:34:37.723] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:8:0)
[16:34:37.746] Build status: SCHEDULED
[16:34:37.746] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:9:0) after 3m52s
[16:38:29.772] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:9:0)
[16:38:29.798] Build status: SCHEDULED
[16:38:29.798] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:10:0) after 8m20s
[16:46:49.940] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:10:0)
[16:46:50.015] Build status: SCHEDULED
[16:46:50.015] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:11:0) after 9m29s
[16:56:19.037] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:11:0)
[16:56:19.055] Build status: SCHEDULED
[16:56:19.055] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:12:0) after 1m55s
[16:58:14.110] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:12:0)
[16:58:14.165] Build status: SCHEDULED
[16:58:14.165] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:13:0) after 4m37s
[17:02:51.179] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:13:0)
[17:02:51.242] Build status: SCHEDULED
[17:02:51.242] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:14:0) after 2m30s
[17:05:21.376] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:14:0)
[17:05:21.396] Build status: SCHEDULED
[17:05:21.396] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:15:0) after 8m2s
[17:13:23.413] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:15:0)
[17:13:23.500] Build status: SCHEDULED
[17:13:23.500] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:16:0) after 8m18s
[17:21:41.875] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:16:0)
[17:21:41.904] Build status: SCHEDULED
[17:21:41.904] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:17:0) after 5m15s
[17:26:56.958] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:17:0)
[17:26:56.979] Build status: SCHEDULED
[17:26:56.979] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:18:0) after 6m34s
[17:33:31.136] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:18:0)
[17:33:31.161] Build status: SCHEDULED
[17:33:31.161] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:19:0) after 7m54s
[17:41:25.212] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:19:0)
[17:41:25.261] Build status: SCHEDULED
[17:41:25.261] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:20:0) after 9m56s
[17:51:21.404] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:20:0)
[17:51:21.421] Build status: SCHEDULED
[17:51:21.421] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:21:0) after 4m19s
[17:55:40.457] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:21:0)
[17:55:40.514] Build status: SCHEDULED
[17:55:40.514] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:22:0) after 4m53s
[18:00:33.542] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:22:0)
[18:00:33.569] Build status: SCHEDULED
[18:00:33.569] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:23:0) after 3m24s
[18:03:57.591] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:23:0)
[18:03:57.619] Build status: SCHEDULED
[18:03:57.619] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:24:0) after 5m13s
[18:09:10.655] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:24:0)
[18:09:10.676] Build status: SCHEDULED
[18:09:10.676] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:25:0) after 2m45s
[18:11:55.643] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:25:0)
[18:11:55.666] Build status: SCHEDULED
[18:11:55.666] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:26:0) after 6m34s
[18:18:29.656] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:26:0)
[18:18:29.679] Build status: SCHEDULED
[18:18:29.679] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:27:0) after 4m30s
[18:22:59.676] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:27:0)
[18:22:59.751] Build status: SCHEDULED
[18:22:59.751] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:28:0) after 1m29s
[18:24:28.778] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:28:0)
[18:24:28.911] Build status: SCHEDULED
[18:24:28.911] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:29:0) after 3m45s
[18:28:13.986] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:29:0)
[18:28:14.025] Build status: SCHEDULED
[18:28:14.025] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:30:0) after 4m43s
[18:32:57.106] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:30:0)
[18:32:57.137] Build status: SCHEDULED
[18:32:57.137] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:31:0) after 5m10s
[18:38:07.182] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:31:0)
[18:38:07.339] Build status: SCHEDULED
[18:38:07.339] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:32:0) after 3m22s
[18:41:29.558] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:32:0)
[18:41:29.582] Build status: SCHEDULED
[18:41:29.582] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:33:0) after 6m20s
[18:47:49.612] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:33:0)
[18:47:49.660] Build status: SCHEDULED
[18:47:49.660] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:34:0) after 4m35s
[18:52:24.699] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:34:0)
[18:52:24.730] Build status: SCHEDULED
[18:52:24.730] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:35:0) after 7m34s
[18:59:58.747] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:35:0)
[18:59:58.771] Build status: SCHEDULED
[18:59:58.771] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:36:0) after 1m4s
[19:01:02.813] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:36:0)
[19:01:02.884] Build status: SCHEDULED
[19:01:02.884] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:37:0) after 5m0s
[19:06:02.908] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:37:0)
[19:06:03.047] Build status: SCHEDULED
[19:06:03.047] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:38:0) after 6m40s
[19:12:43.080] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:38:0)
[19:12:43.097] Build status: SCHEDULED
[19:12:43.097] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:39:0) after 3m24s
[19:16:07.235] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:39:0)
[19:16:07.287] Build status: SCHEDULED
[19:16:07.287] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:40:0) after 1m17s
[19:17:24.353] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:40:0)
[19:17:24.404] Build status: SCHEDULED
[19:17:24.404] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:41:0) after 2m2s
[19:19:26.528] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:41:0)
[19:19:26.554] Build status: SCHEDULED
[19:19:26.554] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:42:0) after 8m57s
[19:28:23.604] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:42:0)
[19:28:23.629] Build status: SCHEDULED
[19:28:23.629] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:43:0) after 1m29s
[19:29:52.656] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:43:0)
[19:29:52.675] Build status: SCHEDULED
[19:29:52.675] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:44:0) after 2m45s
[19:32:37.715] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:44:0)
[19:32:37.745] Build status: SCHEDULED
[19:32:37.745] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:45:0) after 2m14s
[19:34:51.821] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:45:0)
[19:34:51.884] Build status: SCHEDULED
[19:34:51.884] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:46:0) after 6m52s
[19:41:43.976] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:46:0)
[19:41:44.107] Build status: SCHEDULED
[19:41:44.107] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:47:0) after 7m32s
[19:49:16.236] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:47:0)
[19:49:16.265] Build status: SCHEDULED
[19:49:16.265] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:48:0) after 2m3s
[19:51:19.293] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:48:0)
[19:51:19.325] Build status: SCHEDULED
[19:51:19.326] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:49:0) after 3m34s
[19:54:53.379] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:49:0)
[19:54:53.489] Build status: SCHEDULED
[19:54:53.489] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:50:0) after 7m39s
[20:02:32.487] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:50:0)
[20:02:32.507] Build status: SCHEDULED
[20:02:32.507] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:51:0) after 1m46s
[20:04:18.524] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:51:0)
[20:04:18.551] Build status: SCHEDULED
[20:04:18.551] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:52:0) after 2m42s
[20:07:00.631] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:52:0)
[20:07:00.670] Build status: SCHEDULED
[20:07:00.671] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:53:0) after 9m15s
[20:16:15.744] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:53:0)
[20:16:15.764] Build status: SCHEDULED
[20:16:15.764] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:54:0) after 6m13s
[20:22:28.797] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:54:0)
[20:22:28.851] Build status: SCHEDULED
[20:22:28.851] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:55:0) after 6m16s
[20:28:44.908] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:55:0)
[20:28:44.950] Build status: SCHEDULED
[20:28:44.950] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:56:0) after 4m48s
[20:33:32.954] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:56:0)
[20:33:32.993] Build status: SCHEDULED
[20:33:32.993] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:57:0) after 5m27s
[20:39:00.029] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:57:0)
[20:39:00.129] Build status: SCHEDULED
[20:39:00.129] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:58:0) after 5m40s
[20:44:40.211] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:58:0)
[20:44:40.239] Build status: SCHEDULED
[20:44:40.241] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:59:0) after 1m3s
[20:45:43.334] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:59:0)
[20:45:43.359] Build status: SCHEDULED
[20:45:43.359] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:60:0) after 6m41s
[20:52:24.384] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:60:0)
[20:52:24.491] Build status: SCHEDULED
[20:52:24.491] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:61:0) after 9m56s
[21:02:20.531] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:61:0)
[21:02:20.698] Build status: SCHEDULED
[21:02:20.698] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:62:0) after 5m9s
[21:07:29.768] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:62:0)
[21:07:29.796] Build status: SCHEDULED
[21:07:29.796] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:63:0) after 3m40s
[21:11:09.826] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:63:0)
[21:11:09.862] Build status: SCHEDULED
[21:11:09.862] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:64:0) after 8m30s
[21:19:39.902] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:64:0)
[21:19:39.929] Build status: SCHEDULED
[21:19:39.929] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:65:0) after 1m6s
[21:20:45.962] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:65:0)
[21:20:45.983] Build status: SCHEDULED
[21:20:45.983] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:66:0) after 8m25s
[21:29:11.107] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:66:0)
[21:29:11.137] Build status: SCHEDULED
[21:29:11.137] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:67:0) after 3m10s
[21:32:21.175] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:67:0)
[21:32:21.197] Build status: SCHEDULED
[21:32:21.197] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:68:0) after 1m56s
[21:34:17.282] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:68:0)
[21:34:17.305] Build status: SCHEDULED
[21:34:17.305] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:69:0) after 8m32s
[21:42:49.321] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:69:0)
[21:42:49.337] Build status: SCHEDULED
[21:42:49.337] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:70:0) after 6m54s
[21:49:43.327] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:70:0)
[21:49:43.350] Build status: SCHEDULED
[21:49:43.350] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:71:0) after 2m24s
[21:52:07.427] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:71:0)
[21:52:07.450] Build status: SCHEDULED
[21:52:07.450] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:72:0) after 1m40s
[21:53:47.508] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:72:0)
[21:53:47.525] Build status: SCHEDULED
[21:53:47.525] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:73:0) after 5m45s
[21:59:32.512] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:73:0)
[21:59:32.640] Build status: SCHEDULED
[21:59:32.640] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:74:0) after 3m41s
[22:03:13.666] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:74:0)
[22:03:13.684] Build status: SCHEDULED
[22:03:13.684] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:75:0) after 2m54s
[22:06:07.752] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:75:0)
[22:06:07.831] Build status: SCHEDULED
[22:06:07.831] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:76:0) after 2m58s
[22:09:05.857] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:76:0)
[22:09:05.881] Build status: SCHEDULED
[22:09:05.881] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:77:0) after 5m6s
[22:14:11.905] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:77:0)
[22:14:11.922] Build status: SCHEDULED
[22:14:11.922] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:78:0) after 6m30s
[22:20:42.005] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:78:0)
[22:20:42.050] Build status: SCHEDULED
[22:20:42.050] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:79:0) after 9m22s
[22:30:04.083] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:79:0)
[22:30:04.103] Build status: SCHEDULED
[22:30:04.103] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:80:0) after 9m15s
[22:39:19.220] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:80:0)
[22:39:19.300] Build status: SCHEDULED
[22:39:19.300] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:81:0) after 3m17s
[22:42:36.396] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:81:0)
[22:42:36.434] Build status: SCHEDULED
[22:42:36.434] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:82:0) after 8m9s
[22:50:45.506] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:82:0)
[22:50:45.528] Build status: SCHEDULED
[22:50:45.528] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:83:0) after 9m44s
[22:59:00.915] Received PubSub notification, asking Buildbucket for the build status
[22:59:00.948] Build status: STARTED
[23:00:29.554] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:83:0)
[23:00:29.655] Build status: STARTED
[23:00:29.656] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:85:0) after 1m0s
[23:01:29.672] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:85:0)
[23:01:29.742] Build status: STARTED
[23:01:29.742] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.ci-pigweed-mac-arm-bazel-build-host-clang:8918452318865921200:86:0) after 2m1s
[23:02:26.005] Received PubSub notification, asking Buildbucket for the build status
[23:02:26.032] Build:
{
  "id": "8753022256672815649",
  "builder": {
    "project": "pigweed",
    "bucket": "pigweed.ci",
    "builder": "pigweed-mac-arm-bazel-build-host-clang"
  },
  "createdBy": "project:pigweed",
  "createTime": "2024-03-19T16:08:25.086921033Z",
  "startTime": "2024-03-19T22:58:57.385185Z",
  "endTime": "2024-03-19T23:02:25.299958Z",
  "updateTime": "2024-03-19T23:02:25.299958Z",
  "status": "FAILURE",
  "input": {
    "gitilesCommit": {
      "host": "pigweed.googlesource.com",
      "project": "pigweed/pigweed",
      "id": "bce7ebb1cb9638e249591a27c68927c15e236193",
      "ref": "refs/heads/main"
    }
  }
}
[23:02:26.032] Invocation finished in 6h54m2.421423336s with status FAILED