1. All projects
  2. pigweed
  3. pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan
  4. 8857499079576351168
Status: FAILED
Triggered by: -
Duration: 3 hours
Actions:

Definition (rev ed331b29843b850a4bc37ad64e7e3a240af6f486) 

buildbucket: <
  server: "cr-buildbucket.appspot.com"
  bucket: "pigweed.dev.ci"
  builder: "pigweed-mac-arm-bazel-sanitizers-tsan"
>

Incoming triggers

Incoming properties

{
  "branch": "refs/heads/main",
  "repository": "https://pigweed.googlesource.com/pigweed/pigweed",
  "revision": "542624cf7148f679d147df84f7ae938ef1c5b658"
}

Incoming tags

  • buildset:commit/gitiles/pigweed.googlesource.com/pigweed/pigweed/+/542624cf7148f679d147df84f7ae938ef1c5b658
  • gitiles_ref:refs/heads/main

Debug log (UTC)

[11:14:02.428] New invocation is queued and will start shortly
[11:14:04.823] Starting the invocation (attempt 1)
[11:14:04.844] Popped buildset tag "buildset:commit/gitiles/pigweed.googlesource.com/pigweed/pigweed/+/542624cf7148f679d147df84f7ae938ef1c5b658"
[11:14:04.844] Popped gitiles commit info from properties and tags
[11:14:04.844] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[11:14:04.844] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[11:14:04.844] Buildbucket request:
{
  "requestId": "8857499079576351168",
  "builder": {
    "project": "pigweed",
    "bucket": "pigweed.dev.ci",
    "builder": "pigweed-mac-arm-bazel-sanitizers-tsan"
  },
  "properties": {
      "$recipe_engine/scheduler": {
            "hostname": "luci-scheduler.appspot.com",
            "invocation": "8857499079576351168",
            "job": "pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan",
            "triggers": [
                  {
                        "gitiles": {
                              "ref": "refs/heads/main",
                              "repo": "https://pigweed.googlesource.com/pigweed/pigweed",
                              "revision": "542624cf7148f679d147df84f7ae938ef1c5b658"
                            },
                        "id": "https://pigweed.googlesource.com/pigweed/pigweed/+/refs/heads/main@542624cf7148f679d147df84f7ae938ef1c5b658",
                        "title": "542624cf7148f679d147df84f7ae938ef1c5b658",
                        "url": "https://pigweed.googlesource.com/pigweed/pigweed/+/542624cf7148f679d147df84f7ae938ef1c5b658"
                      }
                ]
          }
    },
  "gitilesCommit": {
    "host": "pigweed.googlesource.com",
    "project": "pigweed/pigweed",
    "id": "542624cf7148f679d147df84f7ae938ef1c5b658",
    "ref": "refs/heads/main"
  },
  "tags": [
    {
      "key": "scheduler_invocation_id",
      "value": "8857499079576351168"
    },
    {
      "key": "scheduler_job_id",
      "value": "pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan"
    },
    {
      "key": "user_agent",
      "value": "luci-scheduler"
    }
  ],
  "notify": {
    "pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
  }
}
[11:14:05.240] Scheduled build:
{
  "id": "8692069016265932289",
  "builder": {
    "project": "pigweed",
    "bucket": "pigweed.dev.ci",
    "builder": "pigweed-mac-arm-bazel-sanitizers-tsan"
  },
  "createdBy": "project:pigweed",
  "createTime": "2026-01-21T11:14:04.964577633Z",
  "updateTime": "2026-01-21T11:14:04.964577633Z",
  "status": "SCHEDULED",
  "input": {
    "gitilesCommit": {
      "host": "pigweed.googlesource.com",
      "project": "pigweed/pigweed",
      "id": "542624cf7148f679d147df84f7ae938ef1c5b658",
      "ref": "refs/heads/main"
    }
  }
}
[11:14:05.240] Task URL: https://cr-buildbucket.appspot.com/build/8692069016265932289
[11:14:05.240] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:2:0) after 3m43s
[11:14:05.315] Received PubSub notification, asking Buildbucket for the build status
[11:14:05.350] Build status: SCHEDULED
[11:17:48.259] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:2:0)
[11:17:48.293] Build status: SCHEDULED
[11:17:48.293] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:4:0) after 8m45s
[11:26:33.309] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:4:0)
[11:26:33.325] Build status: SCHEDULED
[11:26:33.325] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:5:0) after 6m33s
[11:33:06.369] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:5:0)
[11:33:06.395] Build status: SCHEDULED
[11:33:06.395] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:6:0) after 6m36s
[11:39:42.410] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:6:0)
[11:39:42.426] Build status: SCHEDULED
[11:39:42.426] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:7:0) after 3m54s
[11:43:36.441] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:7:0)
[11:43:36.460] Build status: SCHEDULED
[11:43:36.460] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:8:0) after 4m49s
[11:48:25.474] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:8:0)
[11:48:25.489] Build status: SCHEDULED
[11:48:25.489] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:9:0) after 7m44s
[11:56:09.541] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:9:0)
[11:56:09.555] Build status: SCHEDULED
[11:56:09.555] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:10:0) after 1m45s
[11:57:54.566] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:10:0)
[11:57:54.582] Build status: SCHEDULED
[11:57:54.582] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:11:0) after 6m6s
[12:04:01.215] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:11:0)
[12:04:01.243] Build status: SCHEDULED
[12:04:01.243] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:12:0) after 4m31s
[12:08:32.255] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:12:0)
[12:08:32.273] Build status: SCHEDULED
[12:08:32.273] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:13:0) after 8m14s
[12:16:46.285] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:13:0)
[12:16:46.298] Build status: SCHEDULED
[12:16:46.298] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:14:0) after 7m19s
[12:24:05.286] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:14:0)
[12:24:05.320] Build status: SCHEDULED
[12:24:05.320] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:15:0) after 6m12s
[12:30:17.334] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:15:0)
[12:30:17.348] Build status: SCHEDULED
[12:30:17.349] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:16:0) after 8m26s
[12:38:43.363] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:16:0)
[12:38:43.380] Build status: SCHEDULED
[12:38:43.380] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:17:0) after 3m40s
[12:42:23.525] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:17:0)
[12:42:23.558] Build status: SCHEDULED
[12:42:23.558] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:18:0) after 7m43s
[12:50:06.600] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:18:0)
[12:50:06.692] Build status: SCHEDULED
[12:50:06.692] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:19:0) after 8m15s
[12:58:21.756] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:19:0)
[12:58:21.772] Build status: SCHEDULED
[12:58:21.772] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:20:0) after 9m49s
[13:08:10.787] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:20:0)
[13:08:10.805] Build status: SCHEDULED
[13:08:10.805] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:21:0) after 9m56s
[13:18:06.856] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:21:0)
[13:18:06.891] Build status: SCHEDULED
[13:18:06.891] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:22:0) after 6m50s
[13:24:56.945] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:22:0)
[13:24:56.960] Build status: SCHEDULED
[13:24:56.960] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:23:0) after 8m43s
[13:33:40.143] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:23:0)
[13:33:40.158] Build status: SCHEDULED
[13:33:40.159] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:24:0) after 7m14s
[13:40:54.218] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:24:0)
[13:40:54.235] Build status: SCHEDULED
[13:40:54.235] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:25:0) after 3m57s
[13:44:51.238] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:25:0)
[13:44:51.258] Build status: SCHEDULED
[13:44:51.258] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:26:0) after 1m48s
[13:46:39.270] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:26:0)
[13:46:39.288] Build status: SCHEDULED
[13:46:39.288] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:27:0) after 5m23s
[13:52:02.301] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:27:0)
[13:52:02.315] Build status: SCHEDULED
[13:52:02.315] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:28:0) after 1m25s
[13:53:27.305] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:28:0)
[13:53:27.322] Build status: SCHEDULED
[13:53:27.322] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:29:0) after 1m20s
[13:54:47.331] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:29:0)
[13:54:47.347] Build status: SCHEDULED
[13:54:47.347] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:30:0) after 1m42s
[13:56:29.379] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:30:0)
[13:56:29.425] Build status: SCHEDULED
[13:56:29.425] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:31:0) after 7m51s
[14:04:20.595] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:31:0)
[14:04:20.699] Build status: SCHEDULED
[14:04:20.699] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:32:0) after 1m50s
[14:06:11.262] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:32:0)
[14:06:11.285] Build status: SCHEDULED
[14:06:11.285] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:33:0) after 5m21s
[14:11:32.421] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:33:0)
[14:11:32.453] Build status: SCHEDULED
[14:11:32.453] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:34:0) after 5m45s
[14:17:17.585] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:34:0)
[14:17:17.663] Build status: SCHEDULED
[14:17:17.663] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:35:0) after 6m42s
[14:23:59.819] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:35:0)
[14:23:59.893] Build status: SCHEDULED
[14:23:59.893] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:36:0) after 9m58s
[14:33:57.888] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:36:0)
[14:33:57.905] Build status: SCHEDULED
[14:33:57.905] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:37:0) after 8m39s
[14:42:36.926] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:37:0)
[14:42:36.944] Build status: SCHEDULED
[14:42:36.944] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:38:0) after 9m42s
[14:52:19.006] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:38:0)
[14:52:19.025] Build status: SCHEDULED
[14:52:19.026] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:39:0) after 1m42s
[14:54:01.069] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:39:0)
[14:54:01.196] Build status: SCHEDULED
[14:54:01.196] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:40:0) after 6m42s
[15:00:43.303] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:40:0)
[15:00:43.317] Build status: SCHEDULED
[15:00:43.317] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:41:0) after 1m25s
[15:02:08.406] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:41:0)
[15:02:08.428] Build status: SCHEDULED
[15:02:08.428] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:42:0) after 2m37s
[15:03:09.350] Received PubSub notification, asking Buildbucket for the build status
[15:03:09.380] Build status: STARTED
[15:04:45.441] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:42:0)
[15:04:45.486] Build status: STARTED
[15:04:45.486] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-sanitizers-tsan:8857499079576351168:44:0) after 6m24s
[15:07:11.598] Received PubSub notification, asking Buildbucket for the build status
[15:07:11.612] Build:
{
  "id": "8692069016265932289",
  "builder": {
    "project": "pigweed",
    "bucket": "pigweed.dev.ci",
    "builder": "pigweed-mac-arm-bazel-sanitizers-tsan"
  },
  "createdBy": "project:pigweed",
  "createTime": "2026-01-21T11:14:04.964577633Z",
  "startTime": "2026-01-21T15:03:09.075642934Z",
  "endTime": "2026-01-21T15:07:11.347684860Z",
  "updateTime": "2026-01-21T15:07:11.347684860Z",
  "status": "FAILURE",
  "input": {
    "gitilesCommit": {
      "host": "pigweed.googlesource.com",
      "project": "pigweed/pigweed",
      "id": "542624cf7148f679d147df84f7ae938ef1c5b658",
      "ref": "refs/heads/main"
    }
  }
}
[15:07:11.612] Invocation finished in 3h53m9.188013562s with status FAILED