1. All projects
  2. pigweed
  3. pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan
  4. 8880491544991691440
Status: FAILED
Triggered by: -
Duration: 4 hours
Actions:

Definition (rev d2b949be221fc8dd3acbfdb77921a85f7b1b8e9d) 

buildbucket: <
  server: "cr-buildbucket.appspot.com"
  bucket: "pigweed.dev.ci"
  builder: "pigweed-mac-arm-bazel-san-tsan"
>

Incoming triggers

Incoming properties

{
  "branch": "refs/heads/main",
  "repository": "https://pigweed.googlesource.com/pigweed/pigweed",
  "revision": "d99edbe1afc68631f84266c2bbc6b4e833a1f392"
}

Incoming tags

  • buildset:commit/gitiles/pigweed.googlesource.com/pigweed/pigweed/+/d99edbe1afc68631f84266c2bbc6b4e833a1f392
  • gitiles_ref:refs/heads/main

Debug log (UTC)

[16:18:38.696] New invocation is queued and will start shortly
[16:18:40.264] Starting the invocation (attempt 1)
[16:18:40.286] Popped buildset tag "buildset:commit/gitiles/pigweed.googlesource.com/pigweed/pigweed/+/d99edbe1afc68631f84266c2bbc6b4e833a1f392"
[16:18:40.286] Popped gitiles commit info from properties and tags
[16:18:40.286] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[16:18:40.286] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[16:18:40.286] Buildbucket request:
{
  "requestId": "8880491544991691440",
  "builder": {
    "project": "pigweed",
    "bucket": "pigweed.dev.ci",
    "builder": "pigweed-mac-arm-bazel-san-tsan"
  },
  "properties": {
      "$recipe_engine/scheduler": {
            "hostname": "luci-scheduler.appspot.com",
            "invocation": "8880491544991691440",
            "job": "pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan",
            "triggers": [
                  {
                        "gitiles": {
                              "ref": "refs/heads/main",
                              "repo": "https://pigweed.googlesource.com/pigweed/pigweed",
                              "revision": "d99edbe1afc68631f84266c2bbc6b4e833a1f392"
                            },
                        "id": "https://pigweed.googlesource.com/pigweed/pigweed/+/refs/heads/main@d99edbe1afc68631f84266c2bbc6b4e833a1f392",
                        "title": "d99edbe1afc68631f84266c2bbc6b4e833a1f392",
                        "url": "https://pigweed.googlesource.com/pigweed/pigweed/+/d99edbe1afc68631f84266c2bbc6b4e833a1f392"
                      }
                ]
          }
    },
  "gitilesCommit": {
    "host": "pigweed.googlesource.com",
    "project": "pigweed/pigweed",
    "id": "d99edbe1afc68631f84266c2bbc6b4e833a1f392",
    "ref": "refs/heads/main"
  },
  "tags": [
    {
      "key": "scheduler_invocation_id",
      "value": "8880491544991691440"
    },
    {
      "key": "scheduler_job_id",
      "value": "pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan"
    },
    {
      "key": "user_agent",
      "value": "luci-scheduler"
    }
  ],
  "notify": {
    "pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
  }
}
[16:18:40.709] Scheduled build:
{
  "id": "8715061482596591585",
  "builder": {
    "project": "pigweed",
    "bucket": "pigweed.dev.ci",
    "builder": "pigweed-mac-arm-bazel-san-tsan"
  },
  "createdBy": "project:pigweed",
  "createTime": "2025-05-12T16:18:40.354393707Z",
  "updateTime": "2025-05-12T16:18:40.354393707Z",
  "status": "SCHEDULED",
  "input": {
    "gitilesCommit": {
      "host": "pigweed.googlesource.com",
      "project": "pigweed/pigweed",
      "id": "d99edbe1afc68631f84266c2bbc6b4e833a1f392",
      "ref": "refs/heads/main"
    }
  }
}
[16:18:40.709] Task URL: https://cr-buildbucket.appspot.com/build/8715061482596591585
[16:18:40.709] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:2:0) after 7m21s
[16:18:40.902] Received PubSub notification, asking Buildbucket for the build status
[16:18:40.927] Build status: SCHEDULED
[16:26:01.716] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:2:0)
[16:26:01.740] Build status: SCHEDULED
[16:26:01.740] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:4:0) after 3m25s
[16:29:26.796] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:4:0)
[16:29:26.815] Build status: SCHEDULED
[16:29:26.815] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:5:0) after 4m27s
[16:33:53.830] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:5:0)
[16:33:53.907] Build status: SCHEDULED
[16:33:53.907] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:6:0) after 4m31s
[16:38:24.926] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:6:0)
[16:38:24.957] Build status: SCHEDULED
[16:38:24.957] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:7:0) after 6m5s
[16:44:30.023] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:7:0)
[16:44:30.049] Build status: SCHEDULED
[16:44:30.049] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:8:0) after 9m39s
[16:54:09.098] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:8:0)
[16:54:09.175] Build status: SCHEDULED
[16:54:09.175] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:9:0) after 3m40s
[16:57:49.197] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:9:0)
[16:57:49.219] Build status: SCHEDULED
[16:57:49.219] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:10:0) after 4m4s
[17:01:53.243] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:10:0)
[17:01:53.271] Build status: SCHEDULED
[17:01:53.271] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:11:0) after 7m51s
[17:09:44.351] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:11:0)
[17:09:44.373] Build status: SCHEDULED
[17:09:44.373] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:12:0) after 6m8s
[17:15:52.396] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:12:0)
[17:15:52.418] Build status: SCHEDULED
[17:15:52.418] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:13:0) after 5m30s
[17:21:22.526] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:13:0)
[17:21:22.551] Build status: SCHEDULED
[17:21:22.552] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:14:0) after 7m25s
[17:28:47.592] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:14:0)
[17:28:47.620] Build status: SCHEDULED
[17:28:47.620] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:15:0) after 7m19s
[17:36:06.641] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:15:0)
[17:36:06.673] Build status: SCHEDULED
[17:36:06.673] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:16:0) after 7m25s
[17:43:31.731] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:16:0)
[17:43:31.749] Build status: SCHEDULED
[17:43:31.750] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:17:0) after 5m3s
[17:48:34.775] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:17:0)
[17:48:34.804] Build status: SCHEDULED
[17:48:34.804] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:18:0) after 4m16s
[17:52:50.964] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:18:0)
[17:52:50.994] Build status: SCHEDULED
[17:52:50.994] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:19:0) after 9m44s
[18:02:35.116] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:19:0)
[18:02:35.140] Build status: SCHEDULED
[18:02:35.140] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:20:0) after 8m8s
[18:10:43.353] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:20:0)
[18:10:43.372] Build status: SCHEDULED
[18:10:43.372] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:21:0) after 3m45s
[18:14:28.471] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:21:0)
[18:14:28.525] Build status: SCHEDULED
[18:14:28.525] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:22:0) after 4m44s
[18:19:12.546] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:22:0)
[18:19:12.568] Build status: SCHEDULED
[18:19:12.568] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:23:0) after 7m10s
[18:26:22.611] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:23:0)
[18:26:25.291] Build status: SCHEDULED
[18:26:25.291] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:24:0) after 5m7s
[18:31:32.373] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:24:0)
[18:31:32.397] Build status: SCHEDULED
[18:31:32.397] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:25:0) after 2m55s
[18:34:27.413] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:25:0)
[18:34:27.435] Build status: SCHEDULED
[18:34:27.435] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:26:0) after 3m20s
[18:37:47.494] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:26:0)
[18:37:47.514] Build status: SCHEDULED
[18:37:47.514] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:27:0) after 6m20s
[18:44:07.537] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:27:0)
[18:44:07.559] Build status: SCHEDULED
[18:44:07.559] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:28:0) after 5m43s
[18:49:50.743] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:28:0)
[18:49:50.768] Build status: SCHEDULED
[18:49:50.768] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:29:0) after 9m9s
[18:58:59.830] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:29:0)
[18:58:59.880] Build status: SCHEDULED
[18:58:59.880] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:30:0) after 5m21s
[19:04:20.969] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:30:0)
[19:04:20.991] Build status: SCHEDULED
[19:04:20.991] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:31:0) after 5m53s
[19:10:14.016] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:31:0)
[19:10:14.030] Build status: SCHEDULED
[19:10:14.030] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:32:0) after 1m5s
[19:11:19.163] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:32:0)
[19:11:19.224] Build status: SCHEDULED
[19:11:19.224] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:33:0) after 8m29s
[19:19:48.312] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:33:0)
[19:19:48.335] Build status: SCHEDULED
[19:19:48.335] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:34:0) after 1m35s
[19:21:23.414] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:34:0)
[19:21:23.433] Build status: SCHEDULED
[19:21:23.433] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:35:0) after 8m49s
[19:30:12.495] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:35:0)
[19:30:12.853] Build status: SCHEDULED
[19:30:12.853] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:36:0) after 4m16s
[19:34:28.881] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:36:0)
[19:34:28.901] Build status: SCHEDULED
[19:34:28.901] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:37:0) after 9m15s
[19:43:44.114] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:37:0)
[19:43:44.136] Build status: SCHEDULED
[19:43:44.136] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:38:0) after 2m42s
[19:46:26.177] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:38:0)
[19:46:26.195] Build status: SCHEDULED
[19:46:26.195] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:39:0) after 9m26s
[19:55:52.181] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:39:0)
[19:55:52.196] Build status: SCHEDULED
[19:55:52.196] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:40:0) after 4m26s
[20:00:18.289] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:40:0)
[20:00:18.315] Build status: SCHEDULED
[20:00:18.315] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:41:0) after 7m30s
[20:07:48.335] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:41:0)
[20:07:48.366] Build status: SCHEDULED
[20:07:48.367] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:42:0) after 5m23s
[20:09:33.119] Received PubSub notification, asking Buildbucket for the build status
[20:09:33.239] Build status: STARTED
[20:13:11.386] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:42:0)
[20:13:11.505] Build status: STARTED
[20:13:11.505] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:44:0) after 1m32s
[20:14:43.678] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:44:0)
[20:14:43.696] Build status: STARTED
[20:14:43.696] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-pigweed-mac-arm-bazel-san-tsan:8880491544991691440:45:0) after 8m42s
[20:20:46.883] Received PubSub notification, asking Buildbucket for the build status
[20:20:46.955] Build:
{
  "id": "8715061482596591585",
  "builder": {
    "project": "pigweed",
    "bucket": "pigweed.dev.ci",
    "builder": "pigweed-mac-arm-bazel-san-tsan"
  },
  "createdBy": "project:pigweed",
  "createTime": "2025-05-12T16:18:40.354393707Z",
  "startTime": "2025-05-12T20:09:32.880781171Z",
  "endTime": "2025-05-12T20:20:46.618018172Z",
  "updateTime": "2025-05-12T20:20:46.618018172Z",
  "status": "FAILURE",
  "input": {
    "gitilesCommit": {
      "host": "pigweed.googlesource.com",
      "project": "pigweed/pigweed",
      "id": "d99edbe1afc68631f84266c2bbc6b4e833a1f392",
      "ref": "refs/heads/main"
    }
  }
}
[20:20:46.955] Invocation finished in 4h2m8.268280072s with status FAILED