1. All projects
  2. chromium
  3. ToTMacArm64PGO
  4. 8854350933137473792
Status: FAILED
Triggered by: -
Duration: 5 hours
Actions:

Definition (rev 6e27020c5be9c002301a748cd853064a98cc9bff) 

buildbucket: <
  server: "cr-buildbucket.appspot.com"
  bucket: "ci"
  builder: "ToTMacArm64PGO"
>

Incoming triggers

Incoming properties

{
  "branch": "refs/heads/main",
  "repository": "https://chromium.googlesource.com/chromium/src",
  "revision": "cb31b0b250de1c75a38dacd68595680beccd980f"
}

Incoming tags

  • buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/cb31b0b250de1c75a38dacd68595680beccd980f
  • gitiles_ref:refs/heads/main

Debug log (UTC)

[05:12:28.839] New invocation is queued and will start shortly
[05:12:29.989] Starting the invocation (attempt 1)
[05:12:30.019] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/cb31b0b250de1c75a38dacd68595680beccd980f"
[05:12:30.019] Popped gitiles commit info from properties and tags
[05:12:30.019] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[05:12:30.019] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[05:12:30.019] Buildbucket request:
{
  "requestId": "8854350933137473792",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTMacArm64PGO"
  },
  "properties": {
    },
  "gitilesCommit": {
    "host": "chromium.googlesource.com",
    "project": "chromium/src",
    "id": "cb31b0b250de1c75a38dacd68595680beccd980f",
    "ref": "refs/heads/main"
  },
  "tags": [
    {
      "key": "scheduler_invocation_id",
      "value": "8854350933137473792"
    },
    {
      "key": "scheduler_job_id",
      "value": "chromium/ToTMacArm64PGO"
    },
    {
      "key": "user_agent",
      "value": "luci-scheduler"
    }
  ],
  "notify": {
    "pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
  }
}
[05:12:30.480] Scheduled build:
{
  "id": "8688920871180628721",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTMacArm64PGO"
  },
  "number": 1419,
  "createdBy": "project:chromium",
  "createTime": "2026-02-25T05:12:30.076458956Z",
  "updateTime": "2026-02-25T05:12:30.076458956Z",
  "status": "SCHEDULED",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "cb31b0b250de1c75a38dacd68595680beccd980f",
      "ref": "refs/heads/main"
    }
  },
  "canary": true
}
[05:12:30.480] Task URL: https://cr-buildbucket.appspot.com/build/8688920871180628721
[05:12:30.480] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:2:0) after 6m12s
[05:12:31.441] Received PubSub notification, asking Buildbucket for the build status
[05:12:31.466] Build status: SCHEDULED
[05:12:33.737] Received PubSub notification, asking Buildbucket for the build status
[05:12:33.755] Build status: STARTED
[05:18:42.509] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:2:0)
[05:18:42.525] Build status: STARTED
[05:18:42.525] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:5:0) after 5m33s
[05:24:15.507] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:5:0)
[05:24:15.520] Build status: STARTED
[05:24:15.520] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:6:0) after 5m2s
[05:29:17.536] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:6:0)
[05:29:17.550] Build status: STARTED
[05:29:17.550] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:7:0) after 2m11s
[05:31:28.625] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:7:0)
[05:31:28.646] Build status: STARTED
[05:31:28.646] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:8:0) after 9m12s
[05:40:40.746] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:8:0)
[05:40:40.769] Build status: STARTED
[05:40:40.769] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:9:0) after 4m15s
[05:44:55.838] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:9:0)
[05:44:55.863] Build status: STARTED
[05:44:55.863] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:10:0) after 8m48s
[05:53:43.923] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:10:0)
[05:53:43.938] Build status: STARTED
[05:53:43.938] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:11:0) after 3m43s
[05:57:26.959] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:11:0)
[05:57:26.994] Build status: STARTED
[05:57:26.994] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:12:0) after 4m7s
[06:01:34.045] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:12:0)
[06:01:34.112] Build status: STARTED
[06:01:34.112] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:13:0) after 1m50s
[06:03:24.132] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:13:0)
[06:03:24.148] Build status: STARTED
[06:03:24.148] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:14:0) after 6m16s
[06:09:40.193] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:14:0)
[06:09:40.209] Build status: STARTED
[06:09:40.209] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:15:0) after 2m47s
[06:12:27.227] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:15:0)
[06:12:27.256] Build status: STARTED
[06:12:27.256] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:16:0) after 6m10s
[06:18:37.230] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:16:0)
[06:18:37.252] Build status: STARTED
[06:18:37.252] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:17:0) after 7m35s
[06:26:12.268] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:17:0)
[06:26:12.281] Build status: STARTED
[06:26:12.281] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:18:0) after 4m46s
[06:30:58.300] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:18:0)
[06:30:58.320] Build status: STARTED
[06:30:58.320] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:19:0) after 7m56s
[06:38:54.339] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:19:0)
[06:38:54.354] Build status: STARTED
[06:38:54.354] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:20:0) after 7m20s
[06:46:14.386] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:20:0)
[06:46:14.400] Build status: STARTED
[06:46:14.400] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:21:0) after 4m3s
[06:50:17.543] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:21:0)
[06:50:17.559] Build status: STARTED
[06:50:17.559] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:22:0) after 6m2s
[06:56:19.557] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:22:0)
[06:56:19.576] Build status: STARTED
[06:56:19.576] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:23:0) after 9m14s
[07:05:33.601] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:23:0)
[07:05:33.616] Build status: STARTED
[07:05:33.616] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:24:0) after 8m56s
[07:14:29.697] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:24:0)
[07:14:29.723] Build status: STARTED
[07:14:29.723] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:25:0) after 7m2s
[07:21:31.784] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:25:0)
[07:21:31.829] Build status: STARTED
[07:21:31.829] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:26:0) after 2m24s
[07:23:55.846] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:26:0)
[07:23:55.864] Build status: STARTED
[07:23:55.864] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:27:0) after 8m6s
[07:32:01.994] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:27:0)
[07:32:02.019] Build status: STARTED
[07:32:02.019] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:28:0) after 5m32s
[07:37:34.048] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:28:0)
[07:37:34.062] Build status: STARTED
[07:37:34.062] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:29:0) after 2m33s
[07:40:07.105] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:29:0)
[07:40:07.123] Build status: STARTED
[07:40:07.123] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:30:0) after 3m37s
[07:43:44.150] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:30:0)
[07:43:44.166] Build status: STARTED
[07:43:44.166] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:31:0) after 5m0s
[07:48:44.186] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:31:0)
[07:48:44.200] Build status: STARTED
[07:48:44.200] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:32:0) after 1m10s
[07:49:54.237] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:32:0)
[07:49:54.259] Build status: STARTED
[07:49:54.259] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:33:0) after 4m19s
[07:54:13.275] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:33:0)
[07:54:13.291] Build status: STARTED
[07:54:13.291] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:34:0) after 7m15s
[08:01:28.310] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:34:0)
[08:01:28.330] Build status: STARTED
[08:01:28.330] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:35:0) after 6m44s
[08:08:12.395] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:35:0)
[08:08:12.415] Build status: STARTED
[08:08:12.415] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:36:0) after 4m13s
[08:12:25.457] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:36:0)
[08:12:25.512] Build status: STARTED
[08:12:25.512] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:37:0) after 8m22s
[08:20:47.558] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:37:0)
[08:20:47.582] Build status: STARTED
[08:20:47.582] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:38:0) after 9m35s
[08:30:22.606] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:38:0)
[08:30:22.627] Build status: STARTED
[08:30:22.627] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:39:0) after 3m42s
[08:34:04.699] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:39:0)
[08:34:04.722] Build status: STARTED
[08:34:04.722] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:40:0) after 7m40s
[08:41:44.744] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:40:0)
[08:41:44.783] Build status: STARTED
[08:41:44.783] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:41:0) after 3m7s
[08:44:51.856] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:41:0)
[08:44:51.891] Build status: STARTED
[08:44:51.891] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:42:0) after 3m20s
[08:48:11.938] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:42:0)
[08:48:11.952] Build status: STARTED
[08:48:11.952] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:43:0) after 1m31s
[08:49:42.972] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:43:0)
[08:49:42.989] Build status: STARTED
[08:49:42.989] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:44:0) after 5m18s
[08:55:00.974] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:44:0)
[08:55:00.998] Build status: STARTED
[08:55:00.998] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:45:0) after 6m9s
[09:01:10.040] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:45:0)
[09:01:10.077] Build status: STARTED
[09:01:10.077] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:46:0) after 4m50s
[09:06:00.099] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:46:0)
[09:06:00.120] Build status: STARTED
[09:06:00.120] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:47:0) after 6m42s
[09:12:42.139] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:47:0)
[09:12:42.203] Build status: STARTED
[09:12:42.203] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:48:0) after 3m39s
[09:16:21.225] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:48:0)
[09:16:21.244] Build status: STARTED
[09:16:21.244] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:49:0) after 2m57s
[09:19:18.237] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:49:0)
[09:19:18.253] Build status: STARTED
[09:19:18.253] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:50:0) after 7m16s
[09:26:34.321] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:50:0)
[09:26:34.371] Build status: STARTED
[09:26:34.371] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:51:0) after 6m10s
[09:32:44.418] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:51:0)
[09:32:44.434] Build status: STARTED
[09:32:44.434] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:52:0) after 4m45s
[09:37:29.452] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:52:0)
[09:37:29.470] Build status: STARTED
[09:37:29.470] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:53:0) after 9m52s
[09:47:21.564] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:53:0)
[09:47:21.613] Build status: STARTED
[09:47:21.613] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:54:0) after 7m44s
[09:55:05.693] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:54:0)
[09:55:05.710] Build status: STARTED
[09:55:05.710] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:55:0) after 6m27s
[10:01:32.795] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:55:0)
[10:01:32.811] Build status: STARTED
[10:01:32.811] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:56:0) after 4m20s
[10:05:52.826] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:56:0)
[10:05:52.846] Build status: STARTED
[10:05:52.846] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:57:0) after 7m23s
[10:13:15.927] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:57:0)
[10:13:15.943] Build status: STARTED
[10:13:15.943] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:58:0) after 2m38s
[10:15:53.964] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:58:0)
[10:15:54.005] Build status: STARTED
[10:15:54.005] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8854350933137473792:59:0) after 8m14s
[10:16:06.286] Received PubSub notification, asking Buildbucket for the build status
[10:16:06.311] Build:
{
  "id": "8688920871180628721",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTMacArm64PGO"
  },
  "number": 1419,
  "createdBy": "project:chromium",
  "createTime": "2026-02-25T05:12:30.076458956Z",
  "startTime": "2026-02-25T05:12:33.562445760Z",
  "endTime": "2026-02-25T10:16:05.477564394Z",
  "updateTime": "2026-02-25T10:16:05.477564394Z",
  "status": "FAILURE",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "cb31b0b250de1c75a38dacd68595680beccd980f",
      "ref": "refs/heads/main"
    }
  },
  "canary": true
}
[10:16:06.312] Invocation finished in 5h3m37.484174922s with status FAILED