1. All projects
  2. chromium
  3. ToTMacArm64PGO
  4. 8850647505287067056
Status: FAILED
Triggered by: -
Duration: 5 hours
Actions:

Definition (rev 6e27020c5be9c002301a748cd853064a98cc9bff) 

buildbucket: <
  server: "cr-buildbucket.appspot.com"
  bucket: "ci"
  builder: "ToTMacArm64PGO"
>

Incoming triggers

Incoming properties

{
  "branch": "refs/heads/main",
  "repository": "https://chromium.googlesource.com/chromium/src",
  "revision": "5187f95ff1d2faac57a59d47b563623709cc1976"
}

Incoming tags

  • buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/5187f95ff1d2faac57a59d47b563623709cc1976
  • gitiles_ref:refs/heads/main

Debug log (UTC)

[02:16:52.860] New invocation is queued and will start shortly
[02:16:53.923] Starting the invocation (attempt 1)
[02:16:53.946] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/5187f95ff1d2faac57a59d47b563623709cc1976"
[02:16:53.946] Popped gitiles commit info from properties and tags
[02:16:53.946] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[02:16:53.946] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[02:16:53.947] Buildbucket request:
{
  "requestId": "8850647505287067056",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTMacArm64PGO"
  },
  "properties": {
    },
  "gitilesCommit": {
    "host": "chromium.googlesource.com",
    "project": "chromium/src",
    "id": "5187f95ff1d2faac57a59d47b563623709cc1976",
    "ref": "refs/heads/main"
  },
  "tags": [
    {
      "key": "scheduler_invocation_id",
      "value": "8850647505287067056"
    },
    {
      "key": "scheduler_job_id",
      "value": "chromium/ToTMacArm64PGO"
    },
    {
      "key": "user_agent",
      "value": "luci-scheduler"
    }
  ],
  "notify": {
    "pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
  }
}
[02:16:57.489] Scheduled build:
{
  "id": "8685217443418281297",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTMacArm64PGO"
  },
  "number": 2103,
  "createdBy": "project:chromium",
  "createTime": "2026-04-07T02:16:54.016117734Z",
  "updateTime": "2026-04-07T02:16:54.016117734Z",
  "status": "SCHEDULED",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "5187f95ff1d2faac57a59d47b563623709cc1976",
      "ref": "refs/heads/main"
    }
  },
  "canary": true
}
[02:16:57.489] Task URL: https://cr-buildbucket.appspot.com/build/8685217443418281297
[02:16:57.489] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:2:0) after 4m15s
[02:16:58.391] Received PubSub notification, asking Buildbucket for the build status
[02:16:58.451] Build status: SCHEDULED
[02:17:02.678] Received PubSub notification, asking Buildbucket for the build status
[02:17:02.705] Build status: STARTED
[02:21:12.513] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:2:0)
[02:21:12.568] Build status: STARTED
[02:21:12.568] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:5:0) after 9m52s
[02:31:04.638] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:5:0)
[02:31:04.657] Build status: STARTED
[02:31:04.657] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:6:0) after 8m20s
[02:39:24.678] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:6:0)
[02:39:24.699] Build status: STARTED
[02:39:24.699] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:7:0) after 1m42s
[02:41:06.706] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:7:0)
[02:41:06.738] Build status: STARTED
[02:41:06.738] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:8:0) after 9m7s
[02:50:13.806] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:8:0)
[02:50:13.827] Build status: STARTED
[02:50:13.827] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:9:0) after 5m9s
[02:55:22.924] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:9:0)
[02:55:22.942] Build status: STARTED
[02:55:22.942] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:10:0) after 4m52s
[03:00:14.980] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:10:0)
[03:00:14.998] Build status: STARTED
[03:00:14.998] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:11:0) after 3m43s
[03:03:58.032] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:11:0)
[03:03:58.079] Build status: STARTED
[03:03:58.079] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:12:0) after 2m13s
[03:06:11.090] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:12:0)
[03:06:11.108] Build status: STARTED
[03:06:11.108] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:13:0) after 5m10s
[03:11:21.255] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:13:0)
[03:11:21.335] Build status: STARTED
[03:11:21.335] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:14:0) after 7m6s
[03:18:27.401] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:14:0)
[03:18:27.417] Build status: STARTED
[03:18:27.417] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:15:0) after 4m12s
[03:22:39.434] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:15:0)
[03:22:39.453] Build status: STARTED
[03:22:39.453] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:16:0) after 9m44s
[03:32:23.516] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:16:0)
[03:32:23.537] Build status: STARTED
[03:32:23.537] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:17:0) after 3m48s
[03:36:11.578] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:17:0)
[03:36:11.598] Build status: STARTED
[03:36:11.598] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:18:0) after 9m0s
[03:45:11.675] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:18:0)
[03:45:11.699] Build status: STARTED
[03:45:11.699] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:19:0) after 1m58s
[03:47:09.716] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:19:0)
[03:47:09.736] Build status: STARTED
[03:47:09.736] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:20:0) after 4m30s
[03:51:39.784] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:20:0)
[03:51:39.801] Build status: STARTED
[03:51:39.801] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:21:0) after 3m4s
[03:54:43.820] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:21:0)
[03:54:43.837] Build status: STARTED
[03:54:43.837] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:22:0) after 6m6s
[04:00:49.890] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:22:0)
[04:00:49.923] Build status: STARTED
[04:00:49.923] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:23:0) after 1m36s
[04:02:25.934] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:23:0)
[04:02:25.980] Build status: STARTED
[04:02:25.980] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:24:0) after 3m33s
[04:05:59.002] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:24:0)
[04:05:59.021] Build status: STARTED
[04:05:59.021] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:25:0) after 6m32s
[04:12:31.043] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:25:0)
[04:12:31.108] Build status: STARTED
[04:12:31.108] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:26:0) after 5m28s
[04:17:59.174] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:26:0)
[04:17:59.198] Build status: STARTED
[04:17:59.198] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:27:0) after 1m18s
[04:19:17.218] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:27:0)
[04:19:17.237] Build status: STARTED
[04:19:17.237] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:28:0) after 3m9s
[04:22:26.315] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:28:0)
[04:22:26.332] Build status: STARTED
[04:22:26.332] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:29:0) after 9m41s
[04:32:07.356] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:29:0)
[04:32:07.374] Build status: STARTED
[04:32:07.374] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:30:0) after 3m28s
[04:35:35.419] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:30:0)
[04:35:35.436] Build status: STARTED
[04:35:35.436] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:31:0) after 4m33s
[04:40:08.475] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:31:0)
[04:40:08.499] Build status: STARTED
[04:40:08.499] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:32:0) after 9m27s
[04:49:35.517] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:32:0)
[04:49:35.541] Build status: STARTED
[04:49:35.541] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:33:0) after 8m43s
[04:58:18.611] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:33:0)
[04:58:18.638] Build status: STARTED
[04:58:18.638] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:34:0) after 7m6s
[05:05:24.659] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:34:0)
[05:05:24.676] Build status: STARTED
[05:05:24.676] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:35:0) after 8m48s
[05:14:12.723] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:35:0)
[05:14:12.740] Build status: STARTED
[05:14:12.741] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:36:0) after 7m7s
[05:21:19.762] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:36:0)
[05:21:19.778] Build status: STARTED
[05:21:19.778] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:37:0) after 9m35s
[05:30:54.856] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:37:0)
[05:30:54.935] Build status: STARTED
[05:30:54.936] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:38:0) after 7m18s
[05:38:12.927] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:38:0)
[05:38:12.961] Build status: STARTED
[05:38:12.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:39:0) after 5m1s
[05:43:14.010] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:39:0)
[05:43:14.027] Build status: STARTED
[05:43:14.027] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:40:0) after 7m35s
[05:50:49.046] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:40:0)
[05:50:49.346] Build status: STARTED
[05:50:49.346] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:41:0) after 8m7s
[05:58:56.402] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:41:0)
[05:58:56.423] Build status: STARTED
[05:58:56.424] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:42:0) after 6m1s
[06:04:57.495] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:42:0)
[06:04:57.512] Build status: STARTED
[06:04:57.512] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:43:0) after 8m43s
[06:13:40.554] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:43:0)
[06:13:40.569] Build status: STARTED
[06:13:40.569] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:44:0) after 3m35s
[06:17:15.589] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:44:0)
[06:17:15.603] Build status: STARTED
[06:17:15.603] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:45:0) after 1m39s
[06:18:54.581] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:45:0)
[06:18:54.614] Build status: STARTED
[06:18:54.614] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:46:0) after 9m25s
[06:28:19.683] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:46:0)
[06:28:19.706] Build status: STARTED
[06:28:19.706] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:47:0) after 9m58s
[06:38:17.728] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:47:0)
[06:38:17.744] Build status: STARTED
[06:38:17.744] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:48:0) after 2m17s
[06:40:34.816] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:48:0)
[06:40:34.836] Build status: STARTED
[06:40:34.836] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:49:0) after 6m12s
[06:46:47.338] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:49:0)
[06:46:47.355] Build status: STARTED
[06:46:47.355] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:50:0) after 8m37s
[06:55:24.423] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:50:0)
[06:55:24.443] Build status: STARTED
[06:55:24.443] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:51:0) after 1m19s
[06:56:43.460] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:51:0)
[06:56:43.476] Build status: STARTED
[06:56:43.476] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:52:0) after 8m55s
[07:05:38.545] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:52:0)
[07:05:38.585] Build status: STARTED
[07:05:38.585] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:53:0) after 2m47s
[07:12:02.498] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:53:0)
[07:12:02.553] Build status: STARTED
[07:12:02.553] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:54:0) after 2m51s
[07:14:53.585] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:54:0)
[07:14:53.648] Build status: STARTED
[07:14:53.648] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:55:0) after 6m9s
[07:21:02.941] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:55:0)
[07:21:02.960] Build status: STARTED
[07:21:02.960] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:56:0) after 4m5s
[07:25:07.983] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:56:0)
[07:25:08.035] Build status: STARTED
[07:25:08.036] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:57:0) after 4m57s
[07:30:05.073] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:57:0)
[07:30:05.089] Build status: STARTED
[07:30:05.089] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:58:0) after 6m44s
[07:36:49.109] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:58:0)
[07:36:49.140] Build status: STARTED
[07:36:49.140] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:59:0) after 2m54s
[07:39:43.166] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:59:0)
[07:39:43.184] Build status: STARTED
[07:39:43.184] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:60:0) after 6m57s
[07:46:40.302] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:60:0)
[07:46:40.348] Build status: STARTED
[07:46:40.348] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850647505287067056:61:0) after 9m41s
[07:55:33.696] Received PubSub notification, asking Buildbucket for the build status
[07:55:33.734] Build:
{
  "id": "8685217443418281297",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTMacArm64PGO"
  },
  "number": 2103,
  "createdBy": "project:chromium",
  "createTime": "2026-04-07T02:16:54.016117734Z",
  "startTime": "2026-04-07T02:17:01.384241866Z",
  "endTime": "2026-04-07T07:55:33.307310381Z",
  "updateTime": "2026-04-07T07:55:33.307310381Z",
  "status": "FAILURE",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "5187f95ff1d2faac57a59d47b563623709cc1976",
      "ref": "refs/heads/main"
    }
  },
  "canary": true
}
[07:55:33.734] Invocation finished in 5h38m40.88441693s with status FAILED