1. All projects
  2. chromium
  3. ToTMacArm64PGO
  4. 8841164852981392960
Status: FAILED
Triggered by: -
Duration: 5 hours
Actions:

Definition (rev 6e27020c5be9c002301a748cd853064a98cc9bff) 

buildbucket: <
  server: "cr-buildbucket.appspot.com"
  bucket: "ci"
  builder: "ToTMacArm64PGO"
>

Incoming triggers

Incoming properties

{
  "branch": "refs/heads/main",
  "repository": "https://chromium.googlesource.com/chromium/src",
  "revision": "8e538551c1c182e1c6552ba67a6a8dc0944809a9"
}

Incoming tags

  • buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/8e538551c1c182e1c6552ba67a6a8dc0944809a9
  • gitiles_ref:refs/heads/main

Debug log (UTC)

[18:19:34.810] New invocation is queued and will start shortly
[18:19:36.084] Starting the invocation (attempt 1)
[18:19:36.112] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/8e538551c1c182e1c6552ba67a6a8dc0944809a9"
[18:19:36.112] Popped gitiles commit info from properties and tags
[18:19:36.112] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[18:19:36.112] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[18:19:36.112] Buildbucket request:
{
  "requestId": "8841164852981392960",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTMacArm64PGO"
  },
  "properties": {
    },
  "gitilesCommit": {
    "host": "chromium.googlesource.com",
    "project": "chromium/src",
    "id": "8e538551c1c182e1c6552ba67a6a8dc0944809a9",
    "ref": "refs/heads/main"
  },
  "tags": [
    {
      "key": "scheduler_invocation_id",
      "value": "8841164852981392960"
    },
    {
      "key": "scheduler_job_id",
      "value": "chromium/ToTMacArm64PGO"
    },
    {
      "key": "user_agent",
      "value": "luci-scheduler"
    }
  ],
  "notify": {
    "pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
  }
}
[18:19:36.632] Scheduled build:
{
  "id": "8675734790889257569",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTMacArm64PGO"
  },
  "number": 3893,
  "createdBy": "project:chromium",
  "createTime": "2026-07-20T18:19:36.184506937Z",
  "updateTime": "2026-07-20T18:19:36.184506937Z",
  "status": "SCHEDULED",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "8e538551c1c182e1c6552ba67a6a8dc0944809a9",
      "ref": "refs/heads/main"
    }
  }
}
[18:19:36.632] Task URL: https://cr-buildbucket.appspot.com/build/8675734790889257569
[18:19:36.632] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:2:0) after 2m44s
[18:19:37.765] Received PubSub notification, asking Buildbucket for the build status
[18:19:37.788] Build status: SCHEDULED
[18:19:40.771] Received PubSub notification, asking Buildbucket for the build status
[18:19:40.809] Build status: STARTED
[18:22:20.650] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:2:0)
[18:22:20.685] Build status: STARTED
[18:22:20.685] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:5:0) after 5m30s
[18:27:50.710] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:5:0)
[18:27:50.784] Build status: STARTED
[18:27:50.784] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:6:0) after 7m55s
[18:35:45.838] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:6:0)
[18:35:45.872] Build status: STARTED
[18:35:45.872] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:7:0) after 6m47s
[18:42:33.067] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:7:0)
[18:42:33.090] Build status: STARTED
[18:42:33.090] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:8:0) after 5m7s
[18:47:40.106] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:8:0)
[18:47:40.126] Build status: STARTED
[18:47:40.126] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:9:0) after 6m3s
[18:53:43.170] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:9:0)
[18:53:43.187] Build status: STARTED
[18:53:43.188] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:10:0) after 4m34s
[18:58:17.220] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:10:0)
[18:58:17.265] Build status: STARTED
[18:58:17.265] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:11:0) after 8m53s
[19:07:10.292] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:11:0)
[19:07:10.313] Build status: STARTED
[19:07:10.313] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:12:0) after 5m39s
[19:12:49.334] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:12:0)
[19:12:49.350] Build status: STARTED
[19:12:49.350] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:13:0) after 4m4s
[19:16:53.337] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:13:0)
[19:16:53.368] Build status: STARTED
[19:16:53.368] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:14:0) after 8m50s
[19:25:43.433] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:14:0)
[19:25:43.460] Build status: STARTED
[19:25:43.460] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:15:0) after 8m28s
[19:34:11.570] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:15:0)
[19:34:11.595] Build status: STARTED
[19:34:11.595] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:16:0) after 5m23s
[19:39:34.706] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:16:0)
[19:39:34.759] Build status: STARTED
[19:39:34.759] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:17:0) after 6m46s
[19:46:20.763] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:17:0)
[19:46:20.792] Build status: STARTED
[19:46:20.792] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:18:0) after 4m47s
[19:51:07.767] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:18:0)
[19:51:07.789] Build status: STARTED
[19:51:07.789] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:19:0) after 4m20s
[19:55:28.025] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:19:0)
[19:55:28.058] Build status: STARTED
[19:55:28.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:20:0) after 6m7s
[20:01:35.097] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:20:0)
[20:01:35.122] Build status: STARTED
[20:01:35.122] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:21:0) after 6m6s
[20:07:41.332] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:21:0)
[20:07:41.358] Build status: STARTED
[20:07:41.358] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:22:0) after 7m19s
[20:15:00.418] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:22:0)
[20:15:00.476] Build status: STARTED
[20:15:00.476] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:23:0) after 3m3s
[20:18:03.548] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:23:0)
[20:18:03.567] Build status: STARTED
[20:18:03.567] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:24:0) after 7m48s
[20:25:51.632] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:24:0)
[20:25:51.716] Build status: STARTED
[20:25:51.716] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:25:0) after 6m48s
[20:32:39.734] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:25:0)
[20:32:39.793] Build status: STARTED
[20:32:39.793] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:26:0) after 3m17s
[20:35:56.815] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:26:0)
[20:35:56.870] Build status: STARTED
[20:35:56.870] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:27:0) after 3m25s
[20:39:21.890] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:27:0)
[20:39:21.915] Build status: STARTED
[20:39:21.915] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:28:0) after 7m6s
[20:46:28.035] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:28:0)
[20:46:28.058] Build status: STARTED
[20:46:28.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:29:0) after 3m25s
[20:49:53.101] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:29:0)
[20:49:53.128] Build status: STARTED
[20:49:53.128] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:30:0) after 1m59s
[20:51:52.178] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:30:0)
[20:51:52.201] Build status: STARTED
[20:51:52.201] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:31:0) after 4m40s
[20:56:32.326] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:31:0)
[20:56:32.420] Build status: STARTED
[20:56:32.420] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:32:0) after 5m14s
[21:01:46.444] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:32:0)
[21:01:46.540] Build status: STARTED
[21:01:46.540] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:33:0) after 1m6s
[21:02:52.639] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:33:0)
[21:02:52.668] Build status: STARTED
[21:02:52.668] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:34:0) after 1m51s
[21:04:43.686] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:34:0)
[21:04:43.701] Build status: STARTED
[21:04:43.701] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:35:0) after 4m3s
[21:08:46.743] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:35:0)
[21:08:46.810] Build status: STARTED
[21:08:46.810] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:36:0) after 2m48s
[21:11:34.887] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:36:0)
[21:11:34.904] Build status: STARTED
[21:11:34.904] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:37:0) after 5m34s
[21:17:08.921] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:37:0)
[21:17:08.940] Build status: STARTED
[21:17:08.940] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:38:0) after 6m35s
[21:23:43.932] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:38:0)
[21:23:44.306] Build status: STARTED
[21:23:44.306] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:39:0) after 8m54s
[21:32:38.327] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:39:0)
[21:32:38.347] Build status: STARTED
[21:32:38.347] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:40:0) after 1m17s
[21:33:55.356] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:40:0)
[21:33:55.375] Build status: STARTED
[21:33:55.375] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:41:0) after 9m38s
[21:43:33.532] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:41:0)
[21:43:33.547] Build status: STARTED
[21:43:33.547] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:42:0) after 8m14s
[21:51:47.648] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:42:0)
[21:51:47.734] Build status: STARTED
[21:51:47.734] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:43:0) after 3m9s
[21:54:56.828] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:43:0)
[21:54:56.847] Build status: STARTED
[21:54:56.847] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:44:0) after 2m2s
[21:56:58.866] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:44:0)
[21:56:58.909] Build status: STARTED
[21:56:58.909] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:45:0) after 4m23s
[22:01:21.975] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:45:0)
[22:01:21.995] Build status: STARTED
[22:01:21.995] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:46:0) after 3m33s
[22:04:55.012] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:46:0)
[22:04:55.039] Build status: STARTED
[22:04:55.039] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:47:0) after 7m2s
[22:11:57.058] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:47:0)
[22:11:57.102] Build status: STARTED
[22:11:57.102] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:48:0) after 2m14s
[22:14:11.122] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:48:0)
[22:14:11.142] Build status: STARTED
[22:14:11.142] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:49:0) after 4m5s
[22:18:16.162] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:49:0)
[22:18:16.188] Build status: STARTED
[22:18:16.188] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:50:0) after 8m11s
[22:26:27.296] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:50:0)
[22:26:27.310] Build status: STARTED
[22:26:27.310] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:51:0) after 8m35s
[22:35:02.374] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:51:0)
[22:35:02.389] Build status: STARTED
[22:35:02.389] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:52:0) after 2m15s
[22:37:17.421] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:52:0)
[22:37:17.440] Build status: STARTED
[22:37:17.441] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:53:0) after 3m3s
[22:40:20.468] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:53:0)
[22:40:20.533] Build status: STARTED
[22:40:20.533] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:54:0) after 2m49s
[22:43:09.550] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:54:0)
[22:43:09.567] Build status: STARTED
[22:43:09.567] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:55:0) after 2m43s
[22:45:52.620] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:55:0)
[22:45:52.645] Build status: STARTED
[22:45:52.645] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:56:0) after 5m25s
[22:51:17.668] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:56:0)
[22:51:17.684] Build status: STARTED
[22:51:17.684] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:57:0) after 3m35s
[22:54:52.794] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:57:0)
[22:54:52.833] Build status: STARTED
[22:54:52.833] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:58:0) after 1m11s
[22:56:03.950] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:58:0)
[22:56:03.987] Build status: STARTED
[22:56:03.987] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:59:0) after 6m25s
[23:02:29.052] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:59:0)
[23:02:29.086] Build status: STARTED
[23:02:29.086] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:60:0) after 1m31s
[23:04:00.258] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:60:0)
[23:04:00.277] Build status: STARTED
[23:04:00.277] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:61:0) after 9m28s
[23:13:28.585] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:61:0)
[23:13:28.626] Build status: STARTED
[23:13:28.626] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:62:0) after 5m55s
[23:19:23.777] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:62:0)
[23:19:23.804] Build status: STARTED
[23:19:23.804] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841164852981392960:63:0) after 8m20s
[23:20:31.148] Received PubSub notification, asking Buildbucket for the build status
[23:20:31.170] Build:
{
  "id": "8675734790889257569",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTMacArm64PGO"
  },
  "number": 3893,
  "createdBy": "project:chromium",
  "createTime": "2026-07-20T18:19:36.184506937Z",
  "startTime": "2026-07-20T18:19:40.493885203Z",
  "endTime": "2026-07-20T23:20:30.785376331Z",
  "updateTime": "2026-07-20T23:20:30.785376331Z",
  "status": "INFRA_FAILURE",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "8e538551c1c182e1c6552ba67a6a8dc0944809a9",
      "ref": "refs/heads/main"
    }
  }
}
[23:20:31.170] Invocation finished in 5h0m56.364629822s with status FAILED