LUCI Scheduler :: chromium :: ToTMacArm64PGO

Status: FAILED

Triggered by: -

Duration: 4 hours

Actions:

Definition (rev 6e27020c5be9c002301a748cd853064a98cc9bff)

buildbucket: <
  server: "cr-buildbucket.appspot.com"
  bucket: "ci"
  builder: "ToTMacArm64PGO"
>

Incoming triggers

9e6a4c5786221612d777ffd8104dfcea9c04f4a0 (3 months ago)
2b3274a6feb8cb44da58760f79375af3cbbddad3 (3 months ago)
605c904774a4e2204ef7ca2dbc93ac16f526c085 (3 months ago)
6cf07f0d180c406197ce823ab8edc9bde4dddef5 (3 months ago)
089f3925c1f9eca761e0eb5f286438abc0b3766d (3 months ago)
7a7c99aa2394ee1cdbc83a4ca75d80fc818bf6f3 (3 months ago)
15f4245fae65ff06f954f5adc990d0b709780523 (3 months ago)
6f3ec49d6ef6acb2fffd2ab8af8254c2a7ac81bb (3 months ago)
745ebad09b005500c498cd7f4ea102329b078d40 (3 months ago)
7acaba3362bc0d11c0844f0c85c45bf7ff58f6a8 (3 months ago)
8441162107cba3c9bdf418048d59aaf809ca13a1 (3 months ago)

Incoming properties

{
  "branch": "refs/heads/main",
  "repository": "https://chromium.googlesource.com/chromium/src",
  "revision": "8441162107cba3c9bdf418048d59aaf809ca13a1"
}

Incoming tags

buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/8441162107cba3c9bdf418048d59aaf809ca13a1
gitiles_ref:refs/heads/main

Debug log (UTC)

[13:18:36.337] New invocation is queued and will start shortly
[13:18:37.626] Starting the invocation (attempt 1)
[13:18:37.652] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/8441162107cba3c9bdf418048d59aaf809ca13a1"
[13:18:37.652] Popped gitiles commit info from properties and tags
[13:18:37.652] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[13:18:37.653] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[13:18:37.653] Buildbucket request:
{
  "requestId": "8841364982596431200",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTMacArm64PGO"
  },
  "properties": {
    },
  "gitilesCommit": {
    "host": "chromium.googlesource.com",
    "project": "chromium/src",
    "id": "8441162107cba3c9bdf418048d59aaf809ca13a1",
    "ref": "refs/heads/main"
  },
  "tags": [
    {
      "key": "scheduler_invocation_id",
      "value": "8841364982596431200"
    },
    {
      "key": "scheduler_job_id",
      "value": "chromium/ToTMacArm64PGO"
    },
    {
      "key": "user_agent",
      "value": "luci-scheduler"
    }
  ],
  "notify": {
    "pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
  }
}
[13:18:38.225] Scheduled build:
{
  "id": "8675934920484632897",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTMacArm64PGO"
  },
  "number": 3879,
  "createdBy": "project:chromium",
  "createTime": "2026-07-18T13:18:37.729901558Z",
  "updateTime": "2026-07-18T13:18:37.729901558Z",
  "status": "SCHEDULED",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "8441162107cba3c9bdf418048d59aaf809ca13a1",
      "ref": "refs/heads/main"
    }
  },
  "canary": true
}
[13:18:38.225] Task URL: https://cr-buildbucket.appspot.com/build/8675934920484632897
[13:18:38.225] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:2:0) after 7m15s
[13:18:39.343] Received PubSub notification, asking Buildbucket for the build status
[13:18:39.363] Build status: SCHEDULED
[13:18:42.297] Received PubSub notification, asking Buildbucket for the build status
[13:18:42.323] Build status: STARTED
[13:25:53.239] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:2:0)
[13:25:53.278] Build status: STARTED
[13:25:53.278] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:5:0) after 5m2s
[13:30:55.295] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:5:0)
[13:30:55.328] Build status: STARTED
[13:30:55.328] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:6:0) after 6m25s
[13:37:20.408] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:6:0)
[13:37:20.430] Build status: STARTED
[13:37:20.430] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:7:0) after 8m9s
[13:45:29.456] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:7:0)
[13:45:29.486] Build status: STARTED
[13:45:29.486] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:8:0) after 1m49s
[13:47:18.545] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:8:0)
[13:47:18.567] Build status: STARTED
[13:47:18.567] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:9:0) after 7m7s
[13:54:25.631] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:9:0)
[13:54:25.649] Build status: STARTED
[13:54:25.649] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:10:0) after 8m28s
[14:02:53.713] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:10:0)
[14:02:53.748] Build status: STARTED
[14:02:53.748] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:11:0) after 5m38s
[14:08:31.740] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:11:0)
[14:08:31.788] Build status: STARTED
[14:08:31.788] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:12:0) after 2m50s
[14:11:21.852] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:12:0)
[14:11:21.868] Build status: STARTED
[14:11:21.868] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:13:0) after 5m22s
[14:16:43.907] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:13:0)
[14:16:43.936] Build status: STARTED
[14:16:43.936] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:14:0) after 5m50s
[14:22:33.949] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:14:0)
[14:22:33.965] Build status: STARTED
[14:22:33.965] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:15:0) after 9m43s
[14:32:17.029] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:15:0)
[14:32:17.115] Build status: STARTED
[14:32:17.115] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:16:0) after 9m27s
[14:41:44.129] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:16:0)
[14:41:44.158] Build status: STARTED
[14:41:44.158] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:17:0) after 6m7s
[14:47:51.799] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:17:0)
[14:47:51.817] Build status: STARTED
[14:47:51.817] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:18:0) after 6m14s
[14:54:05.970] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:18:0)
[14:54:05.988] Build status: STARTED
[14:54:05.988] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:19:0) after 3m14s
[14:57:20.010] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:19:0)
[14:57:20.025] Build status: STARTED
[14:57:20.025] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:20:0) after 6m6s
[15:03:26.332] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:20:0)
[15:03:26.354] Build status: STARTED
[15:03:26.354] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:21:0) after 3m24s
[15:06:50.368] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:21:0)
[15:06:50.384] Build status: STARTED
[15:06:50.384] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:22:0) after 8m19s
[15:15:09.396] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:22:0)
[15:15:09.413] Build status: STARTED
[15:15:09.413] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:23:0) after 3m11s
[15:18:20.427] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:23:0)
[15:18:20.460] Build status: STARTED
[15:18:20.460] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:24:0) after 9m36s
[15:27:56.471] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:24:0)
[15:27:56.489] Build status: STARTED
[15:27:56.489] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:25:0) after 9m9s
[15:37:05.532] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:25:0)
[15:37:05.549] Build status: STARTED
[15:37:05.549] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:26:0) after 6m21s
[15:43:26.844] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:26:0)
[15:43:26.866] Build status: STARTED
[15:43:26.866] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:27:0) after 7m6s
[15:50:32.980] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:27:0)
[15:50:32.996] Build status: STARTED
[15:50:32.996] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:28:0) after 9m4s
[15:59:37.012] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:28:0)
[15:59:37.032] Build status: STARTED
[15:59:37.032] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:29:0) after 9m49s
[16:09:26.222] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:29:0)
[16:09:26.288] Build status: STARTED
[16:09:26.288] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:30:0) after 8m11s
[16:17:37.302] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:30:0)
[16:17:37.330] Build status: STARTED
[16:17:37.330] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:31:0) after 4m42s
[16:22:19.508] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:31:0)
[16:22:19.531] Build status: STARTED
[16:22:19.531] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:32:0) after 8m14s
[16:30:33.666] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:32:0)
[16:30:33.687] Build status: STARTED
[16:30:33.687] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:33:0) after 5m9s
[16:35:42.963] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:33:0)
[16:35:42.981] Build status: STARTED
[16:35:42.981] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:34:0) after 4m44s
[16:40:27.082] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:34:0)
[16:40:27.120] Build status: STARTED
[16:40:27.120] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:35:0) after 2m50s
[16:43:17.340] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:35:0)
[16:43:17.390] Build status: STARTED
[16:43:17.390] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:36:0) after 8m53s
[16:52:10.423] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:36:0)
[16:52:10.446] Build status: STARTED
[16:52:10.446] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:37:0) after 4m23s
[16:56:33.739] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:37:0)
[16:56:33.753] Build status: STARTED
[16:56:33.753] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:38:0) after 2m7s
[16:58:40.847] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:38:0)
[16:58:40.866] Build status: STARTED
[16:58:40.866] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:39:0) after 7m21s
[17:06:02.082] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:39:0)
[17:06:02.172] Build status: STARTED
[17:06:02.172] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:40:0) after 8m54s
[17:14:56.892] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:40:0)
[17:14:56.919] Build status: STARTED
[17:14:56.919] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:41:0) after 4m0s
[17:18:57.170] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:41:0)
[17:18:57.191] Build status: STARTED
[17:18:57.191] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:42:0) after 9m40s
[17:28:37.205] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:42:0)
[17:28:37.227] Build status: STARTED
[17:28:37.227] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:43:0) after 2m6s
[17:30:43.347] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:43:0)
[17:30:43.363] Build status: STARTED
[17:30:43.363] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:44:0) after 7m1s
[17:37:44.528] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:44:0)
[17:37:44.547] Build status: STARTED
[17:37:44.547] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:45:0) after 2m54s
[17:40:38.565] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:45:0)
[17:40:38.585] Build status: STARTED
[17:40:38.585] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:46:0) after 9m38s
[17:50:16.617] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:46:0)
[17:50:16.635] Build status: STARTED
[17:50:16.635] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:47:0) after 4m6s
[17:54:22.842] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:47:0)
[17:54:22.862] Build status: STARTED
[17:54:22.862] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:48:0) after 1m2s
[17:55:25.622] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:48:0)
[17:55:25.642] Build status: STARTED
[17:55:25.642] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:49:0) after 4m47s
[18:00:12.797] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:49:0)
[18:00:12.816] Build status: STARTED
[18:00:12.816] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:50:0) after 1m2s
[18:01:14.836] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:50:0)
[18:01:14.853] Build status: STARTED
[18:01:14.853] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:51:0) after 8m43s
[18:09:58.032] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:51:0)
[18:09:58.114] Build status: STARTED
[18:09:58.114] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841364982596431200:52:0) after 9m48s
[18:17:16.480] Received PubSub notification, asking Buildbucket for the build status
[18:17:16.504] Build:
{
  "id": "8675934920484632897",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTMacArm64PGO"
  },
  "number": 3879,
  "createdBy": "project:chromium",
  "createTime": "2026-07-18T13:18:37.729901558Z",
  "startTime": "2026-07-18T13:18:41.837418768Z",
  "endTime": "2026-07-18T18:17:16.150363553Z",
  "updateTime": "2026-07-18T18:17:16.150363553Z",
  "status": "INFRA_FAILURE",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "8441162107cba3c9bdf418048d59aaf809ca13a1",
      "ref": "refs/heads/main"
    }
  },
  "canary": true
}
[18:17:16.504] Invocation finished in 4h58m40.171522973s with status FAILED