LUCI Scheduler :: chromium :: ToTMacArm64PGO

Status: FAILED

Triggered by: -

Duration: 5 hours

Actions:

Definition (rev 6e27020c5be9c002301a748cd853064a98cc9bff)

buildbucket: <
  server: "cr-buildbucket.appspot.com"
  bucket: "ci"
  builder: "ToTMacArm64PGO"
>

Incoming triggers

31d18e8bd138761304b5458ef221f8c9280881e0 (2 days ago)
4ea12023aa0e82935819096baaa37d29991c15bc (2 days ago)
dc26369f5471f35422c5d48559d46355fadb7942 (2 days ago)
34017445f6f60ccee830402533f55d526a1156f4 (2 days ago)
926e0523d2d8eb0df90f88edc8c961fffe7b0503 (2 days ago)
3f9525786aff8530bc6da20d5fb2d08c9c5e49d2 (2 days ago)
6c73bb08cf97ce3401c74b515ec51f3757ef7a5b (2 days ago)
ed78cc65ace4a9a989f567e7e7408e3e8d409dfa (2 days ago)
a48e15f43c447d1fd3a7af6a9f266db5c5ac1cf5 (2 days ago)
65328f50d68e814acf9033fb245a8f521c248924 (2 days ago)
c67d0b2a6207ae48d6d9395fbc66b2c9460b9f07 (2 days ago)
554027a938e59e1b0f824405db19f440ff677a6d (2 days ago)

Incoming properties

{
  "branch": "refs/heads/main",
  "repository": "https://chromium.googlesource.com/chromium/src",
  "revision": "554027a938e59e1b0f824405db19f440ff677a6d"
}

Incoming tags

buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/554027a938e59e1b0f824405db19f440ff677a6d
gitiles_ref:refs/heads/main

Debug log (UTC)

[16:48:51.020] New invocation is queued and will start shortly
[16:48:52.440] Starting the invocation (attempt 1)
[16:48:52.466] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/554027a938e59e1b0f824405db19f440ff677a6d"
[16:48:52.466] Popped gitiles commit info from properties and tags
[16:48:52.466] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[16:48:52.466] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[16:48:52.466] Buildbucket request:
{
  "requestId": "8850773839653852416",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTMacArm64PGO"
  },
  "properties": {
    },
  "gitilesCommit": {
    "host": "chromium.googlesource.com",
    "project": "chromium/src",
    "id": "554027a938e59e1b0f824405db19f440ff677a6d",
    "ref": "refs/heads/main"
  },
  "tags": [
    {
      "key": "scheduler_invocation_id",
      "value": "8850773839653852416"
    },
    {
      "key": "scheduler_job_id",
      "value": "chromium/ToTMacArm64PGO"
    },
    {
      "key": "user_agent",
      "value": "luci-scheduler"
    }
  ],
  "notify": {
    "pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
  }
}
[16:48:53.033] Scheduled build:
{
  "id": "8685343777412433521",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTMacArm64PGO"
  },
  "number": 2090,
  "createdBy": "project:chromium",
  "createTime": "2026-04-05T16:48:52.530206371Z",
  "updateTime": "2026-04-05T16:48:52.530206371Z",
  "status": "SCHEDULED",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "554027a938e59e1b0f824405db19f440ff677a6d",
      "ref": "refs/heads/main"
    }
  }
}
[16:48:53.033] Task URL: https://cr-buildbucket.appspot.com/build/8685343777412433521
[16:48:53.033] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:2:0) after 3m12s
[16:48:53.927] Received PubSub notification, asking Buildbucket for the build status
[16:48:53.998] Build status: SCHEDULED
[16:49:33.727] Received PubSub notification, asking Buildbucket for the build status
[16:49:33.743] Build status: STARTED
[16:52:05.306] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:2:0)
[16:52:05.333] Build status: STARTED
[16:52:05.333] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:5:0) after 8m55s
[17:01:00.348] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:5:0)
[17:01:00.398] Build status: STARTED
[17:01:00.398] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:6:0) after 2m4s
[17:03:04.512] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:6:0)
[17:03:04.545] Build status: STARTED
[17:03:04.545] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:7:0) after 1m4s
[17:04:08.719] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:7:0)
[17:04:08.752] Build status: STARTED
[17:04:08.752] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:8:0) after 1m49s
[17:05:57.765] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:8:0)
[17:05:57.794] Build status: STARTED
[17:05:57.795] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:9:0) after 4m24s
[17:10:21.826] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:9:0)
[17:10:21.854] Build status: STARTED
[17:10:21.854] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:10:0) after 9m30s
[17:19:52.019] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:10:0)
[17:19:52.039] Build status: STARTED
[17:19:52.040] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:11:0) after 2m51s
[17:22:43.050] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:11:0)
[17:22:43.073] Build status: STARTED
[17:22:43.073] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:12:0) after 3m13s
[17:25:56.085] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:12:0)
[17:25:56.111] Build status: STARTED
[17:25:56.111] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:13:0) after 3m27s
[17:29:23.106] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:13:0)
[17:29:23.122] Build status: STARTED
[17:29:23.122] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:14:0) after 9m50s
[17:39:13.136] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:14:0)
[17:39:13.181] Build status: STARTED
[17:39:13.181] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:15:0) after 2m28s
[17:41:41.358] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:15:0)
[17:41:41.383] Build status: STARTED
[17:41:41.383] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:16:0) after 4m40s
[17:46:21.451] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:16:0)
[17:46:21.470] Build status: STARTED
[17:46:21.470] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:17:0) after 4m40s
[17:51:01.656] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:17:0)
[17:51:01.681] Build status: STARTED
[17:51:01.681] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:18:0) after 2m47s
[17:53:49.455] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:18:0)
[17:53:49.517] Build status: STARTED
[17:53:49.517] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:19:0) after 9m8s
[18:02:57.629] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:19:0)
[18:02:57.647] Build status: STARTED
[18:02:57.647] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:20:0) after 6m34s
[18:09:32.165] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:20:0)
[18:09:32.192] Build status: STARTED
[18:09:32.192] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:21:0) after 6m15s
[18:15:47.330] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:21:0)
[18:15:47.349] Build status: STARTED
[18:15:47.350] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:22:0) after 3m27s
[18:19:14.362] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:22:0)
[18:19:14.387] Build status: STARTED
[18:19:14.387] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:23:0) after 3m32s
[18:22:46.550] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:23:0)
[18:22:46.568] Build status: STARTED
[18:22:46.568] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:24:0) after 1m28s
[18:24:14.580] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:24:0)
[18:24:14.612] Build status: STARTED
[18:24:14.612] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:25:0) after 2m6s
[18:26:20.629] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:25:0)
[18:26:20.658] Build status: STARTED
[18:26:20.658] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:26:0) after 7m19s
[18:33:39.710] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:26:0)
[18:33:39.735] Build status: STARTED
[18:33:39.736] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:27:0) after 5m21s
[18:39:00.829] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:27:0)
[18:39:00.904] Build status: STARTED
[18:39:00.904] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:28:0) after 4m35s
[18:43:36.019] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:28:0)
[18:43:36.055] Build status: STARTED
[18:43:36.055] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:29:0) after 5m7s
[18:48:43.035] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:29:0)
[18:48:43.055] Build status: STARTED
[18:48:43.055] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:30:0) after 4m58s
[18:53:41.097] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:30:0)
[18:53:41.175] Build status: STARTED
[18:53:41.175] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:31:0) after 6m49s
[19:00:30.243] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:31:0)
[19:00:30.260] Build status: STARTED
[19:00:30.260] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:32:0) after 4m41s
[19:05:11.707] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:32:0)
[19:05:11.725] Build status: STARTED
[19:05:11.725] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:33:0) after 6m16s
[19:11:27.938] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:33:0)
[19:11:27.955] Build status: STARTED
[19:11:27.955] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:34:0) after 1m0s
[19:12:27.970] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:34:0)
[19:12:27.991] Build status: STARTED
[19:12:27.991] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:35:0) after 7m26s
[19:19:54.006] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:35:0)
[19:19:54.025] Build status: STARTED
[19:19:54.026] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:36:0) after 9m15s
[19:29:09.065] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:36:0)
[19:29:09.146] Build status: STARTED
[19:29:09.146] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:37:0) after 9m24s
[19:38:33.454] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:37:0)
[19:38:33.476] Build status: STARTED
[19:38:33.476] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:38:0) after 4m56s
[19:43:29.544] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:38:0)
[19:43:29.588] Build status: STARTED
[19:43:29.588] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:39:0) after 4m29s
[19:47:58.603] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:39:0)
[19:47:58.625] Build status: STARTED
[19:47:58.625] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:40:0) after 3m27s
[19:51:25.639] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:40:0)
[19:51:25.659] Build status: STARTED
[19:51:25.659] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:41:0) after 1m49s
[19:53:14.714] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:41:0)
[19:53:14.813] Build status: STARTED
[19:53:14.813] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:42:0) after 1m18s
[19:54:32.828] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:42:0)
[19:54:32.919] Build status: STARTED
[19:54:32.919] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:43:0) after 4m53s
[19:59:25.934] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:43:0)
[19:59:25.954] Build status: STARTED
[19:59:25.954] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:44:0) after 2m47s
[20:02:13.014] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:44:0)
[20:02:13.032] Build status: STARTED
[20:02:13.032] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:45:0) after 6m53s
[20:09:06.149] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:45:0)
[20:09:06.170] Build status: STARTED
[20:09:06.170] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:46:0) after 4m11s
[20:13:17.183] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:46:0)
[20:13:17.204] Build status: STARTED
[20:13:17.204] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:47:0) after 5m6s
[20:18:23.506] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:47:0)
[20:18:23.526] Build status: STARTED
[20:18:23.526] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:48:0) after 6m37s
[20:25:00.586] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:48:0)
[20:25:00.895] Build status: STARTED
[20:25:00.895] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:49:0) after 2m57s
[20:27:58.066] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:49:0)
[20:27:58.083] Build status: STARTED
[20:27:58.083] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:50:0) after 3m38s
[20:31:36.078] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:50:0)
[20:31:36.119] Build status: STARTED
[20:31:36.119] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:51:0) after 6m48s
[20:38:24.105] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:51:0)
[20:38:24.125] Build status: STARTED
[20:38:24.125] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:52:0) after 4m4s
[20:42:28.270] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:52:0)
[20:42:28.289] Build status: STARTED
[20:42:28.289] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:53:0) after 5m32s
[20:48:00.305] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:53:0)
[20:48:00.330] Build status: STARTED
[20:48:00.330] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:54:0) after 4m21s
[20:52:21.301] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:54:0)
[20:52:21.318] Build status: STARTED
[20:52:21.318] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:55:0) after 1m57s
[20:54:18.337] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:55:0)
[20:54:18.415] Build status: STARTED
[20:54:18.415] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:56:0) after 5m52s
[21:00:10.451] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:56:0)
[21:00:10.466] Build status: STARTED
[21:00:10.466] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:57:0) after 2m46s
[21:02:56.624] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:57:0)
[21:02:56.643] Build status: STARTED
[21:02:56.643] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:58:0) after 7m34s
[21:10:30.664] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:58:0)
[21:10:30.680] Build status: STARTED
[21:10:30.680] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:59:0) after 3m53s
[21:14:23.695] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:59:0)
[21:14:23.720] Build status: STARTED
[21:14:23.720] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:60:0) after 5m58s
[21:20:21.693] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:60:0)
[21:20:21.722] Build status: STARTED
[21:20:21.723] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:61:0) after 9m54s
[21:30:15.699] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:61:0)
[21:30:15.725] Build status: STARTED
[21:30:15.725] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:62:0) after 8m27s
[21:38:42.785] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:62:0)
[21:38:42.805] Build status: STARTED
[21:38:42.805] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:63:0) after 9m41s
[21:48:23.822] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:63:0)
[21:48:23.841] Build status: STARTED
[21:48:23.841] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:64:0) after 9m14s
[21:57:38.029] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:64:0)
[21:57:38.052] Build status: STARTED
[21:57:38.053] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:65:0) after 1m46s
[21:59:24.067] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:65:0)
[21:59:24.096] Build status: STARTED
[21:59:24.096] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:66:0) after 3m27s
[22:02:51.132] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:66:0)
[22:02:51.147] Build status: STARTED
[22:02:51.147] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:67:0) after 4m51s
[22:07:42.248] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:67:0)
[22:07:42.267] Build status: STARTED
[22:07:42.267] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:68:0) after 8m31s
[22:16:13.435] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:68:0)
[22:16:13.453] Build status: STARTED
[22:16:13.453] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:69:0) after 6m9s
[22:22:22.465] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:69:0)
[22:22:22.479] Build status: STARTED
[22:22:22.479] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:70:0) after 1m21s
[22:23:43.699] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:70:0)
[22:23:43.722] Build status: STARTED
[22:23:43.723] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850773839653852416:71:0) after 8m29s
[22:26:07.243] Received PubSub notification, asking Buildbucket for the build status
[22:26:07.318] Build:
{
  "id": "8685343777412433521",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTMacArm64PGO"
  },
  "number": 2090,
  "createdBy": "project:chromium",
  "createTime": "2026-04-05T16:48:52.530206371Z",
  "startTime": "2026-04-05T16:49:33.541069012Z",
  "endTime": "2026-04-05T22:26:05.727478832Z",
  "updateTime": "2026-04-05T22:26:05.727478832Z",
  "status": "FAILURE",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "554027a938e59e1b0f824405db19f440ff677a6d",
      "ref": "refs/heads/main"
    }
  }
}
[22:26:07.318] Invocation finished in 5h37m16.309019581s with status FAILED