LUCI Scheduler :: chromium :: ToTMacArm64PGO

Status: FAILED

Triggered by: -

Duration: 5 hours

Actions:

Definition (rev 6e27020c5be9c002301a748cd853064a98cc9bff)

buildbucket: <
  server: "cr-buildbucket.appspot.com"
  bucket: "ci"
  builder: "ToTMacArm64PGO"
>

Incoming triggers

872afbba32f750af1a81df07ac4000ddd1a52504 (1 week ago)
54ac15878cffec1709befca6efbb16395ff0f318 (1 week ago)
0237f07066e0344a8107da05d5ac804ab77e1cf1 (1 week ago)
1c7546a10f43efb918ae2f4779f54386179e3694 (1 week ago)
2cecae1704e737490526e94c71de00192c0d0110 (1 week ago)
c7b99e29068b46110340ca878479df89f652b6ca (1 week ago)
5e4256617805a758f3dfe5f50f91f8b086b3102c (1 week ago)
e12983e388dc763e37167a033642d4d22f4e7353 (1 week ago)
6efe33a4f758a4555d6ce617657cf8e35effecee (1 week ago)
2071ecba74911e854a6cb16918d6dcf7d11f54ad (1 week ago)
8c5ec3db0db5fb8a227b51229a6510d5e664c68a (1 week ago)

Incoming properties

{
  "branch": "refs/heads/main",
  "repository": "https://chromium.googlesource.com/chromium/src",
  "revision": "8c5ec3db0db5fb8a227b51229a6510d5e664c68a"
}

Incoming tags

buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/8c5ec3db0db5fb8a227b51229a6510d5e664c68a
gitiles_ref:refs/heads/main

Debug log (UTC)

[11:13:56.483] New invocation is queued and will start shortly
[11:13:57.602] Starting the invocation (attempt 1)
[11:13:57.623] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/8c5ec3db0db5fb8a227b51229a6510d5e664c68a"
[11:13:57.623] Popped gitiles commit info from properties and tags
[11:13:57.623] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[11:13:57.623] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[11:13:57.623] Buildbucket request:
{
  "requestId": "8850794910297507088",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTMacArm64PGO"
  },
  "properties": {
    },
  "gitilesCommit": {
    "host": "chromium.googlesource.com",
    "project": "chromium/src",
    "id": "8c5ec3db0db5fb8a227b51229a6510d5e664c68a",
    "ref": "refs/heads/main"
  },
  "tags": [
    {
      "key": "scheduler_invocation_id",
      "value": "8850794910297507088"
    },
    {
      "key": "scheduler_job_id",
      "value": "chromium/ToTMacArm64PGO"
    },
    {
      "key": "user_agent",
      "value": "luci-scheduler"
    }
  ],
  "notify": {
    "pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
  }
}
[11:13:58.467] Scheduled build:
{
  "id": "8685364848232867041",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTMacArm64PGO"
  },
  "number": 2089,
  "createdBy": "project:chromium",
  "createTime": "2026-04-05T11:13:57.830524695Z",
  "updateTime": "2026-04-05T11:13:57.830524695Z",
  "status": "SCHEDULED",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "8c5ec3db0db5fb8a227b51229a6510d5e664c68a",
      "ref": "refs/heads/main"
    }
  }
}
[11:13:58.467] Task URL: https://cr-buildbucket.appspot.com/build/8685364848232867041
[11:13:58.467] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:2:0) after 2m4s
[11:13:59.455] Received PubSub notification, asking Buildbucket for the build status
[11:13:59.497] Build status: SCHEDULED
[11:14:38.747] Received PubSub notification, asking Buildbucket for the build status
[11:14:38.775] Build status: STARTED
[11:16:02.470] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:2:0)
[11:16:02.487] Build status: STARTED
[11:16:02.487] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:5:0) after 8m20s
[11:24:22.500] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:5:0)
[11:24:22.560] Build status: STARTED
[11:24:22.560] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:6:0) after 1m18s
[11:25:40.655] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:6:0)
[11:25:40.667] Build status: STARTED
[11:25:40.667] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:7:0) after 4m14s
[11:29:54.680] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:7:0)
[11:29:54.696] Build status: STARTED
[11:29:54.697] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:8:0) after 8m11s
[11:38:05.769] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:8:0)
[11:38:05.865] Build status: STARTED
[11:38:05.865] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:9:0) after 8m4s
[11:46:09.890] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:9:0)
[11:46:09.906] Build status: STARTED
[11:46:09.906] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:10:0) after 3m30s
[11:49:39.922] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:10:0)
[11:49:39.937] Build status: STARTED
[11:49:39.937] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:11:0) after 5m48s
[11:55:28.129] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:11:0)
[11:55:28.146] Build status: STARTED
[11:55:28.146] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:12:0) after 3m46s
[11:59:14.161] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:12:0)
[11:59:14.177] Build status: STARTED
[11:59:14.177] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:13:0) after 3m10s
[12:02:24.188] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:13:0)
[12:02:24.459] Build status: STARTED
[12:02:24.459] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:14:0) after 3m27s
[12:05:51.606] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:14:0)
[12:05:51.635] Build status: STARTED
[12:05:51.635] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:15:0) after 5m41s
[12:11:32.684] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:15:0)
[12:11:32.701] Build status: STARTED
[12:11:32.701] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:16:0) after 8m53s
[12:20:25.719] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:16:0)
[12:20:25.814] Build status: STARTED
[12:20:25.814] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:17:0) after 8m3s
[12:28:28.926] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:17:0)
[12:28:28.942] Build status: STARTED
[12:28:28.942] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:18:0) after 7m7s
[12:35:35.963] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:18:0)
[12:35:35.980] Build status: STARTED
[12:35:35.980] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:19:0) after 3m16s
[12:38:51.994] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:19:0)
[12:38:52.011] Build status: STARTED
[12:38:52.011] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:20:0) after 9m17s
[12:48:08.990] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:20:0)
[12:48:09.014] Build status: STARTED
[12:48:09.014] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:21:0) after 3m56s
[12:52:05.285] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:21:0)
[12:52:05.299] Build status: STARTED
[12:52:05.299] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:22:0) after 1m19s
[12:53:24.401] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:22:0)
[12:53:24.422] Build status: STARTED
[12:53:24.422] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:23:0) after 3m36s
[12:57:00.480] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:23:0)
[12:57:00.504] Build status: STARTED
[12:57:00.504] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:24:0) after 2m20s
[12:59:20.932] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:24:0)
[12:59:20.962] Build status: STARTED
[12:59:20.962] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:25:0) after 1m22s
[13:00:43.122] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:25:0)
[13:00:43.145] Build status: STARTED
[13:00:43.146] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:26:0) after 7m9s
[13:07:52.158] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:26:0)
[13:07:52.177] Build status: STARTED
[13:07:52.177] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:27:0) after 5m9s
[13:13:01.169] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:27:0)
[13:13:01.188] Build status: STARTED
[13:13:01.188] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:28:0) after 1m33s
[13:14:34.600] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:28:0)
[13:14:34.615] Build status: STARTED
[13:14:34.615] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:29:0) after 2m51s
[13:17:25.703] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:29:0)
[13:17:25.718] Build status: STARTED
[13:17:25.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:30:0) after 5m37s
[13:23:02.856] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:30:0)
[13:23:02.873] Build status: STARTED
[13:23:02.873] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:31:0) after 2m11s
[13:25:13.887] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:31:0)
[13:25:13.979] Build status: STARTED
[13:25:13.979] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:32:0) after 8m30s
[13:33:43.993] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:32:0)
[13:33:44.018] Build status: STARTED
[13:33:44.018] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:33:0) after 1m27s
[13:35:11.059] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:33:0)
[13:35:11.092] Build status: STARTED
[13:35:11.092] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:34:0) after 8m29s
[13:43:40.273] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:34:0)
[13:43:40.287] Build status: STARTED
[13:43:40.287] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:35:0) after 8m6s
[13:51:46.394] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:35:0)
[13:51:46.497] Build status: STARTED
[13:51:46.497] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:36:0) after 7m13s
[13:58:59.648] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:36:0)
[13:58:59.669] Build status: STARTED
[13:58:59.670] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:37:0) after 4m32s
[14:03:31.837] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:37:0)
[14:03:31.859] Build status: STARTED
[14:03:31.859] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:38:0) after 6m48s
[14:10:20.065] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:38:0)
[14:10:20.099] Build status: STARTED
[14:10:20.099] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:39:0) after 8m43s
[14:19:03.160] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:39:0)
[14:19:03.178] Build status: STARTED
[14:19:03.178] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:40:0) after 1m10s
[14:20:13.259] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:40:0)
[14:20:13.330] Build status: STARTED
[14:20:13.330] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:41:0) after 3m54s
[14:24:07.520] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:41:0)
[14:24:07.541] Build status: STARTED
[14:24:07.541] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:42:0) after 1m26s
[14:25:33.559] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:42:0)
[14:25:33.588] Build status: STARTED
[14:25:33.588] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:43:0) after 3m39s
[14:29:12.666] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:43:0)
[14:29:12.697] Build status: STARTED
[14:29:12.697] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:44:0) after 5m54s
[14:35:06.712] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:44:0)
[14:35:06.729] Build status: STARTED
[14:35:06.729] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:45:0) after 4m1s
[14:39:08.049] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:45:0)
[14:39:08.067] Build status: STARTED
[14:39:08.067] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:46:0) after 5m3s
[14:44:11.182] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:46:0)
[14:44:11.200] Build status: STARTED
[14:44:11.200] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:47:0) after 1m45s
[14:45:56.214] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:47:0)
[14:45:56.289] Build status: STARTED
[14:45:56.289] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:48:0) after 1m49s
[14:47:45.308] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:48:0)
[14:47:45.328] Build status: STARTED
[14:47:45.328] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:49:0) after 6m50s
[14:54:35.386] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:49:0)
[14:54:35.401] Build status: STARTED
[14:54:35.401] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:50:0) after 3m43s
[14:58:18.516] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:50:0)
[14:58:18.541] Build status: STARTED
[14:58:18.541] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:51:0) after 3m48s
[15:02:06.705] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:51:0)
[15:02:06.731] Build status: STARTED
[15:02:06.731] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:52:0) after 8m36s
[15:10:42.913] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:52:0)
[15:10:42.932] Build status: STARTED
[15:10:42.932] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:53:0) after 8m2s
[15:18:45.048] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:53:0)
[15:18:45.067] Build status: STARTED
[15:18:45.067] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:54:0) after 4m47s
[15:23:32.084] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:54:0)
[15:23:32.167] Build status: STARTED
[15:23:32.167] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:55:0) after 2m52s
[15:26:24.281] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:55:0)
[15:26:24.297] Build status: STARTED
[15:26:24.297] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:56:0) after 2m17s
[15:28:41.528] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:56:0)
[15:28:41.550] Build status: STARTED
[15:28:41.550] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:57:0) after 9m2s
[15:37:43.597] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:57:0)
[15:37:43.615] Build status: STARTED
[15:37:43.615] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:58:0) after 1m7s
[15:38:50.670] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:58:0)
[15:38:50.694] Build status: STARTED
[15:38:50.695] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:59:0) after 7m24s
[15:46:14.698] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:59:0)
[15:46:14.800] Build status: STARTED
[15:46:14.800] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:60:0) after 8m54s
[15:55:08.987] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:60:0)
[15:55:09.035] Build status: STARTED
[15:55:09.035] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:61:0) after 5m5s
[16:00:14.051] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:61:0)
[16:00:14.078] Build status: STARTED
[16:00:14.078] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:62:0) after 3m5s
[16:03:19.091] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:62:0)
[16:03:19.114] Build status: STARTED
[16:03:19.114] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:63:0) after 6m10s
[16:09:29.130] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:63:0)
[16:09:29.169] Build status: STARTED
[16:09:29.169] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:64:0) after 2m2s
[16:11:31.325] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:64:0)
[16:11:31.359] Build status: STARTED
[16:11:31.359] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:65:0) after 7m26s
[16:18:57.651] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:65:0)
[16:18:57.665] Build status: STARTED
[16:18:57.665] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:66:0) after 3m43s
[16:22:40.697] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:66:0)
[16:22:40.712] Build status: STARTED
[16:22:40.712] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:67:0) after 4m55s
[16:27:35.728] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:67:0)
[16:27:35.744] Build status: STARTED
[16:27:35.744] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:68:0) after 8m56s
[16:36:31.760] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:68:0)
[16:36:31.776] Build status: STARTED
[16:36:31.776] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:69:0) after 4m26s
[16:40:58.090] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:69:0)
[16:40:58.109] Build status: STARTED
[16:40:58.109] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8850794910297507088:70:0) after 8m32s
[16:48:48.600] Received PubSub notification, asking Buildbucket for the build status
[16:48:48.627] Build:
{
  "id": "8685364848232867041",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTMacArm64PGO"
  },
  "number": 2089,
  "createdBy": "project:chromium",
  "createTime": "2026-04-05T11:13:57.830524695Z",
  "startTime": "2026-04-05T11:14:38.600537222Z",
  "endTime": "2026-04-05T16:48:48.267126927Z",
  "updateTime": "2026-04-05T16:48:48.267126927Z",
  "status": "FAILURE",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "8c5ec3db0db5fb8a227b51229a6510d5e664c68a",
      "ref": "refs/heads/main"
    }
  }
}
[16:48:48.628] Invocation finished in 5h34m52.149153632s with status FAILED