[12:51:54.598] New invocation is queued and will start shortly
[12:51:55.837] Starting the invocation (attempt 1)
[12:51:55.868] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/bc84bc4e3c71f07e74a8850d1d1cbf8c1bb0389f"
[12:51:55.868] Popped gitiles commit info from properties and tags
[12:51:55.869] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[12:51:55.869] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[12:51:55.869] Buildbucket request:
{
"requestId": "8833394129100281328",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64PGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "bc84bc4e3c71f07e74a8850d1d1cbf8c1bb0389f",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8833394129100281328"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacArm64PGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[12:51:56.559] Scheduled build:
{
"id": "8667964067047596257",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64PGO"
},
"number": 5857,
"createdBy": "project:chromium",
"createTime": "2026-10-14T12:51:55.932944952Z",
"updateTime": "2026-10-14T12:51:55.932944952Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "bc84bc4e3c71f07e74a8850d1d1cbf8c1bb0389f",
"ref": "refs/heads/main"
}
}
}
[12:51:56.559] Task URL: https://cr-buildbucket.appspot.com/build/8667964067047596257
[12:51:56.559] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833394129100281328:2:0) after 9m37s
[12:51:57.378] Received PubSub notification, asking Buildbucket for the build status
[12:51:57.450] Build status: SCHEDULED
[12:52:00.531] Received PubSub notification, asking Buildbucket for the build status
[12:52:00.548] Build status: STARTED
[13:01:33.569] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833394129100281328:2:0)
[13:01:33.917] Build status: STARTED
[13:01:33.917] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833394129100281328:5:0) after 1m56s
[13:03:29.990] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833394129100281328:5:0)
[13:03:30.009] Build status: STARTED
[13:03:30.009] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833394129100281328:6:0) after 4m47s
[13:08:17.028] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833394129100281328:6:0)
[13:08:17.067] Build status: STARTED
[13:08:17.068] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833394129100281328:7:0) after 4m55s
[13:13:12.182] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833394129100281328:7:0)
[13:13:12.201] Build status: STARTED
[13:13:12.201] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833394129100281328:8:0) after 4m2s
[13:17:14.230] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833394129100281328:8:0)
[13:17:14.363] Build status: STARTED
[13:17:14.363] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833394129100281328:9:0) after 9m14s
[13:26:28.458] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833394129100281328:9:0)
[13:26:28.487] Build status: STARTED
[13:26:28.487] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833394129100281328:10:0) after 6m33s
[13:33:01.542] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833394129100281328:10:0)
[13:33:01.597] Build status: STARTED
[13:33:01.597] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833394129100281328:11:0) after 7m44s
[13:40:45.624] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833394129100281328:11:0)
[13:40:45.712] Build status: STARTED
[13:40:45.712] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833394129100281328:12:0) after 5m55s
[13:46:40.783] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833394129100281328:12:0)
[13:46:40.802] Build status: STARTED
[13:46:40.802] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833394129100281328:13:0) after 5m29s
[13:52:09.834] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833394129100281328:13:0)
[13:52:09.861] Build status: STARTED
[13:52:09.861] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833394129100281328:14:0) after 7m19s
[13:59:28.904] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833394129100281328:14:0)
[13:59:28.946] Build status: STARTED
[13:59:28.946] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833394129100281328:15:0) after 2m10s
[14:01:39.117] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833394129100281328:15:0)
[14:01:39.131] Build status: STARTED
[14:01:39.131] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833394129100281328:16:0) after 3m56s
[14:05:35.294] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833394129100281328:16:0)
[14:05:35.315] Build status: STARTED
[14:05:35.315] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833394129100281328:17:0) after 5m48s
[14:11:23.341] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833394129100281328:17:0)
[14:11:23.362] Build status: STARTED
[14:11:23.362] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833394129100281328:18:0) after 4m4s
[14:15:27.382] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833394129100281328:18:0)
[14:15:27.419] Build status: STARTED
[14:15:27.419] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833394129100281328:19:0) after 4m2s
[14:19:29.440] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833394129100281328:19:0)
[14:19:29.457] Build status: STARTED
[14:19:29.457] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833394129100281328:20:0) after 7m46s
[14:27:15.476] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833394129100281328:20:0)
[14:27:15.500] Build status: STARTED
[14:27:15.500] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833394129100281328:21:0) after 7m52s
[14:35:07.668] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833394129100281328:21:0)
[14:35:07.765] Build status: STARTED
[14:35:07.765] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833394129100281328:22:0) after 7m46s
[14:42:53.803] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833394129100281328:22:0)
[14:42:53.825] Build status: STARTED
[14:42:53.825] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833394129100281328:23:0) after 8m9s
[14:51:02.854] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833394129100281328:23:0)
[14:51:02.877] Build status: STARTED
[14:51:02.877] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833394129100281328:24:0) after 1m53s
[14:52:55.905] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833394129100281328:24:0)
[14:52:55.923] Build status: STARTED
[14:52:55.923] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833394129100281328:25:0) after 2m15s
[14:55:10.946] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833394129100281328:25:0)
[14:55:10.974] Build status: STARTED
[14:55:10.974] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833394129100281328:26:0) after 3m8s
[14:58:19.046] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833394129100281328:26:0)
[14:58:19.120] Build status: STARTED
[14:58:19.120] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833394129100281328:27:0) after 9m5s
[15:07:24.137] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833394129100281328:27:0)
[15:07:24.166] Build status: STARTED
[15:07:24.166] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833394129100281328:28:0) after 7m19s
[15:14:43.153] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833394129100281328:28:0)
[15:14:43.172] Build status: STARTED
[15:14:43.172] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833394129100281328:29:0) after 9m25s
[15:24:08.196] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833394129100281328:29:0)
[15:24:08.222] Build status: STARTED
[15:24:08.222] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833394129100281328:30:0) after 2m32s
[15:26:40.261] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833394129100281328:30:0)
[15:26:40.278] Build status: STARTED
[15:26:40.278] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833394129100281328:31:0) after 6m1s
[15:32:41.304] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833394129100281328:31:0)
[15:32:41.351] Build status: STARTED
[15:32:41.351] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833394129100281328:32:0) after 3m17s
[15:35:58.370] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833394129100281328:32:0)
[15:35:58.466] Build status: STARTED
[15:35:58.466] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833394129100281328:33:0) after 4m22s
[15:40:20.599] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833394129100281328:33:0)
[15:40:20.632] Build status: STARTED
[15:40:20.632] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833394129100281328:34:0) after 5m41s
[15:46:01.653] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833394129100281328:34:0)
[15:46:01.672] Build status: STARTED
[15:46:01.672] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833394129100281328:35:0) after 6m53s
[15:52:54.721] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833394129100281328:35:0)
[15:52:54.812] Build status: STARTED
[15:52:54.812] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833394129100281328:36:0) after 8m46s
[16:01:40.835] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833394129100281328:36:0)
[16:01:40.855] Build status: STARTED
[16:01:40.855] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833394129100281328:37:0) after 6m33s
[16:08:13.893] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833394129100281328:37:0)
[16:08:13.940] Build status: STARTED
[16:08:13.940] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833394129100281328:38:0) after 5m13s
[16:09:36.343] Received PubSub notification, asking Buildbucket for the build status
[16:09:36.362] Build:
{
"id": "8667964067047596257",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64PGO"
},
"number": 5857,
"createdBy": "project:chromium",
"createTime": "2026-10-14T12:51:55.932944952Z",
"startTime": "2026-10-14T12:52:00.327107183Z",
"endTime": "2026-10-14T16:09:36.015955899Z",
"updateTime": "2026-10-14T16:09:36.015955899Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "bc84bc4e3c71f07e74a8850d1d1cbf8c1bb0389f",
"ref": "refs/heads/main"
}
}
}
[16:09:36.362] Invocation finished in 3h17m41.770946808s with status FAILED