[02:16:31.741] New invocation is queued and will start shortly
[02:16:32.899] Starting the invocation (attempt 1)
[02:16:32.928] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/49481f94d33814f1030c7cf23e212e43b0360f21"
[02:16:32.928] Popped gitiles commit info from properties and tags
[02:16:32.929] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[02:16:32.929] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[02:16:32.929] Buildbucket request:
{
"requestId": "8846842454835617472",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64PGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "49481f94d33814f1030c7cf23e212e43b0360f21",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8846842454835617472"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacArm64PGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[02:16:33.414] Scheduled build:
{
"id": "8681412392865569233",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64PGO"
},
"number": 2783,
"createdBy": "project:chromium",
"createTime": "2026-05-19T02:16:33.001445279Z",
"updateTime": "2026-05-19T02:16:33.001445279Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "49481f94d33814f1030c7cf23e212e43b0360f21",
"ref": "refs/heads/main"
}
}
}
[02:16:33.414] Task URL: https://cr-buildbucket.appspot.com/build/8681412392865569233
[02:16:33.414] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8846842454835617472:2:0) after 8m15s
[02:16:34.385] Received PubSub notification, asking Buildbucket for the build status
[02:16:34.401] Build status: SCHEDULED
[02:16:37.039] Received PubSub notification, asking Buildbucket for the build status
[02:16:37.122] Build status: STARTED
[02:24:48.438] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8846842454835617472:2:0)
[02:24:48.454] Build status: STARTED
[02:24:48.454] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8846842454835617472:5:0) after 2m37s
[02:27:25.470] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8846842454835617472:5:0)
[02:27:25.496] Build status: STARTED
[02:27:25.496] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8846842454835617472:6:0) after 9m24s
[02:36:49.678] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8846842454835617472:6:0)
[02:36:49.696] Build status: STARTED
[02:36:49.696] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8846842454835617472:7:0) after 2m0s
[02:38:49.709] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8846842454835617472:7:0)
[02:38:49.730] Build status: STARTED
[02:38:49.730] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8846842454835617472:8:0) after 6m35s
[02:45:24.741] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8846842454835617472:8:0)
[02:45:24.759] Build status: STARTED
[02:45:24.759] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8846842454835617472:9:0) after 3m41s
[02:49:05.838] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8846842454835617472:9:0)
[02:49:05.947] Build status: STARTED
[02:49:05.947] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8846842454835617472:10:0) after 8m13s
[02:57:19.000] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8846842454835617472:10:0)
[02:57:19.019] Build status: STARTED
[02:57:19.019] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8846842454835617472:11:0) after 7m50s
[03:05:09.133] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8846842454835617472:11:0)
[03:05:09.157] Build status: STARTED
[03:05:09.157] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8846842454835617472:12:0) after 3m2s
[03:08:11.167] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8846842454835617472:12:0)
[03:08:11.183] Build status: STARTED
[03:08:11.183] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8846842454835617472:13:0) after 5m39s
[03:13:50.195] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8846842454835617472:13:0)
[03:13:50.238] Build status: STARTED
[03:13:50.238] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8846842454835617472:14:0) after 4m42s
[03:18:32.251] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8846842454835617472:14:0)
[03:18:32.274] Build status: STARTED
[03:18:32.274] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8846842454835617472:15:0) after 7m57s
[03:26:29.356] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8846842454835617472:15:0)
[03:26:29.376] Build status: STARTED
[03:26:29.376] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8846842454835617472:16:0) after 2m0s
[03:28:29.391] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8846842454835617472:16:0)
[03:28:29.409] Build status: STARTED
[03:28:29.409] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8846842454835617472:17:0) after 4m14s
[03:32:43.416] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8846842454835617472:17:0)
[03:32:43.481] Build status: STARTED
[03:32:43.481] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8846842454835617472:18:0) after 6m36s
[03:39:19.523] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8846842454835617472:18:0)
[03:39:19.563] Build status: STARTED
[03:39:19.563] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8846842454835617472:19:0) after 4m44s
[03:44:03.575] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8846842454835617472:19:0)
[03:44:03.602] Build status: STARTED
[03:44:03.602] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8846842454835617472:20:0) after 3m38s
[03:47:41.614] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8846842454835617472:20:0)
[03:47:41.632] Build status: STARTED
[03:47:41.632] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8846842454835617472:21:0) after 5m54s
[03:53:35.646] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8846842454835617472:21:0)
[03:53:35.661] Build status: STARTED
[03:53:35.661] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8846842454835617472:22:0) after 2m13s
[03:55:48.877] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8846842454835617472:22:0)
[03:55:48.896] Build status: STARTED
[03:55:48.896] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8846842454835617472:23:0) after 7m10s
[04:02:58.917] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8846842454835617472:23:0)
[04:02:58.945] Build status: STARTED
[04:02:58.945] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8846842454835617472:24:0) after 8m45s
[04:11:44.024] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8846842454835617472:24:0)
[04:11:44.108] Build status: STARTED
[04:11:44.108] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8846842454835617472:25:0) after 7m35s
[04:19:19.121] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8846842454835617472:25:0)
[04:19:19.179] Build status: STARTED
[04:19:19.179] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8846842454835617472:26:0) after 8m21s
[04:27:40.214] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8846842454835617472:26:0)
[04:27:40.229] Build status: STARTED
[04:27:40.229] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8846842454835617472:27:0) after 3m12s
[04:30:52.245] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8846842454835617472:27:0)
[04:30:52.258] Build status: STARTED
[04:30:52.258] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8846842454835617472:28:0) after 5m45s
[04:36:37.284] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8846842454835617472:28:0)
[04:36:37.306] Build status: STARTED
[04:36:37.306] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8846842454835617472:29:0) after 8m18s
[04:39:24.211] Received PubSub notification, asking Buildbucket for the build status
[04:39:24.228] Build:
{
"id": "8681412392865569233",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64PGO"
},
"number": 2783,
"createdBy": "project:chromium",
"createTime": "2026-05-19T02:16:33.001445279Z",
"startTime": "2026-05-19T02:16:36.872840201Z",
"endTime": "2026-05-19T04:39:23.941122999Z",
"updateTime": "2026-05-19T04:39:23.941122999Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "49481f94d33814f1030c7cf23e212e43b0360f21",
"ref": "refs/heads/main"
}
}
}
[04:39:24.228] Invocation finished in 2h22m52.490145622s with status FAILED