[06:51:56.344] New invocation is queued and will start shortly
[06:51:57.503] Starting the invocation (attempt 1)
[06:51:57.531] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/82492b78c96faab5bb2a6f86b5a998834def5b52"
[06:51:57.531] Popped gitiles commit info from properties and tags
[06:51:57.531] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[06:51:57.531] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[06:51:57.532] Buildbucket request:
{
"requestId": "8833507373475497968",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64PGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "82492b78c96faab5bb2a6f86b5a998834def5b52",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8833507373475497968"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacArm64PGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[06:51:58.109] Scheduled build:
{
"id": "8668077311474180161",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64PGO"
},
"number": 5848,
"createdBy": "project:chromium",
"createTime": "2026-10-13T06:51:57.631472851Z",
"updateTime": "2026-10-13T06:51:57.631472851Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "82492b78c96faab5bb2a6f86b5a998834def5b52",
"ref": "refs/heads/main"
}
}
}
[06:51:58.109] Task URL: https://cr-buildbucket.appspot.com/build/8668077311474180161
[06:51:58.109] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833507373475497968:2:0) after 9m55s
[06:51:58.206] Received PubSub notification, asking Buildbucket for the build status
[06:51:58.223] Build status: SCHEDULED
[06:52:38.551] Received PubSub notification, asking Buildbucket for the build status
[06:52:38.569] Build status: STARTED
[07:01:53.186] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833507373475497968:2:0)
[07:01:53.203] Build status: STARTED
[07:01:53.203] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833507373475497968:5:0) after 6m30s
[07:08:23.176] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833507373475497968:5:0)
[07:08:23.200] Build status: STARTED
[07:08:23.200] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833507373475497968:6:0) after 7m1s
[07:15:24.297] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833507373475497968:6:0)
[07:15:24.320] Build status: STARTED
[07:15:24.320] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833507373475497968:7:0) after 1m23s
[07:16:47.306] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833507373475497968:7:0)
[07:16:47.341] Build status: STARTED
[07:16:47.341] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833507373475497968:8:0) after 2m12s
[07:18:59.477] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833507373475497968:8:0)
[07:18:59.505] Build status: STARTED
[07:18:59.505] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833507373475497968:9:0) after 5m8s
[07:24:07.534] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833507373475497968:9:0)
[07:24:07.558] Build status: STARTED
[07:24:07.559] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833507373475497968:10:0) after 1m34s
[07:25:41.577] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833507373475497968:10:0)
[07:25:41.599] Build status: STARTED
[07:25:41.599] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833507373475497968:11:0) after 5m30s
[07:31:11.628] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833507373475497968:11:0)
[07:31:11.653] Build status: STARTED
[07:31:11.653] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833507373475497968:12:0) after 5m32s
[07:36:43.670] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833507373475497968:12:0)
[07:36:43.699] Build status: STARTED
[07:36:43.699] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833507373475497968:13:0) after 2m11s
[07:38:54.705] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833507373475497968:13:0)
[07:38:54.724] Build status: STARTED
[07:38:54.724] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833507373475497968:14:0) after 6m20s
[07:45:14.802] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833507373475497968:14:0)
[07:45:14.826] Build status: STARTED
[07:45:14.826] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833507373475497968:15:0) after 6m7s
[07:51:21.842] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833507373475497968:15:0)
[07:51:21.859] Build status: STARTED
[07:51:21.859] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833507373475497968:16:0) after 5m53s
[07:57:14.902] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833507373475497968:16:0)
[07:57:14.921] Build status: STARTED
[07:57:14.921] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833507373475497968:17:0) after 4m43s
[08:01:57.944] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833507373475497968:17:0)
[08:01:57.962] Build status: STARTED
[08:01:57.962] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833507373475497968:18:0) after 7m13s
[08:09:11.174] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833507373475497968:18:0)
[08:09:11.194] Build status: STARTED
[08:09:11.194] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833507373475497968:19:0) after 2m10s
[08:11:21.231] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833507373475497968:19:0)
[08:11:21.295] Build status: STARTED
[08:11:21.296] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833507373475497968:20:0) after 5m25s
[08:16:46.316] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833507373475497968:20:0)
[08:16:46.334] Build status: STARTED
[08:16:46.334] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833507373475497968:21:0) after 8m20s
[08:25:06.343] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833507373475497968:21:0)
[08:25:06.370] Build status: STARTED
[08:25:06.370] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833507373475497968:22:0) after 9m3s
[08:34:09.440] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833507373475497968:22:0)
[08:34:09.474] Build status: STARTED
[08:34:09.474] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833507373475497968:23:0) after 9m39s
[08:43:48.518] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833507373475497968:23:0)
[08:43:48.576] Build status: STARTED
[08:43:48.576] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833507373475497968:24:0) after 2m20s
[08:46:08.643] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833507373475497968:24:0)
[08:46:08.665] Build status: STARTED
[08:46:08.665] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833507373475497968:25:0) after 7m44s
[08:53:52.686] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833507373475497968:25:0)
[08:53:52.718] Build status: STARTED
[08:53:52.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833507373475497968:26:0) after 9m55s
[09:03:47.832] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833507373475497968:26:0)
[09:03:47.850] Build status: STARTED
[09:03:47.851] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833507373475497968:27:0) after 3m45s
[09:07:32.874] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833507373475497968:27:0)
[09:07:32.892] Build status: STARTED
[09:07:32.892] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833507373475497968:28:0) after 2m4s
[09:09:36.940] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833507373475497968:28:0)
[09:09:36.964] Build status: STARTED
[09:09:36.964] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833507373475497968:29:0) after 8m51s
[09:18:28.002] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833507373475497968:29:0)
[09:18:28.022] Build status: STARTED
[09:18:28.022] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833507373475497968:30:0) after 6m13s
[09:24:41.058] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833507373475497968:30:0)
[09:24:41.084] Build status: STARTED
[09:24:41.084] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833507373475497968:31:0) after 2m27s
[09:27:08.158] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833507373475497968:31:0)
[09:27:08.182] Build status: STARTED
[09:27:08.182] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833507373475497968:32:0) after 4m45s
[09:31:53.203] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833507373475497968:32:0)
[09:31:53.221] Build status: STARTED
[09:31:53.221] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833507373475497968:33:0) after 6m18s
[09:38:11.319] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833507373475497968:33:0)
[09:38:11.375] Build status: STARTED
[09:38:11.375] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833507373475497968:34:0) after 2m25s
[09:40:36.511] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833507373475497968:34:0)
[09:40:36.525] Build status: STARTED
[09:40:36.525] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833507373475497968:35:0) after 9m40s
[09:50:16.587] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833507373475497968:35:0)
[09:50:16.648] Build status: STARTED
[09:50:16.649] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833507373475497968:36:0) after 1m59s
[09:52:15.712] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833507373475497968:36:0)
[09:52:15.730] Build status: STARTED
[09:52:15.731] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833507373475497968:37:0) after 6m38s
[09:58:53.756] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833507373475497968:37:0)
[09:58:53.802] Build status: STARTED
[09:58:53.802] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833507373475497968:38:0) after 6m42s
[10:05:35.831] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833507373475497968:38:0)
[10:05:35.853] Build status: STARTED
[10:05:35.853] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833507373475497968:39:0) after 8m35s
[10:10:17.488] Received PubSub notification, asking Buildbucket for the build status
[10:10:17.509] Build:
{
"id": "8668077311474180161",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64PGO"
},
"number": 5848,
"createdBy": "project:chromium",
"createTime": "2026-10-13T06:51:57.631472851Z",
"startTime": "2026-10-13T06:52:38.270266887Z",
"endTime": "2026-10-13T10:10:16.826158615Z",
"updateTime": "2026-10-13T10:10:16.826158615Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "82492b78c96faab5bb2a6f86b5a998834def5b52",
"ref": "refs/heads/main"
}
}
}
[10:10:17.509] Invocation finished in 3h18m21.17064689s with status FAILED