[17:22:06.072] New invocation is queued and will start shortly
[17:22:07.127] Starting the invocation (attempt 1)
[17:22:07.150] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/0d252e04a4b5c3c901f810a9ddc1a05aa78d11ea"
[17:22:07.150] Popped gitiles commit info from properties and tags
[17:22:07.150] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[17:22:07.151] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[17:22:07.151] Buildbucket request:
{
"requestId": "8843705184305201872",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64PGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0d252e04a4b5c3c901f810a9ddc1a05aa78d11ea",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8843705184305201872"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacArm64PGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[17:22:07.845] Scheduled build:
{
"id": "8678275122429387201",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64PGO"
},
"number": 3535,
"createdBy": "project:chromium",
"createTime": "2026-06-22T17:22:07.239210173Z",
"updateTime": "2026-06-22T17:22:07.239210173Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0d252e04a4b5c3c901f810a9ddc1a05aa78d11ea",
"ref": "refs/heads/main"
}
},
"canary": true
}
[17:22:07.845] Task URL: https://cr-buildbucket.appspot.com/build/8678275122429387201
[17:22:07.845] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843705184305201872:2:0) after 4m45s
[17:22:08.648] Received PubSub notification, asking Buildbucket for the build status
[17:22:08.666] Build status: SCHEDULED
[17:22:11.089] Received PubSub notification, asking Buildbucket for the build status
[17:22:11.108] Build status: STARTED
[17:26:52.911] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843705184305201872:2:0)
[17:26:52.941] Build status: STARTED
[17:26:52.941] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843705184305201872:5:0) after 5m49s
[17:32:42.009] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843705184305201872:5:0)
[17:32:42.028] Build status: STARTED
[17:32:42.028] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843705184305201872:6:0) after 5m33s
[17:38:15.135] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843705184305201872:6:0)
[17:38:15.153] Build status: STARTED
[17:38:15.153] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843705184305201872:7:0) after 4m58s
[17:43:13.158] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843705184305201872:7:0)
[17:43:13.200] Build status: STARTED
[17:43:13.200] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843705184305201872:8:0) after 8m3s
[17:51:16.224] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843705184305201872:8:0)
[17:51:16.246] Build status: STARTED
[17:51:16.246] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843705184305201872:9:0) after 5m41s
[17:56:57.285] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843705184305201872:9:0)
[17:56:57.379] Build status: STARTED
[17:56:57.379] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843705184305201872:10:0) after 4m7s
[18:01:04.508] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843705184305201872:10:0)
[18:01:04.534] Build status: STARTED
[18:01:04.534] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843705184305201872:11:0) after 5m12s
[18:06:16.579] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843705184305201872:11:0)
[18:06:16.600] Build status: STARTED
[18:06:16.600] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843705184305201872:12:0) after 9m49s
[18:16:05.603] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843705184305201872:12:0)
[18:16:05.692] Build status: STARTED
[18:16:05.692] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843705184305201872:13:0) after 6m52s
[18:22:57.668] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843705184305201872:13:0)
[18:22:57.761] Build status: STARTED
[18:22:57.761] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843705184305201872:14:0) after 2m49s
[18:25:46.885] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843705184305201872:14:0)
[18:25:46.925] Build status: STARTED
[18:25:46.925] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843705184305201872:15:0) after 1m12s
[18:26:58.946] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843705184305201872:15:0)
[18:26:59.092] Build status: STARTED
[18:26:59.092] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843705184305201872:16:0) after 1m57s
[18:28:56.069] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843705184305201872:16:0)
[18:28:56.090] Build status: STARTED
[18:28:56.090] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843705184305201872:17:0) after 5m1s
[18:33:57.109] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843705184305201872:17:0)
[18:33:57.128] Build status: STARTED
[18:33:57.128] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843705184305201872:18:0) after 3m8s
[18:37:05.149] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843705184305201872:18:0)
[18:37:05.169] Build status: STARTED
[18:37:05.169] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843705184305201872:19:0) after 2m8s
[18:39:13.187] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843705184305201872:19:0)
[18:39:13.206] Build status: STARTED
[18:39:13.206] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843705184305201872:20:0) after 6m2s
[18:45:15.276] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843705184305201872:20:0)
[18:45:15.340] Build status: STARTED
[18:45:15.340] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843705184305201872:21:0) after 9m22s
[18:54:37.361] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843705184305201872:21:0)
[18:54:37.449] Build status: STARTED
[18:54:37.449] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843705184305201872:22:0) after 7m33s
[19:02:10.465] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843705184305201872:22:0)
[19:02:10.485] Build status: STARTED
[19:02:10.485] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843705184305201872:23:0) after 9m41s
[19:11:51.715] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843705184305201872:23:0)
[19:11:51.776] Build status: STARTED
[19:11:51.776] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843705184305201872:24:0) after 8m14s
[19:20:05.808] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843705184305201872:24:0)
[19:20:05.843] Build status: STARTED
[19:20:05.843] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843705184305201872:25:0) after 2m6s
[19:22:11.869] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843705184305201872:25:0)
[19:22:11.887] Build status: STARTED
[19:22:11.887] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843705184305201872:26:0) after 5m47s
[19:27:58.906] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843705184305201872:26:0)
[19:27:58.931] Build status: STARTED
[19:27:58.931] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843705184305201872:27:0) after 7m28s
[19:35:26.966] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843705184305201872:27:0)
[19:35:26.997] Build status: STARTED
[19:35:26.997] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843705184305201872:28:0) after 2m49s
[19:38:16.017] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843705184305201872:28:0)
[19:38:16.035] Build status: STARTED
[19:38:16.035] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843705184305201872:29:0) after 8m2s
[19:46:18.092] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843705184305201872:29:0)
[19:46:18.140] Build status: STARTED
[19:46:18.140] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843705184305201872:30:0) after 7m44s
[19:50:19.505] Received PubSub notification, asking Buildbucket for the build status
[19:50:19.548] Build:
{
"id": "8678275122429387201",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64PGO"
},
"number": 3535,
"createdBy": "project:chromium",
"createTime": "2026-06-22T17:22:07.239210173Z",
"startTime": "2026-06-22T17:22:10.877025275Z",
"endTime": "2026-06-22T19:50:19.226883935Z",
"updateTime": "2026-06-22T19:50:19.226883935Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0d252e04a4b5c3c901f810a9ddc1a05aa78d11ea",
"ref": "refs/heads/main"
}
},
"canary": true
}
[19:50:19.548] Invocation finished in 2h28m13.48121075s with status FAILED