[10:20:02.609] New invocation is queued and will start shortly
[10:20:04.114] Starting the invocation (attempt 1)
[10:20:04.139] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/1275f01594831fbfbd9707337342a355a0221422"
[10:20:04.139] Popped gitiles commit info from properties and tags
[10:20:04.139] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[10:20:04.140] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[10:20:04.140] Buildbucket request:
{
"requestId": "8842282186420539904",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64PGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1275f01594831fbfbd9707337342a355a0221422",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8842282186420539904"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacArm64PGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[10:20:04.618] Scheduled build:
{
"id": "8676852124101635537",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64PGO"
},
"number": 3720,
"createdBy": "project:chromium",
"createTime": "2026-07-08T10:20:04.197330629Z",
"updateTime": "2026-07-08T10:20:04.197330629Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1275f01594831fbfbd9707337342a355a0221422",
"ref": "refs/heads/main"
}
}
}
[10:20:04.618] Task URL: https://cr-buildbucket.appspot.com/build/8676852124101635537
[10:20:04.618] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842282186420539904:2:0) after 2m21s
[10:20:05.589] Received PubSub notification, asking Buildbucket for the build status
[10:20:05.611] Build status: SCHEDULED
[10:20:10.212] Received PubSub notification, asking Buildbucket for the build status
[10:20:10.228] Build status: STARTED
[10:22:25.634] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842282186420539904:2:0)
[10:22:25.689] Build status: STARTED
[10:22:25.689] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842282186420539904:5:0) after 5m57s
[10:28:22.700] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842282186420539904:5:0)
[10:28:22.716] Build status: STARTED
[10:28:22.716] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842282186420539904:6:0) after 3m49s
[10:32:11.731] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842282186420539904:6:0)
[10:32:11.749] Build status: STARTED
[10:32:11.749] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842282186420539904:7:0) after 4m28s
[10:36:39.813] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842282186420539904:7:0)
[10:36:39.838] Build status: STARTED
[10:36:39.838] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842282186420539904:8:0) after 7m52s
[10:44:31.856] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842282186420539904:8:0)
[10:44:31.877] Build status: STARTED
[10:44:31.877] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842282186420539904:9:0) after 6m2s
[10:50:33.928] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842282186420539904:9:0)
[10:50:33.952] Build status: STARTED
[10:50:33.952] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842282186420539904:10:0) after 6m9s
[10:56:42.967] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842282186420539904:10:0)
[10:56:43.016] Build status: STARTED
[10:56:43.016] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842282186420539904:11:0) after 1m12s
[10:57:55.126] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842282186420539904:11:0)
[10:57:55.149] Build status: STARTED
[10:57:55.149] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842282186420539904:12:0) after 3m26s
[11:01:21.145] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842282186420539904:12:0)
[11:01:21.169] Build status: STARTED
[11:01:21.169] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842282186420539904:13:0) after 3m7s
[11:04:28.450] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842282186420539904:13:0)
[11:04:28.471] Build status: STARTED
[11:04:28.471] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842282186420539904:14:0) after 3m9s
[11:07:37.485] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842282186420539904:14:0)
[11:07:37.583] Build status: STARTED
[11:07:37.583] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842282186420539904:15:0) after 9m48s
[11:17:25.598] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842282186420539904:15:0)
[11:17:25.619] Build status: STARTED
[11:17:25.619] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842282186420539904:16:0) after 7m0s
[11:24:25.639] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842282186420539904:16:0)
[11:24:25.658] Build status: STARTED
[11:24:25.658] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842282186420539904:17:0) after 1m15s
[11:25:40.671] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842282186420539904:17:0)
[11:25:40.731] Build status: STARTED
[11:25:40.731] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842282186420539904:18:0) after 5m36s
[11:31:16.742] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842282186420539904:18:0)
[11:31:16.761] Build status: STARTED
[11:31:16.762] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842282186420539904:19:0) after 4m23s
[11:35:39.752] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842282186420539904:19:0)
[11:35:39.784] Build status: STARTED
[11:35:39.785] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842282186420539904:20:0) after 4m40s
[11:40:19.797] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842282186420539904:20:0)
[11:40:19.875] Build status: STARTED
[11:40:19.875] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842282186420539904:21:0) after 9m42s
[11:50:01.889] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842282186420539904:21:0)
[11:50:01.910] Build status: STARTED
[11:50:01.910] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842282186420539904:22:0) after 2m36s
[11:52:37.963] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842282186420539904:22:0)
[11:52:38.004] Build status: STARTED
[11:52:38.004] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842282186420539904:23:0) after 1m17s
[11:53:55.069] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842282186420539904:23:0)
[11:53:55.094] Build status: STARTED
[11:53:55.095] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842282186420539904:24:0) after 5m21s
[11:59:16.129] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842282186420539904:24:0)
[11:59:16.145] Build status: STARTED
[11:59:16.145] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842282186420539904:25:0) after 2m16s
[12:01:32.158] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842282186420539904:25:0)
[12:01:32.176] Build status: STARTED
[12:01:32.176] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842282186420539904:26:0) after 6m32s
[12:08:04.194] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842282186420539904:26:0)
[12:08:04.213] Build status: STARTED
[12:08:04.213] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842282186420539904:27:0) after 6m41s
[12:14:45.318] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842282186420539904:27:0)
[12:14:45.357] Build status: STARTED
[12:14:45.357] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842282186420539904:28:0) after 4m46s
[12:19:31.320] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842282186420539904:28:0)
[12:19:31.338] Build status: STARTED
[12:19:31.338] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842282186420539904:29:0) after 1m34s
[12:21:05.351] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842282186420539904:29:0)
[12:21:05.387] Build status: STARTED
[12:21:05.387] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842282186420539904:30:0) after 4m58s
[12:26:03.390] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842282186420539904:30:0)
[12:26:03.448] Build status: STARTED
[12:26:03.448] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842282186420539904:31:0) after 2m43s
[12:28:46.612] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842282186420539904:31:0)
[12:28:46.636] Build status: STARTED
[12:28:46.636] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842282186420539904:32:0) after 7m3s
[12:35:49.652] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842282186420539904:32:0)
[12:35:49.672] Build status: STARTED
[12:35:49.672] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842282186420539904:33:0) after 7m20s
[12:43:09.741] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842282186420539904:33:0)
[12:43:09.769] Build status: STARTED
[12:43:09.769] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842282186420539904:34:0) after 8m25s
[12:50:08.641] Received PubSub notification, asking Buildbucket for the build status
[12:50:08.696] Build:
{
"id": "8676852124101635537",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64PGO"
},
"number": 3720,
"createdBy": "project:chromium",
"createTime": "2026-07-08T10:20:04.197330629Z",
"startTime": "2026-07-08T10:20:09.766606602Z",
"endTime": "2026-07-08T12:50:08.283219328Z",
"updateTime": "2026-07-08T12:50:08.283219328Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1275f01594831fbfbd9707337342a355a0221422",
"ref": "refs/heads/main"
}
}
}
[12:50:08.696] Invocation finished in 2h30m6.093779661s with status FAILED