[06:11:54.303] New invocation is queued and will start shortly
[06:11:55.619] Starting the invocation (attempt 1)
[06:11:55.649] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/7a2eb274e08504ee76ec6182b033472c709dc4f6"
[06:11:55.649] Popped gitiles commit info from properties and tags
[06:11:55.649] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[06:11:55.649] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[06:11:55.649] Buildbucket request:
{
"requestId": "8833419295232606864",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64PGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7a2eb274e08504ee76ec6182b033472c709dc4f6",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8833419295232606864"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacArm64PGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[06:11:56.265] Scheduled build:
{
"id": "8667989233077189697",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64PGO"
},
"number": 5855,
"createdBy": "project:chromium",
"createTime": "2026-10-14T06:11:55.736592164Z",
"updateTime": "2026-10-14T06:11:55.736592164Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7a2eb274e08504ee76ec6182b033472c709dc4f6",
"ref": "refs/heads/main"
}
}
}
[06:11:56.265] Task URL: https://cr-buildbucket.appspot.com/build/8667989233077189697
[06:11:56.265] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:2:0) after 2m5s
[06:11:57.138] Received PubSub notification, asking Buildbucket for the build status
[06:11:57.158] Build status: SCHEDULED
[06:11:59.718] Received PubSub notification, asking Buildbucket for the build status
[06:11:59.733] Build status: STARTED
[06:14:01.413] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:2:0)
[06:14:01.431] Build status: STARTED
[06:14:01.432] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:5:0) after 8m48s
[06:22:49.762] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:5:0)
[06:22:49.783] Build status: STARTED
[06:22:49.783] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:6:0) after 4m11s
[06:27:00.874] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:6:0)
[06:27:00.899] Build status: STARTED
[06:27:00.899] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:7:0) after 1m48s
[06:28:49.245] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:7:0)
[06:28:49.266] Build status: STARTED
[06:28:49.266] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:8:0) after 5m51s
[06:34:40.430] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:8:0)
[06:34:40.452] Build status: STARTED
[06:34:40.452] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:9:0) after 1m53s
[06:36:33.562] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:9:0)
[06:36:33.586] Build status: STARTED
[06:36:33.586] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:10:0) after 4m9s
[06:40:42.599] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:10:0)
[06:40:42.621] Build status: STARTED
[06:40:42.621] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:11:0) after 2m37s
[06:43:19.620] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:11:0)
[06:43:19.649] Build status: STARTED
[06:43:19.649] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:12:0) after 8m4s
[06:51:23.693] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:12:0)
[06:51:23.725] Build status: STARTED
[06:51:23.725] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:13:0) after 5m22s
[06:56:45.745] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:13:0)
[06:56:45.787] Build status: STARTED
[06:56:45.787] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:14:0) after 3m23s
[07:00:08.837] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:14:0)
[07:00:08.859] Build status: STARTED
[07:00:08.859] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:15:0) after 7m6s
[07:07:14.875] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:15:0)
[07:07:14.898] Build status: STARTED
[07:07:14.898] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:16:0) after 9m18s
[07:16:32.971] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:16:0)
[07:16:32.993] Build status: STARTED
[07:16:32.993] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:17:0) after 4m24s
[07:20:57.009] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:17:0)
[07:20:57.037] Build status: STARTED
[07:20:57.037] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:18:0) after 8m39s
[07:29:36.060] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:18:0)
[07:29:36.077] Build status: STARTED
[07:29:36.077] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:19:0) after 1m50s
[07:31:26.092] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:19:0)
[07:31:26.112] Build status: STARTED
[07:31:26.113] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:20:0) after 2m41s
[07:34:07.175] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:20:0)
[07:34:07.235] Build status: STARTED
[07:34:07.235] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:21:0) after 1m50s
[07:35:57.275] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:21:0)
[07:35:57.447] Build status: STARTED
[07:35:57.447] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:22:0) after 3m3s
[07:39:00.596] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:22:0)
[07:39:00.618] Build status: STARTED
[07:39:00.618] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:23:0) after 2m39s
[07:41:39.633] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:23:0)
[07:41:39.718] Build status: STARTED
[07:41:39.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:24:0) after 5m44s
[07:47:23.756] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:24:0)
[07:47:23.804] Build status: STARTED
[07:47:23.804] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:25:0) after 6m58s
[07:54:21.833] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:25:0)
[07:54:21.855] Build status: STARTED
[07:54:21.855] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:26:0) after 2m13s
[07:56:34.864] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:26:0)
[07:56:34.887] Build status: STARTED
[07:56:34.887] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:27:0) after 1m50s
[07:58:24.910] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:27:0)
[07:58:24.927] Build status: STARTED
[07:58:24.928] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:28:0) after 2m53s
[08:01:18.009] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:28:0)
[08:01:18.036] Build status: STARTED
[08:01:18.036] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:29:0) after 7m11s
[08:08:29.106] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:29:0)
[08:08:29.125] Build status: STARTED
[08:08:29.125] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:30:0) after 8m6s
[08:16:35.193] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:30:0)
[08:16:35.231] Build status: STARTED
[08:16:35.231] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:31:0) after 1m52s
[08:18:27.249] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:31:0)
[08:18:27.314] Build status: STARTED
[08:18:27.314] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:32:0) after 4m44s
[08:23:11.302] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:32:0)
[08:23:11.322] Build status: STARTED
[08:23:11.322] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:33:0) after 1m26s
[08:24:37.376] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:33:0)
[08:24:37.405] Build status: STARTED
[08:24:37.405] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:34:0) after 6m24s
[08:31:01.474] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:34:0)
[08:31:01.553] Build status: STARTED
[08:31:01.553] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:35:0) after 1m20s
[08:32:21.609] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:35:0)
[08:32:21.647] Build status: STARTED
[08:32:21.647] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:36:0) after 5m57s
[08:38:18.768] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:36:0)
[08:38:18.791] Build status: STARTED
[08:38:18.791] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:37:0) after 7m39s
[08:45:57.842] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:37:0)
[08:45:57.917] Build status: STARTED
[08:45:57.917] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:38:0) after 6m44s
[08:52:42.024] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:38:0)
[08:52:42.046] Build status: STARTED
[08:52:42.046] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:39:0) after 7m54s
[09:00:36.220] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:39:0)
[09:00:36.252] Build status: STARTED
[09:00:36.252] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:40:0) after 7m8s
[09:07:44.269] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:40:0)
[09:07:44.289] Build status: STARTED
[09:07:44.289] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:41:0) after 8m36s
[09:16:20.402] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:41:0)
[09:16:20.422] Build status: STARTED
[09:16:20.422] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:42:0) after 5m55s
[09:22:15.487] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:42:0)
[09:22:15.514] Build status: STARTED
[09:22:15.514] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:43:0) after 6m53s
[09:29:08.573] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:43:0)
[09:29:08.594] Build status: STARTED
[09:29:08.594] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833419295232606864:44:0) after 7m54s
[09:31:07.184] Received PubSub notification, asking Buildbucket for the build status
[09:31:07.212] Build:
{
"id": "8667989233077189697",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64PGO"
},
"number": 5855,
"createdBy": "project:chromium",
"createTime": "2026-10-14T06:11:55.736592164Z",
"startTime": "2026-10-14T06:11:59.515430246Z",
"endTime": "2026-10-14T09:30:56.941283604Z",
"updateTime": "2026-10-14T09:30:56.941283604Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7a2eb274e08504ee76ec6182b033472c709dc4f6",
"ref": "refs/heads/main"
}
}
}
[09:31:07.212] Invocation finished in 3h19m12.915229126s with status FAILED