[15:06:04.080] New invocation is queued and will start shortly
[15:06:05.290] Starting the invocation (attempt 1)
[15:06:05.319] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/e4314b23548f428d459eae35a1aeb25a034738bc"
[15:06:05.319] Popped gitiles commit info from properties and tags
[15:06:05.319] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[15:06:05.319] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[15:06:05.319] Buildbucket request:
{
"requestId": "8832117331079421712",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64PGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e4314b23548f428d459eae35a1aeb25a034738bc",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8832117331079421712"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacArm64PGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[15:06:05.856] Scheduled build:
{
"id": "8666687269052196865",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64PGO"
},
"number": 6030,
"createdBy": "project:chromium",
"createTime": "2026-10-28T15:06:05.387367671Z",
"updateTime": "2026-10-28T15:06:05.387367671Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e4314b23548f428d459eae35a1aeb25a034738bc",
"ref": "refs/heads/main"
}
}
}
[15:06:05.856] Task URL: https://cr-buildbucket.appspot.com/build/8666687269052196865
[15:06:05.856] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:2:0) after 3m46s
[15:06:06.870] Received PubSub notification, asking Buildbucket for the build status
[15:06:06.905] Build status: SCHEDULED
[15:06:51.389] Received PubSub notification, asking Buildbucket for the build status
[15:06:51.429] Build status: STARTED
[15:09:51.852] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:2:0)
[15:09:51.883] Build status: STARTED
[15:09:51.883] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:5:0) after 4m38s
[15:14:29.908] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:5:0)
[15:14:30.030] Build status: STARTED
[15:14:30.030] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:6:0) after 6m36s
[15:21:06.049] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:6:0)
[15:21:06.065] Build status: STARTED
[15:21:06.065] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:7:0) after 1m36s
[15:22:42.095] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:7:0)
[15:22:42.276] Build status: STARTED
[15:22:42.276] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:8:0) after 1m58s
[15:24:40.349] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:8:0)
[15:24:40.407] Build status: STARTED
[15:24:40.407] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:9:0) after 8m41s
[15:33:21.478] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:9:0)
[15:33:21.499] Build status: STARTED
[15:33:21.499] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:10:0) after 6m3s
[15:39:24.481] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:10:0)
[15:39:24.521] Build status: STARTED
[15:39:24.521] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:11:0) after 2m55s
[15:42:19.592] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:11:0)
[15:42:19.636] Build status: STARTED
[15:42:19.636] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:12:0) after 2m11s
[15:44:30.785] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:12:0)
[15:44:30.811] Build status: STARTED
[15:44:30.812] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:13:0) after 6m32s
[15:51:02.889] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:13:0)
[15:51:02.914] Build status: STARTED
[15:51:02.914] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:14:0) after 6m53s
[15:57:55.933] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:14:0)
[15:57:55.963] Build status: STARTED
[15:57:55.963] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:15:0) after 9m52s
[16:07:48.089] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:15:0)
[16:07:48.126] Build status: STARTED
[16:07:48.126] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:16:0) after 1m42s
[16:09:30.274] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:16:0)
[16:09:30.299] Build status: STARTED
[16:09:30.299] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:17:0) after 8m39s
[16:18:09.744] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:17:0)
[16:18:09.762] Build status: STARTED
[16:18:09.763] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:18:0) after 2m8s
[16:20:18.067] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:18:0)
[16:20:18.088] Build status: STARTED
[16:20:18.088] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:19:0) after 3m28s
[16:23:46.165] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:19:0)
[16:23:46.286] Build status: STARTED
[16:23:46.286] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:20:0) after 1m57s
[16:25:43.386] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:20:0)
[16:25:43.425] Build status: STARTED
[16:25:43.425] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:21:0) after 3m31s
[16:29:14.476] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:21:0)
[16:29:14.682] Build status: STARTED
[16:29:14.682] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:22:0) after 5m16s
[16:34:30.706] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:22:0)
[16:34:30.819] Build status: STARTED
[16:34:30.819] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:23:0) after 9m11s
[16:43:41.846] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:23:0)
[16:43:41.866] Build status: STARTED
[16:43:41.866] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:24:0) after 9m20s
[16:53:01.974] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:24:0)
[16:53:01.997] Build status: STARTED
[16:53:01.997] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:25:0) after 1m32s
[16:54:34.014] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:25:0)
[16:54:34.050] Build status: STARTED
[16:54:34.050] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:26:0) after 1m25s
[16:55:59.072] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:26:0)
[16:55:59.097] Build status: STARTED
[16:55:59.097] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:27:0) after 2m49s
[16:58:48.224] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:27:0)
[16:58:48.258] Build status: STARTED
[16:58:48.258] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:28:0) after 9m26s
[17:08:14.422] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:28:0)
[17:08:14.446] Build status: STARTED
[17:08:14.446] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:29:0) after 7m54s
[17:16:08.482] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:29:0)
[17:16:08.506] Build status: STARTED
[17:16:08.506] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:30:0) after 1m14s
[17:17:22.698] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:30:0)
[17:17:22.779] Build status: STARTED
[17:17:22.780] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:31:0) after 5m58s
[17:23:20.805] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:31:0)
[17:23:20.851] Build status: STARTED
[17:23:20.851] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:32:0) after 3m39s
[17:27:00.023] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:32:0)
[17:27:00.044] Build status: STARTED
[17:27:00.044] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:33:0) after 5m7s
[17:32:07.016] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:33:0)
[17:32:07.168] Build status: STARTED
[17:32:07.168] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:34:0) after 2m10s
[17:34:17.371] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:34:0)
[17:34:17.393] Build status: STARTED
[17:34:17.393] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:35:0) after 1m27s
[17:35:44.464] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:35:0)
[17:35:44.483] Build status: STARTED
[17:35:44.483] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:36:0) after 2m12s
[17:37:56.603] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:36:0)
[17:37:56.670] Build status: STARTED
[17:37:56.670] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:37:0) after 5m0s
[17:42:56.710] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:37:0)
[17:42:56.730] Build status: STARTED
[17:42:56.730] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:38:0) after 9m39s
[17:52:35.863] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:38:0)
[17:52:35.889] Build status: STARTED
[17:52:35.889] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:39:0) after 1m26s
[17:54:01.917] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:39:0)
[17:54:01.968] Build status: STARTED
[17:54:01.968] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:40:0) after 8m43s
[18:02:45.114] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:40:0)
[18:02:45.134] Build status: STARTED
[18:02:45.134] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:41:0) after 9m10s
[18:11:55.139] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:41:0)
[18:11:55.164] Build status: STARTED
[18:11:55.164] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:42:0) after 4m45s
[18:16:40.254] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:42:0)
[18:16:40.276] Build status: STARTED
[18:16:40.276] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:43:0) after 4m3s
[18:20:43.371] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:43:0)
[18:20:43.409] Build status: STARTED
[18:20:43.409] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832117331079421712:44:0) after 2m36s
[18:22:59.871] Received PubSub notification, asking Buildbucket for the build status
[18:22:59.889] Build:
{
"id": "8666687269052196865",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64PGO"
},
"number": 6030,
"createdBy": "project:chromium",
"createTime": "2026-10-28T15:06:05.387367671Z",
"startTime": "2026-10-28T15:06:51.172427893Z",
"endTime": "2026-10-28T18:22:59.429148910Z",
"updateTime": "2026-10-28T18:22:59.429148910Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e4314b23548f428d459eae35a1aeb25a034738bc",
"ref": "refs/heads/main"
}
}
}
[18:22:59.889] Invocation finished in 3h16m55.818754309s with status FAILED