[08:24:19.417] New invocation is queued and will start shortly
[08:24:20.696] Starting the invocation (attempt 1)
[08:24:20.729] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/13919375d539d354af3b104c2e2a442f8c2d48d4"
[08:24:20.729] Popped gitiles commit info from properties and tags
[08:24:20.729] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[08:24:20.729] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[08:24:20.729] Buildbucket request:
{
"requestId": "8856241399717883200",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64PGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "13919375d539d354af3b104c2e2a442f8c2d48d4",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8856241399717883200"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacArm64PGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[08:24:21.200] Scheduled build:
{
"id": "8690811337602867121",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64PGO"
},
"number": 1288,
"createdBy": "project:chromium",
"createTime": "2026-02-04T08:24:20.803645483Z",
"updateTime": "2026-02-04T08:24:20.803645483Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "13919375d539d354af3b104c2e2a442f8c2d48d4",
"ref": "refs/heads/main"
}
}
}
[08:24:21.200] Task URL: https://cr-buildbucket.appspot.com/build/8690811337602867121
[08:24:21.200] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:2:0) after 5m35s
[08:24:22.168] Received PubSub notification, asking Buildbucket for the build status
[08:24:22.195] Build status: SCHEDULED
[08:24:24.631] Received PubSub notification, asking Buildbucket for the build status
[08:24:24.678] Build status: STARTED
[08:29:56.251] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:2:0)
[08:29:56.265] Build status: STARTED
[08:29:56.265] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:5:0) after 3m19s
[08:33:15.344] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:5:0)
[08:33:15.360] Build status: STARTED
[08:33:15.360] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:6:0) after 5m33s
[08:38:48.431] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:6:0)
[08:38:48.462] Build status: STARTED
[08:38:48.462] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:7:0) after 6m41s
[08:45:29.528] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:7:0)
[08:45:29.548] Build status: STARTED
[08:45:29.548] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:8:0) after 8m23s
[08:53:52.570] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:8:0)
[08:53:52.585] Build status: STARTED
[08:53:52.585] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:9:0) after 2m7s
[08:55:59.606] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:9:0)
[08:55:59.622] Build status: STARTED
[08:55:59.622] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:10:0) after 9m26s
[09:05:25.690] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:10:0)
[09:05:25.705] Build status: STARTED
[09:05:25.705] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:11:0) after 7m15s
[09:12:40.747] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:11:0)
[09:12:40.780] Build status: STARTED
[09:12:40.780] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:12:0) after 7m1s
[09:19:41.800] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:12:0)
[09:19:41.822] Build status: STARTED
[09:19:41.822] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:13:0) after 1m18s
[09:20:59.822] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:13:0)
[09:20:59.842] Build status: STARTED
[09:20:59.842] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:14:0) after 7m48s
[09:28:47.911] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:14:0)
[09:28:47.938] Build status: STARTED
[09:28:47.938] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:15:0) after 7m57s
[09:36:44.955] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:15:0)
[09:36:44.976] Build status: STARTED
[09:36:44.976] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:16:0) after 1m25s
[09:38:10.041] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:16:0)
[09:38:10.058] Build status: STARTED
[09:38:10.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:17:0) after 6m41s
[09:44:51.138] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:17:0)
[09:44:51.155] Build status: STARTED
[09:44:51.155] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:18:0) after 3m38s
[09:48:29.227] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:18:0)
[09:48:29.256] Build status: STARTED
[09:48:29.256] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:19:0) after 9m44s
[09:58:13.281] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:19:0)
[09:58:13.295] Build status: STARTED
[09:58:13.295] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:20:0) after 7m4s
[10:05:17.264] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:20:0)
[10:05:17.278] Build status: STARTED
[10:05:17.278] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:21:0) after 6m7s
[10:11:24.323] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:21:0)
[10:11:24.338] Build status: STARTED
[10:11:24.338] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:22:0) after 5m32s
[10:16:56.354] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:22:0)
[10:16:56.369] Build status: STARTED
[10:16:56.370] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:23:0) after 5m31s
[10:22:27.388] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:23:0)
[10:22:27.402] Build status: STARTED
[10:22:27.402] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:24:0) after 2m39s
[10:25:06.441] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:24:0)
[10:25:06.455] Build status: STARTED
[10:25:06.455] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:25:0) after 6m18s
[10:31:24.524] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:25:0)
[10:31:24.542] Build status: STARTED
[10:31:24.542] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:26:0) after 5m37s
[10:37:01.561] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:26:0)
[10:37:01.601] Build status: STARTED
[10:37:01.601] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:27:0) after 5m45s
[10:42:46.589] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:27:0)
[10:42:46.603] Build status: STARTED
[10:42:46.603] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:28:0) after 5m46s
[10:48:32.637] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:28:0)
[10:48:32.651] Build status: STARTED
[10:48:32.651] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:29:0) after 7m4s
[10:55:36.622] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:29:0)
[10:55:36.772] Build status: STARTED
[10:55:36.772] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:30:0) after 5m23s
[11:00:59.785] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:30:0)
[11:00:59.846] Build status: STARTED
[11:00:59.846] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:31:0) after 4m47s
[11:05:46.861] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:31:0)
[11:05:46.884] Build status: STARTED
[11:05:46.884] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:32:0) after 4m48s
[11:10:34.952] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:32:0)
[11:10:34.968] Build status: STARTED
[11:10:34.968] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:33:0) after 7m8s
[11:17:42.991] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:33:0)
[11:17:43.022] Build status: STARTED
[11:17:43.022] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:34:0) after 7m55s
[11:25:38.008] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:34:0)
[11:25:38.026] Build status: STARTED
[11:25:38.026] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:35:0) after 4m17s
[11:29:55.047] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:35:0)
[11:29:55.083] Build status: STARTED
[11:29:55.083] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:36:0) after 2m7s
[11:32:02.143] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:36:0)
[11:32:02.173] Build status: STARTED
[11:32:02.174] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:37:0) after 7m54s
[11:39:56.179] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:37:0)
[11:39:56.194] Build status: STARTED
[11:39:56.194] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:38:0) after 8m29s
[11:48:25.310] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:38:0)
[11:48:25.324] Build status: STARTED
[11:48:25.324] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:39:0) after 4m4s
[11:52:29.349] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:39:0)
[11:52:29.365] Build status: STARTED
[11:52:29.365] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:40:0) after 4m17s
[11:56:46.382] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:40:0)
[11:56:46.451] Build status: STARTED
[11:56:46.451] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:41:0) after 3m6s
[11:59:52.468] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:41:0)
[11:59:52.505] Build status: STARTED
[11:59:52.505] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:42:0) after 6m56s
[12:06:48.523] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:42:0)
[12:06:48.570] Build status: STARTED
[12:06:48.570] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:43:0) after 3m17s
[12:10:05.671] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:43:0)
[12:10:05.706] Build status: STARTED
[12:10:05.706] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:44:0) after 7m55s
[12:18:00.685] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:44:0)
[12:18:00.712] Build status: STARTED
[12:18:00.712] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:45:0) after 3m1s
[12:21:01.734] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:45:0)
[12:21:01.749] Build status: STARTED
[12:21:01.749] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:46:0) after 6m49s
[12:27:50.766] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:46:0)
[12:27:50.791] Build status: STARTED
[12:27:50.791] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:47:0) after 4m21s
[12:32:11.809] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:47:0)
[12:32:11.831] Build status: STARTED
[12:32:11.831] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:48:0) after 7m38s
[12:39:50.029] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:48:0)
[12:39:50.052] Build status: STARTED
[12:39:50.052] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:49:0) after 2m53s
[12:42:43.033] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:49:0)
[12:42:43.045] Build status: STARTED
[12:42:43.045] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:50:0) after 3m12s
[12:45:55.064] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:50:0)
[12:45:55.077] Build status: STARTED
[12:45:55.077] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:51:0) after 9m49s
[12:55:44.151] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:51:0)
[12:55:44.171] Build status: STARTED
[12:55:44.171] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:52:0) after 1m4s
[12:56:48.180] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:52:0)
[12:56:48.211] Build status: STARTED
[12:56:48.211] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:53:0) after 7m54s
[13:04:42.275] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:53:0)
[13:04:42.296] Build status: STARTED
[13:04:42.296] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:54:0) after 1m8s
[13:05:50.317] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:54:0)
[13:05:50.342] Build status: STARTED
[13:05:50.342] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:55:0) after 1m30s
[13:07:20.357] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:55:0)
[13:07:20.383] Build status: STARTED
[13:07:20.383] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:56:0) after 1m14s
[13:08:34.468] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:56:0)
[13:08:34.541] Build status: STARTED
[13:08:34.541] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:57:0) after 8m31s
[13:17:05.560] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:57:0)
[13:17:05.577] Build status: STARTED
[13:17:05.577] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:58:0) after 8m48s
[13:25:53.597] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:58:0)
[13:25:53.614] Build status: STARTED
[13:25:53.614] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:59:0) after 5m14s
[13:31:07.677] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:59:0)
[13:31:07.693] Build status: STARTED
[13:31:07.693] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:60:0) after 2m20s
[13:33:27.679] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:60:0)
[13:33:27.696] Build status: STARTED
[13:33:27.696] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:61:0) after 3m5s
[13:36:32.728] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:61:0)
[13:36:32.750] Build status: STARTED
[13:36:32.750] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:62:0) after 1m35s
[13:38:07.726] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:62:0)
[13:38:07.743] Build status: STARTED
[13:38:07.743] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:63:0) after 6m41s
[13:44:48.792] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:63:0)
[13:44:48.812] Build status: STARTED
[13:44:48.813] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8856241399717883200:64:0) after 3m12s
[13:46:33.711] Received PubSub notification, asking Buildbucket for the build status
[13:46:33.734] Build:
{
"id": "8690811337602867121",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64PGO"
},
"number": 1288,
"createdBy": "project:chromium",
"createTime": "2026-02-04T08:24:20.803645483Z",
"startTime": "2026-02-04T08:24:24.434617602Z",
"endTime": "2026-02-04T13:46:14.147280229Z",
"updateTime": "2026-02-04T13:46:14.147280229Z",
"status": "SUCCESS",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "13919375d539d354af3b104c2e2a442f8c2d48d4",
"ref": "refs/heads/main"
}
}
}
[13:46:33.734] Invocation finished in 5h22m14.331443604s with status SUCCEEDED