[01:57:00.582] New invocation is queued and will start shortly
[01:57:02.154] Starting the invocation (attempt 1)
[01:57:02.185] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/6499f9ca93b47170a623daa4cd90b94b21e94ce9"
[01:57:02.185] Popped gitiles commit info from properties and tags
[01:57:02.185] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[01:57:02.185] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[01:57:02.185] Buildbucket request:
{
"requestId": "8843038610297715136",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64PGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "6499f9ca93b47170a623daa4cd90b94b21e94ce9",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8843038610297715136"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacArm64PGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[01:57:03.077] Scheduled build:
{
"id": "8677608547890479601",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64PGO"
},
"number": 3584,
"createdBy": "project:chromium",
"createTime": "2026-06-30T01:57:02.257582625Z",
"updateTime": "2026-06-30T01:57:02.257582625Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "6499f9ca93b47170a623daa4cd90b94b21e94ce9",
"ref": "refs/heads/main"
}
}
}
[01:57:03.077] Task URL: https://cr-buildbucket.appspot.com/build/8677608547890479601
[01:57:03.077] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843038610297715136:2:0) after 1m26s
[01:57:03.914] Received PubSub notification, asking Buildbucket for the build status
[01:57:03.931] Build status: SCHEDULED
[01:57:08.394] Received PubSub notification, asking Buildbucket for the build status
[01:57:08.408] Build status: STARTED
[01:58:29.107] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843038610297715136:2:0)
[01:58:29.142] Build status: STARTED
[01:58:29.142] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843038610297715136:5:0) after 4m18s
[02:02:47.322] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843038610297715136:5:0)
[02:02:47.344] Build status: STARTED
[02:02:47.344] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843038610297715136:6:0) after 6m1s
[02:08:48.401] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843038610297715136:6:0)
[02:08:48.486] Build status: STARTED
[02:08:48.486] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843038610297715136:7:0) after 5m42s
[02:14:30.577] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843038610297715136:7:0)
[02:14:30.591] Build status: STARTED
[02:14:30.591] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843038610297715136:8:0) after 5m27s
[02:19:57.661] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843038610297715136:8:0)
[02:19:57.718] Build status: STARTED
[02:19:57.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843038610297715136:9:0) after 4m36s
[02:24:33.781] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843038610297715136:9:0)
[02:24:33.835] Build status: STARTED
[02:24:33.835] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843038610297715136:10:0) after 2m39s
[02:27:12.859] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843038610297715136:10:0)
[02:27:12.957] Build status: STARTED
[02:27:12.957] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843038610297715136:11:0) after 5m17s
[02:32:30.067] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843038610297715136:11:0)
[02:32:30.086] Build status: STARTED
[02:32:30.086] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843038610297715136:12:0) after 7m11s
[02:39:41.107] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843038610297715136:12:0)
[02:39:41.205] Build status: STARTED
[02:39:41.205] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843038610297715136:13:0) after 5m28s
[02:45:09.180] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843038610297715136:13:0)
[02:45:09.197] Build status: STARTED
[02:45:09.197] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843038610297715136:14:0) after 6m22s
[02:51:31.242] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843038610297715136:14:0)
[02:51:31.262] Build status: STARTED
[02:51:31.262] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843038610297715136:15:0) after 9m49s
[03:01:20.326] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843038610297715136:15:0)
[03:01:20.372] Build status: STARTED
[03:01:20.372] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843038610297715136:16:0) after 6m59s
[03:08:19.394] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843038610297715136:16:0)
[03:08:19.438] Build status: STARTED
[03:08:19.438] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843038610297715136:17:0) after 9m28s
[03:17:47.481] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843038610297715136:17:0)
[03:17:47.504] Build status: STARTED
[03:17:47.504] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843038610297715136:18:0) after 4m15s
[03:22:02.533] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843038610297715136:18:0)
[03:22:02.549] Build status: STARTED
[03:22:02.549] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843038610297715136:19:0) after 2m29s
[03:24:31.607] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843038610297715136:19:0)
[03:24:31.623] Build status: STARTED
[03:24:31.623] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843038610297715136:20:0) after 5m35s
[03:30:06.695] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843038610297715136:20:0)
[03:30:06.714] Build status: STARTED
[03:30:06.714] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843038610297715136:21:0) after 8m14s
[03:38:20.736] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843038610297715136:21:0)
[03:38:20.753] Build status: STARTED
[03:38:20.753] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843038610297715136:22:0) after 4m54s
[03:43:14.812] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843038610297715136:22:0)
[03:43:14.833] Build status: STARTED
[03:43:14.833] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843038610297715136:23:0) after 4m35s
[03:47:49.947] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843038610297715136:23:0)
[03:47:50.026] Build status: STARTED
[03:47:50.026] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843038610297715136:24:0) after 9m52s
[03:57:42.145] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843038610297715136:24:0)
[03:57:42.167] Build status: STARTED
[03:57:42.167] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843038610297715136:25:0) after 9m37s
[04:07:19.192] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843038610297715136:25:0)
[04:07:19.211] Build status: STARTED
[04:07:19.211] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843038610297715136:26:0) after 1m24s
[04:08:43.269] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843038610297715136:26:0)
[04:08:43.286] Build status: STARTED
[04:08:43.286] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843038610297715136:27:0) after 1m35s
[04:10:18.355] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843038610297715136:27:0)
[04:10:18.577] Build status: STARTED
[04:10:18.577] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843038610297715136:28:0) after 7m38s
[04:17:56.598] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843038610297715136:28:0)
[04:17:56.621] Build status: STARTED
[04:17:56.621] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843038610297715136:29:0) after 7m6s
[04:25:02.644] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843038610297715136:29:0)
[04:25:02.722] Build status: STARTED
[04:25:02.722] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843038610297715136:30:0) after 8m56s
[04:33:58.741] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843038610297715136:30:0)
[04:33:58.757] Build status: STARTED
[04:33:58.757] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843038610297715136:31:0) after 3m12s
[04:37:10.844] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843038610297715136:31:0)
[04:37:10.974] Build status: STARTED
[04:37:10.974] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843038610297715136:32:0) after 8m41s
[04:45:52.172] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843038610297715136:32:0)
[04:45:52.303] Build status: STARTED
[04:45:52.303] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843038610297715136:33:0) after 3m50s
[04:49:42.332] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843038610297715136:33:0)
[04:49:42.351] Build status: STARTED
[04:49:42.351] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843038610297715136:34:0) after 8m36s
[04:58:18.350] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843038610297715136:34:0)
[04:58:18.368] Build status: STARTED
[04:58:18.368] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843038610297715136:35:0) after 7m49s
[05:00:44.131] Received PubSub notification, asking Buildbucket for the build status
[05:00:44.224] Build:
{
"id": "8677608547890479601",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64PGO"
},
"number": 3584,
"createdBy": "project:chromium",
"createTime": "2026-06-30T01:57:02.257582625Z",
"startTime": "2026-06-30T01:57:08.034708416Z",
"endTime": "2026-06-30T05:00:40.966692246Z",
"updateTime": "2026-06-30T05:00:40.966692246Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "6499f9ca93b47170a623daa4cd90b94b21e94ce9",
"ref": "refs/heads/main"
}
}
}
[05:00:44.224] Invocation finished in 3h3m43.646495442s with status FAILED