[01:08:05.479] New invocation is queued and will start shortly
[01:08:06.548] Starting the invocation (attempt 1)
[01:08:06.578] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/af5aac0e4ada76222c9bd7f0dd7f34249cf5b94d"
[01:08:06.578] Popped gitiles commit info from properties and tags
[01:08:06.578] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[01:08:06.578] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[01:08:06.578] Buildbucket request:
{
"requestId": "8848930490792116480",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64PGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "af5aac0e4ada76222c9bd7f0dd7f34249cf5b94d",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8848930490792116480"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacArm64PGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[01:08:07.228] Scheduled build:
{
"id": "8683500428924006417",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64PGO"
},
"number": 2475,
"createdBy": "project:chromium",
"createTime": "2026-04-26T01:08:06.640381807Z",
"updateTime": "2026-04-26T01:08:06.640381807Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "af5aac0e4ada76222c9bd7f0dd7f34249cf5b94d",
"ref": "refs/heads/main"
}
}
}
[01:08:07.228] Task URL: https://cr-buildbucket.appspot.com/build/8683500428924006417
[01:08:07.228] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:2:0) after 5m37s
[01:08:08.160] Received PubSub notification, asking Buildbucket for the build status
[01:08:08.175] Build status: SCHEDULED
[01:08:10.324] Received PubSub notification, asking Buildbucket for the build status
[01:08:10.349] Build status: STARTED
[01:13:44.244] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:2:0)
[01:13:44.265] Build status: STARTED
[01:13:44.265] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:5:0) after 4m53s
[01:18:37.277] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:5:0)
[01:18:37.292] Build status: STARTED
[01:18:37.292] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:6:0) after 9m51s
[01:28:28.698] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:6:0)
[01:28:28.758] Build status: STARTED
[01:28:28.758] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:7:0) after 1m12s
[01:29:40.799] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:7:0)
[01:29:40.820] Build status: STARTED
[01:29:40.820] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:8:0) after 6m17s
[01:35:57.911] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:8:0)
[01:35:57.940] Build status: STARTED
[01:35:57.940] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:9:0) after 7m17s
[01:43:15.019] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:9:0)
[01:43:15.043] Build status: STARTED
[01:43:15.043] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:10:0) after 8m14s
[01:51:29.203] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:10:0)
[01:51:29.219] Build status: STARTED
[01:51:29.219] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:11:0) after 7m32s
[01:59:01.237] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:11:0)
[01:59:01.254] Build status: STARTED
[01:59:01.254] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:12:0) after 3m36s
[02:02:37.396] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:12:0)
[02:02:37.412] Build status: STARTED
[02:02:37.412] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:13:0) after 4m40s
[02:07:17.427] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:13:0)
[02:07:17.557] Build status: STARTED
[02:07:17.557] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:14:0) after 2m44s
[02:10:01.771] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:14:0)
[02:10:01.790] Build status: STARTED
[02:10:01.790] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:15:0) after 2m28s
[02:12:29.909] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:15:0)
[02:12:29.941] Build status: STARTED
[02:12:29.941] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:16:0) after 5m2s
[02:17:32.234] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:16:0)
[02:17:32.253] Build status: STARTED
[02:17:32.253] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:17:0) after 4m32s
[02:22:04.335] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:17:0)
[02:22:04.357] Build status: STARTED
[02:22:04.357] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:18:0) after 4m49s
[02:26:53.379] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:18:0)
[02:26:53.408] Build status: STARTED
[02:26:53.408] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:19:0) after 3m34s
[02:30:27.558] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:19:0)
[02:30:27.706] Build status: STARTED
[02:30:27.706] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:20:0) after 8m55s
[02:39:22.727] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:20:0)
[02:39:22.773] Build status: STARTED
[02:39:22.774] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:21:0) after 6m41s
[02:46:03.824] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:21:0)
[02:46:03.870] Build status: STARTED
[02:46:03.871] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:22:0) after 7m1s
[02:53:05.013] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:22:0)
[02:53:05.033] Build status: STARTED
[02:53:05.033] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:23:0) after 9m29s
[03:02:34.171] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:23:0)
[03:02:34.229] Build status: STARTED
[03:02:34.229] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:24:0) after 7m13s
[03:09:47.349] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:24:0)
[03:09:47.369] Build status: STARTED
[03:09:47.369] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:25:0) after 5m33s
[03:15:20.383] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:25:0)
[03:15:20.412] Build status: STARTED
[03:15:20.412] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:26:0) after 9m26s
[03:24:46.433] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:26:0)
[03:24:46.451] Build status: STARTED
[03:24:46.451] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:27:0) after 3m8s
[03:27:54.924] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:27:0)
[03:27:54.944] Build status: STARTED
[03:27:54.944] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:28:0) after 3m49s
[03:31:43.997] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:28:0)
[03:31:44.016] Build status: STARTED
[03:31:44.016] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:29:0) after 1m8s
[03:32:52.175] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:29:0)
[03:32:52.194] Build status: STARTED
[03:32:52.194] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:30:0) after 8m30s
[03:41:22.215] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:30:0)
[03:41:22.228] Build status: STARTED
[03:41:22.228] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:31:0) after 8m42s
[03:50:04.241] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:31:0)
[03:50:04.256] Build status: STARTED
[03:50:04.257] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:32:0) after 5m33s
[03:55:37.438] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:32:0)
[03:55:37.457] Build status: STARTED
[03:55:37.457] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:33:0) after 5m32s
[04:01:09.545] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:33:0)
[04:01:09.562] Build status: STARTED
[04:01:09.562] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:34:0) after 1m0s
[04:02:09.578] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:34:0)
[04:02:09.598] Build status: STARTED
[04:02:09.598] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:35:0) after 9m14s
[04:11:23.713] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:35:0)
[04:11:23.763] Build status: STARTED
[04:11:23.763] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:36:0) after 7m46s
[04:19:09.783] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:36:0)
[04:19:09.799] Build status: STARTED
[04:19:09.799] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:37:0) after 3m2s
[04:22:11.816] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:37:0)
[04:22:11.834] Build status: STARTED
[04:22:11.834] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:38:0) after 2m29s
[04:24:40.858] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:38:0)
[04:24:40.902] Build status: STARTED
[04:24:40.902] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:39:0) after 9m18s
[04:33:58.982] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:39:0)
[04:33:59.017] Build status: STARTED
[04:33:59.017] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:40:0) after 3m6s
[04:37:05.268] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:40:0)
[04:37:05.288] Build status: STARTED
[04:37:05.288] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:41:0) after 2m31s
[04:39:36.309] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:41:0)
[04:39:36.336] Build status: STARTED
[04:39:36.336] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:42:0) after 9m58s
[04:49:34.358] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:42:0)
[04:49:34.372] Build status: STARTED
[04:49:34.372] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848930490792116480:43:0) after 8m49s
[04:58:19.874] Received PubSub notification, asking Buildbucket for the build status
[04:58:19.921] Build:
{
"id": "8683500428924006417",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64PGO"
},
"number": 2475,
"createdBy": "project:chromium",
"createTime": "2026-04-26T01:08:06.640381807Z",
"startTime": "2026-04-26T01:08:10.160520156Z",
"endTime": "2026-04-26T04:58:17.659364786Z",
"updateTime": "2026-04-26T04:58:17.659364786Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "af5aac0e4ada76222c9bd7f0dd7f34249cf5b94d",
"ref": "refs/heads/main"
}
}
}
[04:58:19.921] Invocation finished in 3h50m14.445583655s with status FAILED