[10:56:22.412] New invocation is queued and will start shortly
[10:56:23.649] Starting the invocation (attempt 1)
[10:56:23.675] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/f058c0e34cf281c3a5346c0b180d6f22283751ce"
[10:56:23.675] Popped gitiles commit info from properties and tags
[10:56:23.675] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[10:56:23.677] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[10:56:23.677] Buildbucket request:
{
"requestId": "8832042443526874528",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64PGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f058c0e34cf281c3a5346c0b180d6f22283751ce",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8832042443526874528"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacArm64PGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[10:56:24.175] Scheduled build:
{
"id": "8666612381475698673",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64PGO"
},
"number": 6036,
"createdBy": "project:chromium",
"createTime": "2026-10-29T10:56:23.746030849Z",
"updateTime": "2026-10-29T10:56:23.746030849Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f058c0e34cf281c3a5346c0b180d6f22283751ce",
"ref": "refs/heads/main"
}
}
}
[10:56:24.175] Task URL: https://cr-buildbucket.appspot.com/build/8666612381475698673
[10:56:24.175] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832042443526874528:2:0) after 2m29s
[10:56:25.131] Received PubSub notification, asking Buildbucket for the build status
[10:56:25.147] Build status: SCHEDULED
[10:56:29.089] Received PubSub notification, asking Buildbucket for the build status
[10:56:29.114] Build status: STARTED
[10:58:53.259] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832042443526874528:2:0)
[10:58:53.279] Build status: STARTED
[10:58:53.279] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832042443526874528:5:0) after 3m2s
[11:01:55.303] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832042443526874528:5:0)
[11:01:55.322] Build status: STARTED
[11:01:55.322] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832042443526874528:6:0) after 1m41s
[11:03:36.341] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832042443526874528:6:0)
[11:03:36.363] Build status: STARTED
[11:03:36.363] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832042443526874528:7:0) after 8m12s
[11:11:48.484] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832042443526874528:7:0)
[11:11:48.557] Build status: STARTED
[11:11:48.557] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832042443526874528:8:0) after 7m0s
[11:18:48.902] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832042443526874528:8:0)
[11:18:48.925] Build status: STARTED
[11:18:48.925] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832042443526874528:9:0) after 6m51s
[11:25:40.077] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832042443526874528:9:0)
[11:25:40.141] Build status: STARTED
[11:25:40.141] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832042443526874528:10:0) after 6m42s
[11:32:22.229] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832042443526874528:10:0)
[11:32:22.255] Build status: STARTED
[11:32:22.255] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832042443526874528:11:0) after 1m47s
[11:34:09.323] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832042443526874528:11:0)
[11:34:09.341] Build status: STARTED
[11:34:09.341] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832042443526874528:12:0) after 8m52s
[11:43:01.324] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832042443526874528:12:0)
[11:43:01.346] Build status: STARTED
[11:43:01.346] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832042443526874528:13:0) after 9m26s
[11:52:27.464] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832042443526874528:13:0)
[11:52:27.482] Build status: STARTED
[11:52:27.482] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832042443526874528:14:0) after 4m14s
[11:56:41.545] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832042443526874528:14:0)
[11:56:41.569] Build status: STARTED
[11:56:41.569] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832042443526874528:15:0) after 8m28s
[12:05:09.596] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832042443526874528:15:0)
[12:05:09.618] Build status: STARTED
[12:05:09.618] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832042443526874528:16:0) after 1m57s
[12:07:06.714] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832042443526874528:16:0)
[12:07:06.742] Build status: STARTED
[12:07:06.742] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832042443526874528:17:0) after 6m30s
[12:13:36.845] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832042443526874528:17:0)
[12:13:36.920] Build status: STARTED
[12:13:36.920] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832042443526874528:18:0) after 2m7s
[12:15:43.950] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832042443526874528:18:0)
[12:15:43.970] Build status: STARTED
[12:15:43.970] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832042443526874528:19:0) after 9m39s
[12:25:22.996] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832042443526874528:19:0)
[12:25:23.014] Build status: STARTED
[12:25:23.014] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832042443526874528:20:0) after 5m48s
[12:31:11.149] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832042443526874528:20:0)
[12:31:11.274] Build status: STARTED
[12:31:11.275] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832042443526874528:21:0) after 2m23s
[12:33:34.360] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832042443526874528:21:0)
[12:33:34.389] Build status: STARTED
[12:33:34.389] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832042443526874528:22:0) after 8m16s
[12:41:50.385] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832042443526874528:22:0)
[12:41:50.434] Build status: STARTED
[12:41:50.434] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832042443526874528:23:0) after 2m26s
[12:44:16.641] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832042443526874528:23:0)
[12:44:16.718] Build status: STARTED
[12:44:16.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832042443526874528:24:0) after 7m55s
[12:52:11.835] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832042443526874528:24:0)
[12:52:11.870] Build status: STARTED
[12:52:11.870] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832042443526874528:25:0) after 2m48s
[12:54:59.957] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832042443526874528:25:0)
[12:54:59.979] Build status: STARTED
[12:54:59.979] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832042443526874528:26:0) after 8m11s
[13:03:11.042] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832042443526874528:26:0)
[13:03:11.059] Build status: STARTED
[13:03:11.059] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832042443526874528:27:0) after 9m31s
[13:12:42.097] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832042443526874528:27:0)
[13:12:42.117] Build status: STARTED
[13:12:42.117] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832042443526874528:28:0) after 7m22s
[13:20:04.141] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832042443526874528:28:0)
[13:20:04.212] Build status: STARTED
[13:20:04.212] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832042443526874528:29:0) after 8m49s
[13:28:53.318] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832042443526874528:29:0)
[13:28:53.368] Build status: STARTED
[13:28:53.368] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832042443526874528:30:0) after 9m0s
[13:37:53.472] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832042443526874528:30:0)
[13:37:53.495] Build status: STARTED
[13:37:53.495] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832042443526874528:31:0) after 6m0s
[13:43:53.514] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832042443526874528:31:0)
[13:43:53.537] Build status: STARTED
[13:43:53.537] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832042443526874528:32:0) after 9m32s
[13:53:25.556] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832042443526874528:32:0)
[13:53:25.583] Build status: STARTED
[13:53:25.583] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832042443526874528:33:0) after 9m47s
[14:03:12.788] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832042443526874528:33:0)
[14:03:12.807] Build status: STARTED
[14:03:12.807] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832042443526874528:34:0) after 7m42s
[14:10:54.869] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832042443526874528:34:0)
[14:10:54.931] Build status: STARTED
[14:10:54.931] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832042443526874528:35:0) after 4m51s
[14:12:52.978] Received PubSub notification, asking Buildbucket for the build status
[14:12:53.102] Build:
{
"id": "8666612381475698673",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64PGO"
},
"number": 6036,
"createdBy": "project:chromium",
"createTime": "2026-10-29T10:56:23.746030849Z",
"startTime": "2026-10-29T10:56:27.237138170Z",
"endTime": "2026-10-29T14:12:52.539469056Z",
"updateTime": "2026-10-29T14:12:52.539469056Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f058c0e34cf281c3a5346c0b180d6f22283751ce",
"ref": "refs/heads/main"
}
}
}
[14:12:53.102] Invocation finished in 3h16m30.696830214s with status FAILED