[05:37:34.917] New invocation is queued and will start shortly
[05:37:36.010] Starting the invocation (attempt 1)
[05:37:36.037] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/b0bb31350a5ac380ed6c01788d3e1dbc6e9504b4"
[05:37:36.037] Popped gitiles commit info from properties and tags
[05:37:36.037] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[05:37:36.037] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[05:37:36.038] Buildbucket request:
{
"requestId": "8841122196799004672",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64PGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b0bb31350a5ac380ed6c01788d3e1dbc6e9504b4",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8841122196799004672"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacArm64PGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[05:37:36.640] Scheduled build:
{
"id": "8675692134880241329",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64PGO"
},
"number": 3896,
"createdBy": "project:chromium",
"createTime": "2026-07-21T05:37:36.125437276Z",
"updateTime": "2026-07-21T05:37:36.125437276Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b0bb31350a5ac380ed6c01788d3e1dbc6e9504b4",
"ref": "refs/heads/main"
}
}
}
[05:37:36.640] Task URL: https://cr-buildbucket.appspot.com/build/8675692134880241329
[05:37:36.640] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841122196799004672:2:0) after 9m12s
[05:37:37.532] Received PubSub notification, asking Buildbucket for the build status
[05:37:37.555] Build status: SCHEDULED
[05:38:18.013] Received PubSub notification, asking Buildbucket for the build status
[05:38:18.126] Build status: STARTED
[05:46:48.611] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841122196799004672:2:0)
[05:46:48.629] Build status: STARTED
[05:46:48.629] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841122196799004672:5:0) after 2m19s
[05:49:07.706] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841122196799004672:5:0)
[05:49:07.724] Build status: STARTED
[05:49:07.724] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841122196799004672:6:0) after 6m47s
[05:55:54.741] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841122196799004672:6:0)
[05:55:54.767] Build status: STARTED
[05:55:54.767] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841122196799004672:7:0) after 5m22s
[06:01:16.826] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841122196799004672:7:0)
[06:01:16.845] Build status: STARTED
[06:01:16.845] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841122196799004672:8:0) after 3m23s
[06:04:39.865] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841122196799004672:8:0)
[06:04:39.888] Build status: STARTED
[06:04:39.888] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841122196799004672:9:0) after 7m45s
[06:12:24.904] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841122196799004672:9:0)
[06:12:24.924] Build status: STARTED
[06:12:24.924] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841122196799004672:10:0) after 5m31s
[06:17:55.940] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841122196799004672:10:0)
[06:17:55.958] Build status: STARTED
[06:17:55.958] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841122196799004672:11:0) after 2m52s
[06:20:47.998] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841122196799004672:11:0)
[06:20:48.063] Build status: STARTED
[06:20:48.063] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841122196799004672:12:0) after 9m1s
[06:29:49.116] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841122196799004672:12:0)
[06:29:49.135] Build status: STARTED
[06:29:49.135] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841122196799004672:13:0) after 7m8s
[06:36:57.154] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841122196799004672:13:0)
[06:36:57.175] Build status: STARTED
[06:36:57.175] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841122196799004672:14:0) after 9m25s
[06:46:22.197] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841122196799004672:14:0)
[06:46:22.219] Build status: STARTED
[06:46:22.219] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841122196799004672:15:0) after 2m46s
[06:49:08.288] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841122196799004672:15:0)
[06:49:08.310] Build status: STARTED
[06:49:08.310] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841122196799004672:16:0) after 5m31s
[06:54:39.503] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841122196799004672:16:0)
[06:54:39.534] Build status: STARTED
[06:54:39.534] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841122196799004672:17:0) after 4m23s
[06:59:02.558] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841122196799004672:17:0)
[06:59:02.579] Build status: STARTED
[06:59:02.580] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841122196799004672:18:0) after 6m32s
[07:05:34.655] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841122196799004672:18:0)
[07:05:34.680] Build status: STARTED
[07:05:34.680] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841122196799004672:19:0) after 3m5s
[07:08:39.699] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841122196799004672:19:0)
[07:08:39.717] Build status: STARTED
[07:08:39.717] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841122196799004672:20:0) after 8m32s
[07:17:11.736] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841122196799004672:20:0)
[07:17:11.774] Build status: STARTED
[07:17:11.774] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841122196799004672:21:0) after 6m40s
[07:23:51.796] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841122196799004672:21:0)
[07:23:51.818] Build status: STARTED
[07:23:51.819] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841122196799004672:22:0) after 4m53s
[07:28:44.838] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841122196799004672:22:0)
[07:28:44.863] Build status: STARTED
[07:28:44.863] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841122196799004672:23:0) after 1m53s
[07:30:37.879] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841122196799004672:23:0)
[07:30:37.898] Build status: STARTED
[07:30:37.898] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841122196799004672:24:0) after 2m41s
[07:33:18.917] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841122196799004672:24:0)
[07:33:18.940] Build status: STARTED
[07:33:18.940] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841122196799004672:25:0) after 2m46s
[07:36:05.005] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841122196799004672:25:0)
[07:36:05.028] Build status: STARTED
[07:36:05.029] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841122196799004672:26:0) after 1m23s
[07:37:28.011] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841122196799004672:26:0)
[07:37:28.061] Build status: STARTED
[07:37:28.061] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841122196799004672:27:0) after 9m48s
[07:47:16.087] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841122196799004672:27:0)
[07:47:16.118] Build status: STARTED
[07:47:16.118] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841122196799004672:28:0) after 5m43s
[07:52:59.135] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841122196799004672:28:0)
[07:52:59.153] Build status: STARTED
[07:52:59.153] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841122196799004672:29:0) after 4m26s
[07:57:25.168] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841122196799004672:29:0)
[07:57:25.209] Build status: STARTED
[07:57:25.209] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841122196799004672:30:0) after 9m46s
[08:07:11.203] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841122196799004672:30:0)
[08:07:11.220] Build status: STARTED
[08:07:11.220] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841122196799004672:31:0) after 7m55s
[08:15:06.283] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841122196799004672:31:0)
[08:15:06.421] Build status: STARTED
[08:15:06.421] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841122196799004672:32:0) after 7m43s
[08:22:49.533] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841122196799004672:32:0)
[08:22:49.583] Build status: STARTED
[08:22:49.583] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841122196799004672:33:0) after 2m33s
[08:25:22.599] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841122196799004672:33:0)
[08:25:22.627] Build status: STARTED
[08:25:22.627] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841122196799004672:34:0) after 8m1s
[08:33:23.692] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841122196799004672:34:0)
[08:33:23.720] Build status: STARTED
[08:33:23.720] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841122196799004672:35:0) after 9m49s
[08:43:12.987] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841122196799004672:35:0)
[08:43:13.022] Build status: STARTED
[08:43:13.022] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8841122196799004672:36:0) after 9m16s
[08:46:31.484] Received PubSub notification, asking Buildbucket for the build status
[08:46:31.500] Build:
{
"id": "8675692134880241329",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64PGO"
},
"number": 3896,
"createdBy": "project:chromium",
"createTime": "2026-07-21T05:37:36.125437276Z",
"startTime": "2026-07-21T05:38:17.750487123Z",
"endTime": "2026-07-21T08:46:07.840472115Z",
"updateTime": "2026-07-21T08:46:07.840472115Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b0bb31350a5ac380ed6c01788d3e1dbc6e9504b4",
"ref": "refs/heads/main"
}
}
}
[08:46:31.500] Invocation finished in 3h8m56.589017939s with status FAILED