[08:04:43.081] New invocation is queued and will start shortly
[08:04:44.274] Starting the invocation (attempt 1)
[08:04:44.305] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/dd05f3af4c8b4b1bb3580ecc7189eb6f2862bf28"
[08:04:44.305] Popped gitiles commit info from properties and tags
[08:04:44.305] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[08:04:44.306] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[08:04:44.306] Buildbucket request:
{
"requestId": "8843015476091904768",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64PGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "dd05f3af4c8b4b1bb3580ecc7189eb6f2862bf28",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8843015476091904768"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacArm64PGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[08:04:45.570] Scheduled build:
{
"id": "8677585413697676673",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64PGO"
},
"number": 3586,
"createdBy": "project:chromium",
"createTime": "2026-06-30T08:04:44.743473595Z",
"updateTime": "2026-06-30T08:04:44.743473595Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "dd05f3af4c8b4b1bb3580ecc7189eb6f2862bf28",
"ref": "refs/heads/main"
}
},
"canary": true
}
[08:04:45.570] Task URL: https://cr-buildbucket.appspot.com/build/8677585413697676673
[08:04:45.571] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843015476091904768:2:0) after 8m23s
[08:04:46.487] Received PubSub notification, asking Buildbucket for the build status
[08:04:46.627] Build status: SCHEDULED
[08:05:35.594] Received PubSub notification, asking Buildbucket for the build status
[08:05:35.611] Build status: STARTED
[08:13:08.571] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843015476091904768:2:0)
[08:13:08.590] Build status: STARTED
[08:13:08.591] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843015476091904768:5:0) after 6m46s
[08:19:54.609] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843015476091904768:5:0)
[08:19:54.655] Build status: STARTED
[08:19:54.656] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843015476091904768:6:0) after 5m32s
[08:25:26.625] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843015476091904768:6:0)
[08:25:26.648] Build status: STARTED
[08:25:26.648] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843015476091904768:7:0) after 1m28s
[08:26:54.660] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843015476091904768:7:0)
[08:26:54.711] Build status: STARTED
[08:26:54.711] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843015476091904768:8:0) after 4m33s
[08:31:27.800] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843015476091904768:8:0)
[08:31:27.820] Build status: STARTED
[08:31:27.820] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843015476091904768:9:0) after 3m20s
[08:34:47.882] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843015476091904768:9:0)
[08:34:47.901] Build status: STARTED
[08:34:47.901] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843015476091904768:10:0) after 7m38s
[08:42:25.919] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843015476091904768:10:0)
[08:42:25.941] Build status: STARTED
[08:42:25.941] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843015476091904768:11:0) after 6m59s
[08:49:25.075] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843015476091904768:11:0)
[08:49:25.094] Build status: STARTED
[08:49:25.094] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843015476091904768:12:0) after 8m24s
[08:57:49.131] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843015476091904768:12:0)
[08:57:49.152] Build status: STARTED
[08:57:49.152] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843015476091904768:13:0) after 2m20s
[09:00:09.192] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843015476091904768:13:0)
[09:00:09.212] Build status: STARTED
[09:00:09.212] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843015476091904768:14:0) after 5m1s
[09:05:10.226] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843015476091904768:14:0)
[09:05:10.245] Build status: STARTED
[09:05:10.245] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843015476091904768:15:0) after 9m8s
[09:14:18.344] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843015476091904768:15:0)
[09:14:18.381] Build status: STARTED
[09:14:18.381] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843015476091904768:16:0) after 3m21s
[09:17:39.443] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843015476091904768:16:0)
[09:17:39.473] Build status: STARTED
[09:17:39.473] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843015476091904768:17:0) after 7m56s
[09:25:35.489] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843015476091904768:17:0)
[09:25:35.524] Build status: STARTED
[09:25:35.524] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843015476091904768:18:0) after 6m35s
[09:32:10.541] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843015476091904768:18:0)
[09:32:10.768] Build status: STARTED
[09:32:10.768] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843015476091904768:19:0) after 2m6s
[09:34:16.781] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843015476091904768:19:0)
[09:34:16.799] Build status: STARTED
[09:34:16.799] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843015476091904768:20:0) after 7m55s
[09:42:11.852] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843015476091904768:20:0)
[09:42:11.871] Build status: STARTED
[09:42:11.871] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843015476091904768:21:0) after 4m6s
[09:46:17.927] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843015476091904768:21:0)
[09:46:17.944] Build status: STARTED
[09:46:17.944] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843015476091904768:22:0) after 3m46s
[09:50:03.961] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843015476091904768:22:0)
[09:50:04.007] Build status: STARTED
[09:50:04.007] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843015476091904768:23:0) after 3m45s
[09:53:49.026] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843015476091904768:23:0)
[09:53:49.045] Build status: STARTED
[09:53:49.045] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843015476091904768:24:0) after 8m34s
[10:02:23.058] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843015476091904768:24:0)
[10:02:23.076] Build status: STARTED
[10:02:23.076] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843015476091904768:25:0) after 2m14s
[10:04:37.628] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843015476091904768:25:0)
[10:04:37.642] Build status: STARTED
[10:04:37.642] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843015476091904768:26:0) after 5m12s
[10:09:49.749] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843015476091904768:26:0)
[10:09:49.767] Build status: STARTED
[10:09:49.767] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843015476091904768:27:0) after 2m58s
[10:12:47.873] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843015476091904768:27:0)
[10:12:47.892] Build status: STARTED
[10:12:47.892] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843015476091904768:28:0) after 3m1s
[10:15:48.909] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843015476091904768:28:0)
[10:15:48.928] Build status: STARTED
[10:15:48.928] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843015476091904768:29:0) after 8m39s
[10:24:27.946] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843015476091904768:29:0)
[10:24:27.976] Build status: STARTED
[10:24:27.976] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843015476091904768:30:0) after 3m15s
[10:27:43.046] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843015476091904768:30:0)
[10:27:43.091] Build status: STARTED
[10:27:43.093] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843015476091904768:31:0) after 2m29s
[10:30:12.107] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843015476091904768:31:0)
[10:30:12.125] Build status: STARTED
[10:30:12.125] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843015476091904768:32:0) after 9m23s
[10:39:35.148] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843015476091904768:32:0)
[10:39:35.197] Build status: STARTED
[10:39:35.197] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843015476091904768:33:0) after 9m33s
[10:49:08.201] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843015476091904768:33:0)
[10:49:08.218] Build status: STARTED
[10:49:08.218] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843015476091904768:34:0) after 3m27s
[10:52:35.263] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843015476091904768:34:0)
[10:52:35.288] Build status: STARTED
[10:52:35.288] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843015476091904768:35:0) after 4m4s
[10:56:39.324] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843015476091904768:35:0)
[10:56:39.372] Build status: STARTED
[10:56:39.372] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843015476091904768:36:0) after 9m10s
[11:05:49.391] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843015476091904768:36:0)
[11:05:49.407] Build status: STARTED
[11:05:49.407] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8843015476091904768:37:0) after 6m52s
[11:08:02.755] Received PubSub notification, asking Buildbucket for the build status
[11:08:02.820] Build:
{
"id": "8677585413697676673",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64PGO"
},
"number": 3586,
"createdBy": "project:chromium",
"createTime": "2026-06-30T08:04:44.743473595Z",
"startTime": "2026-06-30T08:05:35.445943168Z",
"endTime": "2026-06-30T11:08:02.420027807Z",
"updateTime": "2026-06-30T11:08:02.420027807Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "dd05f3af4c8b4b1bb3580ecc7189eb6f2862bf28",
"ref": "refs/heads/main"
}
},
"canary": true
}
[11:08:02.820] Invocation finished in 3h3m19.744466137s with status FAILED