[22:31:44.617] New invocation is queued and will start shortly
[22:31:45.723] Starting the invocation (attempt 1)
[22:31:45.748] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/9f504d5ba1a3c7fd982cca80cc641fbdfc57930f"
[22:31:45.748] Popped gitiles commit info from properties and tags
[22:31:45.748] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[22:31:45.748] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[22:31:45.748] Buildbucket request:
{
"requestId": "8833720036985594752",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64PGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9f504d5ba1a3c7fd982cca80cc641fbdfc57930f",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8833720036985594752"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacArm64PGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[22:31:46.903] Scheduled build:
{
"id": "8668289975009603457",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64PGO"
},
"number": 5831,
"createdBy": "project:chromium",
"createTime": "2026-10-10T22:31:45.879174860Z",
"updateTime": "2026-10-10T22:31:45.879174860Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9f504d5ba1a3c7fd982cca80cc641fbdfc57930f",
"ref": "refs/heads/main"
}
}
}
[22:31:46.903] Task URL: https://cr-buildbucket.appspot.com/build/8668289975009603457
[22:31:46.903] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833720036985594752:2:0) after 2m38s
[22:31:55.208] Received PubSub notification, asking Buildbucket for the build status
[22:31:55.228] Build status: SCHEDULED
[22:32:29.686] Received PubSub notification, asking Buildbucket for the build status
[22:32:29.704] Build status: STARTED
[22:34:25.012] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833720036985594752:2:0)
[22:34:25.041] Build status: STARTED
[22:34:25.041] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833720036985594752:5:0) after 6m44s
[22:41:09.067] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833720036985594752:5:0)
[22:41:09.190] Build status: STARTED
[22:41:09.190] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833720036985594752:6:0) after 7m54s
[22:49:03.171] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833720036985594752:6:0)
[22:49:03.213] Build status: STARTED
[22:49:03.213] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833720036985594752:7:0) after 3m28s
[22:52:31.312] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833720036985594752:7:0)
[22:52:31.329] Build status: STARTED
[22:52:31.329] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833720036985594752:8:0) after 3m8s
[22:55:39.395] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833720036985594752:8:0)
[22:55:39.432] Build status: STARTED
[22:55:39.432] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833720036985594752:9:0) after 1m16s
[22:56:55.571] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833720036985594752:9:0)
[22:56:55.593] Build status: STARTED
[22:56:55.593] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833720036985594752:10:0) after 2m35s
[22:59:30.608] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833720036985594752:10:0)
[22:59:30.659] Build status: STARTED
[22:59:30.659] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833720036985594752:11:0) after 7m17s
[23:06:47.896] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833720036985594752:11:0)
[23:06:47.922] Build status: STARTED
[23:06:47.922] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833720036985594752:12:0) after 7m13s
[23:14:01.018] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833720036985594752:12:0)
[23:14:01.041] Build status: STARTED
[23:14:01.041] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833720036985594752:13:0) after 1m12s
[23:15:13.030] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833720036985594752:13:0)
[23:15:13.055] Build status: STARTED
[23:15:13.056] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833720036985594752:14:0) after 9m37s
[23:24:50.182] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833720036985594752:14:0)
[23:24:50.210] Build status: STARTED
[23:24:50.210] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833720036985594752:15:0) after 6m53s
[23:31:43.296] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833720036985594752:15:0)
[23:31:43.320] Build status: STARTED
[23:31:43.320] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833720036985594752:16:0) after 2m42s
[23:34:25.336] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833720036985594752:16:0)
[23:34:25.527] Build status: STARTED
[23:34:25.527] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833720036985594752:17:0) after 2m37s
[23:37:02.546] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833720036985594752:17:0)
[23:37:02.608] Build status: STARTED
[23:37:02.609] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833720036985594752:18:0) after 4m39s
[23:41:41.594] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833720036985594752:18:0)
[23:41:41.617] Build status: STARTED
[23:41:41.617] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833720036985594752:19:0) after 8m26s
[23:50:07.617] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833720036985594752:19:0)
[23:50:07.676] Build status: STARTED
[23:50:07.676] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833720036985594752:20:0) after 7m55s
[23:58:02.693] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833720036985594752:20:0)
[23:58:02.766] Build status: STARTED
[23:58:02.766] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833720036985594752:21:0) after 1m16s
[23:59:18.786] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833720036985594752:21:0)
[23:59:18.810] Build status: STARTED
[23:59:18.810] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833720036985594752:22:0) after 3m22s
[00:02:40.830] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833720036985594752:22:0)
[00:02:40.854] Build status: STARTED
[00:02:40.854] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833720036985594752:23:0) after 5m27s
[00:08:07.905] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833720036985594752:23:0)
[00:08:07.923] Build status: STARTED
[00:08:07.923] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833720036985594752:24:0) after 9m3s
[00:17:10.938] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833720036985594752:24:0)
[00:17:10.964] Build status: STARTED
[00:17:10.964] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833720036985594752:25:0) after 5m23s
[00:22:34.057] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833720036985594752:25:0)
[00:22:34.147] Build status: STARTED
[00:22:34.147] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833720036985594752:26:0) after 9m2s
[00:31:36.165] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833720036985594752:26:0)
[00:31:36.181] Build status: STARTED
[00:31:36.181] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833720036985594752:27:0) after 7m35s
[00:39:11.200] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833720036985594752:27:0)
[00:39:11.220] Build status: STARTED
[00:39:11.220] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833720036985594752:28:0) after 7m5s
[00:46:16.246] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833720036985594752:28:0)
[00:46:16.283] Build status: STARTED
[00:46:16.284] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833720036985594752:29:0) after 1m5s
[00:47:21.389] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833720036985594752:29:0)
[00:47:21.464] Build status: STARTED
[00:47:21.464] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833720036985594752:30:0) after 3m22s
[00:50:43.484] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833720036985594752:30:0)
[00:50:43.501] Build status: STARTED
[00:50:43.501] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833720036985594752:31:0) after 2m19s
[00:53:02.568] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833720036985594752:31:0)
[00:53:02.592] Build status: STARTED
[00:53:02.592] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833720036985594752:32:0) after 7m0s
[01:00:02.609] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833720036985594752:32:0)
[01:00:02.648] Build status: STARTED
[01:00:02.648] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833720036985594752:33:0) after 4m26s
[01:04:28.622] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833720036985594752:33:0)
[01:04:28.641] Build status: STARTED
[01:04:28.641] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833720036985594752:34:0) after 2m9s
[01:06:37.656] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833720036985594752:34:0)
[01:06:37.675] Build status: STARTED
[01:06:37.675] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833720036985594752:35:0) after 8m47s
[01:15:24.644] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833720036985594752:35:0)
[01:15:24.694] Build status: STARTED
[01:15:24.694] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833720036985594752:36:0) after 1m2s
[01:16:26.719] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833720036985594752:36:0)
[01:16:26.740] Build status: STARTED
[01:16:26.740] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833720036985594752:37:0) after 1m30s
[01:17:56.721] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833720036985594752:37:0)
[01:17:56.739] Build status: STARTED
[01:17:56.739] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833720036985594752:38:0) after 5m50s
[01:23:46.778] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833720036985594752:38:0)
[01:23:46.809] Build status: STARTED
[01:23:46.809] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833720036985594752:39:0) after 8m24s
[01:32:10.894] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833720036985594752:39:0)
[01:32:10.922] Build status: STARTED
[01:32:10.923] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833720036985594752:40:0) after 8m15s
[01:40:25.897] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833720036985594752:40:0)
[01:40:25.975] Build status: STARTED
[01:40:25.975] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833720036985594752:41:0) after 5m24s
[01:45:50.075] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833720036985594752:41:0)
[01:45:50.096] Build status: STARTED
[01:45:50.096] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833720036985594752:42:0) after 7m9s
[01:50:10.840] Received PubSub notification, asking Buildbucket for the build status
[01:50:10.858] Build:
{
"id": "8668289975009603457",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64PGO"
},
"number": 5831,
"createdBy": "project:chromium",
"createTime": "2026-10-10T22:31:45.879174860Z",
"startTime": "2026-10-10T22:32:19.384675214Z",
"endTime": "2026-10-11T01:50:10.491561581Z",
"updateTime": "2026-10-11T01:50:10.491561581Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9f504d5ba1a3c7fd982cca80cc641fbdfc57930f",
"ref": "refs/heads/main"
}
}
}
[01:50:10.858] Invocation finished in 3h18m26.247086927s with status FAILED