[04:15:13.165] New invocation is queued and will start shortly
[04:15:14.241] Starting the invocation (attempt 1)
[04:15:14.266] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/10ea04ff21714a3d35ec61364847890aacccde4e"
[04:15:14.266] Popped gitiles commit info from properties and tags
[04:15:14.267] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[04:15:14.267] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[04:15:14.267] Buildbucket request:
{
"requestId": "8833607830391274752",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64PGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "10ea04ff21714a3d35ec61364847890aacccde4e",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8833607830391274752"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacArm64PGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[04:15:15.029] Scheduled build:
{
"id": "8668177768406986833",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64PGO"
},
"number": 5840,
"createdBy": "project:chromium",
"createTime": "2026-10-12T04:15:14.434431857Z",
"updateTime": "2026-10-12T04:15:14.434431857Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "10ea04ff21714a3d35ec61364847890aacccde4e",
"ref": "refs/heads/main"
}
}
}
[04:15:15.030] Task URL: https://cr-buildbucket.appspot.com/build/8668177768406986833
[04:15:15.030] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833607830391274752:2:0) after 9m58s
[04:15:19.678] Received PubSub notification, asking Buildbucket for the build status
[04:15:19.697] Build status: STARTED
[04:15:23.345] Received PubSub notification, asking Buildbucket for the build status
[04:15:23.370] Build status: STARTED
[04:25:13.002] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833607830391274752:2:0)
[04:25:13.020] Build status: STARTED
[04:25:13.020] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833607830391274752:5:0) after 5m43s
[04:30:56.106] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833607830391274752:5:0)
[04:30:56.133] Build status: STARTED
[04:30:56.133] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833607830391274752:6:0) after 2m20s
[04:33:16.233] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833607830391274752:6:0)
[04:33:16.253] Build status: STARTED
[04:33:16.253] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833607830391274752:7:0) after 7m35s
[04:40:51.245] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833607830391274752:7:0)
[04:40:51.309] Build status: STARTED
[04:40:51.309] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833607830391274752:8:0) after 4m50s
[04:45:41.391] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833607830391274752:8:0)
[04:45:41.409] Build status: STARTED
[04:45:41.409] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833607830391274752:9:0) after 3m41s
[04:49:22.431] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833607830391274752:9:0)
[04:49:22.487] Build status: STARTED
[04:49:22.487] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833607830391274752:10:0) after 6m55s
[04:56:17.750] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833607830391274752:10:0)
[04:56:17.771] Build status: STARTED
[04:56:17.771] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833607830391274752:11:0) after 8m20s
[05:04:38.002] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833607830391274752:11:0)
[05:04:38.028] Build status: STARTED
[05:04:38.028] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833607830391274752:12:0) after 7m57s
[05:12:35.295] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833607830391274752:12:0)
[05:12:35.322] Build status: STARTED
[05:12:35.322] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833607830391274752:13:0) after 9m7s
[05:21:42.455] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833607830391274752:13:0)
[05:21:42.471] Build status: STARTED
[05:21:42.471] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833607830391274752:14:0) after 4m17s
[05:25:59.485] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833607830391274752:14:0)
[05:25:59.520] Build status: STARTED
[05:25:59.520] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833607830391274752:15:0) after 1m31s
[05:27:30.638] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833607830391274752:15:0)
[05:27:30.660] Build status: STARTED
[05:27:30.660] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833607830391274752:16:0) after 8m58s
[05:36:28.728] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833607830391274752:16:0)
[05:36:28.748] Build status: STARTED
[05:36:28.748] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833607830391274752:17:0) after 8m8s
[05:44:36.739] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833607830391274752:17:0)
[05:44:36.767] Build status: STARTED
[05:44:36.767] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833607830391274752:18:0) after 9m8s
[05:53:44.883] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833607830391274752:18:0)
[05:53:44.907] Build status: STARTED
[05:53:44.908] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833607830391274752:19:0) after 3m56s
[05:57:40.896] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833607830391274752:19:0)
[05:57:40.915] Build status: STARTED
[05:57:40.915] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833607830391274752:20:0) after 5m45s
[06:03:25.933] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833607830391274752:20:0)
[06:03:25.954] Build status: STARTED
[06:03:25.954] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833607830391274752:21:0) after 7m0s
[06:10:26.019] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833607830391274752:21:0)
[06:10:26.037] Build status: STARTED
[06:10:26.037] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833607830391274752:22:0) after 4m10s
[06:14:36.106] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833607830391274752:22:0)
[06:14:36.130] Build status: STARTED
[06:14:36.130] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833607830391274752:23:0) after 4m7s
[06:18:43.132] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833607830391274752:23:0)
[06:18:43.173] Build status: STARTED
[06:18:43.173] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833607830391274752:24:0) after 5m16s
[06:23:59.211] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833607830391274752:24:0)
[06:23:59.247] Build status: STARTED
[06:23:59.247] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833607830391274752:25:0) after 2m4s
[06:26:03.316] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833607830391274752:25:0)
[06:26:03.335] Build status: STARTED
[06:26:03.335] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833607830391274752:26:0) after 2m20s
[06:28:23.393] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833607830391274752:26:0)
[06:28:23.418] Build status: STARTED
[06:28:23.418] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833607830391274752:27:0) after 2m48s
[06:31:11.535] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833607830391274752:27:0)
[06:31:11.566] Build status: STARTED
[06:31:11.566] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833607830391274752:28:0) after 3m49s
[06:35:00.585] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833607830391274752:28:0)
[06:35:00.602] Build status: STARTED
[06:35:00.602] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833607830391274752:29:0) after 4m26s
[06:39:27.048] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833607830391274752:29:0)
[06:39:27.070] Build status: STARTED
[06:39:27.070] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833607830391274752:30:0) after 9m48s
[06:49:15.100] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833607830391274752:30:0)
[06:49:15.140] Build status: STARTED
[06:49:15.140] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833607830391274752:31:0) after 1m30s
[06:50:45.195] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833607830391274752:31:0)
[06:50:45.240] Build status: STARTED
[06:50:45.240] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833607830391274752:32:0) after 1m8s
[06:51:53.257] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833607830391274752:32:0)
[06:51:53.276] Build status: STARTED
[06:51:53.276] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833607830391274752:33:0) after 8m29s
[07:00:22.257] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833607830391274752:33:0)
[07:00:22.288] Build status: STARTED
[07:00:22.288] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833607830391274752:34:0) after 8m31s
[07:08:53.313] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833607830391274752:34:0)
[07:08:53.336] Build status: STARTED
[07:08:53.336] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833607830391274752:35:0) after 5m14s
[07:14:07.354] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833607830391274752:35:0)
[07:14:07.411] Build status: STARTED
[07:14:07.411] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833607830391274752:36:0) after 1m49s
[07:15:56.419] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833607830391274752:36:0)
[07:15:56.449] Build status: STARTED
[07:15:56.449] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833607830391274752:37:0) after 8m21s
[07:24:17.471] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833607830391274752:37:0)
[07:24:17.504] Build status: STARTED
[07:24:17.504] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833607830391274752:38:0) after 1m39s
[07:25:56.605] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833607830391274752:38:0)
[07:25:56.626] Build status: STARTED
[07:25:56.626] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833607830391274752:39:0) after 6m50s
[07:32:46.646] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833607830391274752:39:0)
[07:32:46.674] Build status: STARTED
[07:32:46.674] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833607830391274752:40:0) after 6m23s
[07:34:39.140] Received PubSub notification, asking Buildbucket for the build status
[07:34:39.159] Build:
{
"id": "8668177768406986833",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64PGO"
},
"number": 5840,
"createdBy": "project:chromium",
"createTime": "2026-10-12T04:15:14.434431857Z",
"startTime": "2026-10-12T04:15:18.428183185Z",
"endTime": "2026-10-12T07:34:15.151650881Z",
"updateTime": "2026-10-12T07:34:15.151650881Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "10ea04ff21714a3d35ec61364847890aacccde4e",
"ref": "refs/heads/main"
}
}
}
[07:34:39.159] Invocation finished in 3h19m26.000793352s with status FAILED