[17:31:41.290] New invocation is queued and will start shortly
[17:31:42.542] Starting the invocation (attempt 1)
[17:31:42.567] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/f1a34d74ec4591cb2ccbe099cd5d5739f9143f75"
[17:31:42.567] Popped gitiles commit info from properties and tags
[17:31:42.567] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[17:31:42.567] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[17:31:42.567] Buildbucket request:
{
"requestId": "8833557720909839472",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64PGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f1a34d74ec4591cb2ccbe099cd5d5739f9143f75",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8833557720909839472"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacArm64PGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[17:31:43.705] Scheduled build:
{
"id": "8668127658487113633",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64PGO"
},
"number": 5844,
"createdBy": "project:chromium",
"createTime": "2026-10-12T17:31:42.978455164Z",
"updateTime": "2026-10-12T17:31:42.978455164Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f1a34d74ec4591cb2ccbe099cd5d5739f9143f75",
"ref": "refs/heads/main"
}
}
}
[17:31:43.705] Task URL: https://cr-buildbucket.appspot.com/build/8668127658487113633
[17:31:43.705] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833557720909839472:2:0) after 3m17s
[17:31:43.810] Received PubSub notification, asking Buildbucket for the build status
[17:31:43.831] Build status: SCHEDULED
[17:31:47.852] Received PubSub notification, asking Buildbucket for the build status
[17:31:47.879] Build status: STARTED
[17:35:00.724] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833557720909839472:2:0)
[17:35:00.765] Build status: STARTED
[17:35:00.765] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833557720909839472:5:0) after 2m2s
[17:37:02.787] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833557720909839472:5:0)
[17:37:02.818] Build status: STARTED
[17:37:02.818] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833557720909839472:6:0) after 7m19s
[17:44:21.850] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833557720909839472:6:0)
[17:44:21.877] Build status: STARTED
[17:44:21.877] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833557720909839472:7:0) after 3m1s
[17:47:22.907] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833557720909839472:7:0)
[17:47:22.930] Build status: STARTED
[17:47:22.930] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833557720909839472:8:0) after 2m4s
[17:49:26.948] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833557720909839472:8:0)
[17:49:27.019] Build status: STARTED
[17:49:27.019] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833557720909839472:9:0) after 4m38s
[17:54:05.094] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833557720909839472:9:0)
[17:54:05.133] Build status: STARTED
[17:54:05.133] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833557720909839472:10:0) after 8m24s
[18:02:29.154] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833557720909839472:10:0)
[18:02:29.177] Build status: STARTED
[18:02:29.177] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833557720909839472:11:0) after 7m31s
[18:10:00.204] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833557720909839472:11:0)
[18:10:00.235] Build status: STARTED
[18:10:00.235] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833557720909839472:12:0) after 6m3s
[18:16:03.306] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833557720909839472:12:0)
[18:16:03.441] Build status: STARTED
[18:16:03.441] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833557720909839472:13:0) after 8m36s
[18:24:39.465] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833557720909839472:13:0)
[18:24:39.483] Build status: STARTED
[18:24:39.483] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833557720909839472:14:0) after 9m24s
[18:34:03.474] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833557720909839472:14:0)
[18:34:03.525] Build status: STARTED
[18:34:03.525] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833557720909839472:15:0) after 3m45s
[18:37:48.600] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833557720909839472:15:0)
[18:37:48.632] Build status: STARTED
[18:37:48.632] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833557720909839472:16:0) after 2m26s
[18:40:14.655] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833557720909839472:16:0)
[18:40:14.683] Build status: STARTED
[18:40:14.683] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833557720909839472:17:0) after 3m30s
[18:43:44.738] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833557720909839472:17:0)
[18:43:44.756] Build status: STARTED
[18:43:44.756] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833557720909839472:18:0) after 7m7s
[18:50:51.827] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833557720909839472:18:0)
[18:50:51.861] Build status: STARTED
[18:50:51.861] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833557720909839472:19:0) after 5m18s
[18:56:09.960] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833557720909839472:19:0)
[18:56:10.018] Build status: STARTED
[18:56:10.018] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833557720909839472:20:0) after 3m30s
[18:59:40.046] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833557720909839472:20:0)
[18:59:40.063] Build status: STARTED
[18:59:40.063] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833557720909839472:21:0) after 7m31s
[19:07:11.081] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833557720909839472:21:0)
[19:07:11.104] Build status: STARTED
[19:07:11.104] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833557720909839472:22:0) after 6m40s
[19:13:51.136] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833557720909839472:22:0)
[19:13:51.154] Build status: STARTED
[19:13:51.154] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833557720909839472:23:0) after 8m33s
[19:22:24.176] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833557720909839472:23:0)
[19:22:24.200] Build status: STARTED
[19:22:24.200] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833557720909839472:24:0) after 2m27s
[19:24:51.337] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833557720909839472:24:0)
[19:24:51.415] Build status: STARTED
[19:24:51.415] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833557720909839472:25:0) after 8m9s
[19:33:00.491] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833557720909839472:25:0)
[19:33:00.509] Build status: STARTED
[19:33:00.509] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833557720909839472:26:0) after 1m16s
[19:34:16.570] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833557720909839472:26:0)
[19:34:16.615] Build status: STARTED
[19:34:16.615] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833557720909839472:27:0) after 2m43s
[19:36:59.676] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833557720909839472:27:0)
[19:36:59.699] Build status: STARTED
[19:36:59.699] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833557720909839472:28:0) after 6m42s
[19:43:41.776] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833557720909839472:28:0)
[19:43:41.796] Build status: STARTED
[19:43:41.796] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833557720909839472:29:0) after 2m47s
[19:46:28.915] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833557720909839472:29:0)
[19:46:28.946] Build status: STARTED
[19:46:28.947] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833557720909839472:30:0) after 2m2s
[19:48:31.005] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833557720909839472:30:0)
[19:48:31.025] Build status: STARTED
[19:48:31.025] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833557720909839472:31:0) after 9m22s
[19:57:53.159] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833557720909839472:31:0)
[19:57:53.178] Build status: STARTED
[19:57:53.178] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833557720909839472:32:0) after 5m30s
[20:03:23.211] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833557720909839472:32:0)
[20:03:23.230] Build status: STARTED
[20:03:23.231] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833557720909839472:33:0) after 3m27s
[20:06:50.474] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833557720909839472:33:0)
[20:06:50.496] Build status: STARTED
[20:06:50.496] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833557720909839472:34:0) after 4m49s
[20:11:39.517] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833557720909839472:34:0)
[20:11:39.538] Build status: STARTED
[20:11:39.538] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833557720909839472:35:0) after 4m41s
[20:16:20.845] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833557720909839472:35:0)
[20:16:20.883] Build status: STARTED
[20:16:20.883] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833557720909839472:36:0) after 3m34s
[20:19:54.893] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833557720909839472:36:0)
[20:19:54.966] Build status: STARTED
[20:19:54.966] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833557720909839472:37:0) after 9m38s
[20:29:32.993] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833557720909839472:37:0)
[20:29:33.017] Build status: STARTED
[20:29:33.017] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833557720909839472:38:0) after 8m21s
[20:37:54.040] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833557720909839472:38:0)
[20:37:54.063] Build status: STARTED
[20:37:54.063] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833557720909839472:39:0) after 2m24s
[20:40:18.117] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833557720909839472:39:0)
[20:40:18.134] Build status: STARTED
[20:40:18.134] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833557720909839472:40:0) after 5m6s
[20:45:24.157] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833557720909839472:40:0)
[20:45:24.183] Build status: STARTED
[20:45:24.183] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833557720909839472:41:0) after 2m52s
[20:48:16.245] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833557720909839472:41:0)
[20:48:16.264] Build status: STARTED
[20:48:16.264] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8833557720909839472:42:0) after 5m31s
[20:51:25.337] Received PubSub notification, asking Buildbucket for the build status
[20:51:25.355] Build:
{
"id": "8668127658487113633",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64PGO"
},
"number": 5844,
"createdBy": "project:chromium",
"createTime": "2026-10-12T17:31:42.978455164Z",
"startTime": "2026-10-12T17:31:47.583161351Z",
"endTime": "2026-10-12T20:51:24.204176267Z",
"updateTime": "2026-10-12T20:51:24.204176267Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f1a34d74ec4591cb2ccbe099cd5d5739f9143f75",
"ref": "refs/heads/main"
}
}
}
[20:51:25.355] Invocation finished in 3h19m44.070468246s with status FAILED