[09:07:44.799] New invocation is queued and will start shortly
[09:07:47.768] Starting the invocation (attempt 1)
[09:07:47.799] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/5e4b31cecc1966d114670f0f87491f39ee847e3e"
[09:07:47.799] Popped gitiles commit info from properties and tags
[09:07:47.799] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[09:07:47.799] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[09:07:47.799] Buildbucket request:
{
"requestId": "8846091807531239312",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacPGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5e4b31cecc1966d114670f0f87491f39ee847e3e",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8846091807531239312"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacPGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[09:07:48.475] Scheduled build:
{
"id": "8680661743654665409",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacPGO"
},
"number": 2883,
"createdBy": "project:chromium",
"createTime": "2026-05-27T09:07:47.874707224Z",
"updateTime": "2026-05-27T09:07:47.874707224Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5e4b31cecc1966d114670f0f87491f39ee847e3e",
"ref": "refs/heads/main"
}
}
}
[09:07:48.475] Task URL: https://cr-buildbucket.appspot.com/build/8680661743654665409
[09:07:48.475] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:2:0) after 1m19s
[09:07:49.376] Received PubSub notification, asking Buildbucket for the build status
[09:07:49.446] Build status: SCHEDULED
[09:08:30.465] Received PubSub notification, asking Buildbucket for the build status
[09:08:30.495] Build status: STARTED
[09:09:07.495] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:2:0)
[09:09:07.521] Build status: STARTED
[09:09:07.521] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:5:0) after 8m8s
[09:17:15.534] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:5:0)
[09:17:15.552] Build status: STARTED
[09:17:15.552] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:6:0) after 7m26s
[09:24:41.628] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:6:0)
[09:24:41.644] Build status: STARTED
[09:24:41.645] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:7:0) after 4m55s
[09:29:36.816] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:7:0)
[09:29:36.833] Build status: STARTED
[09:29:36.833] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:8:0) after 3m23s
[09:32:59.871] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:8:0)
[09:32:59.889] Build status: STARTED
[09:32:59.889] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:9:0) after 1m19s
[09:34:18.946] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:9:0)
[09:34:18.968] Build status: STARTED
[09:34:18.968] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:10:0) after 1m17s
[09:35:35.983] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:10:0)
[09:35:36.002] Build status: STARTED
[09:35:36.002] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:11:0) after 3m52s
[09:39:28.117] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:11:0)
[09:39:28.136] Build status: STARTED
[09:39:28.136] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:12:0) after 2m22s
[09:41:50.157] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:12:0)
[09:41:50.174] Build status: STARTED
[09:41:50.174] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:13:0) after 9m0s
[09:50:50.187] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:13:0)
[09:50:50.203] Build status: STARTED
[09:50:50.203] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:14:0) after 6m12s
[09:57:02.438] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:14:0)
[09:57:02.463] Build status: STARTED
[09:57:02.463] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:15:0) after 8m56s
[10:05:58.610] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:15:0)
[10:05:58.628] Build status: STARTED
[10:05:58.628] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:16:0) after 2m58s
[10:08:56.725] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:16:0)
[10:08:56.747] Build status: STARTED
[10:08:56.747] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:17:0) after 2m55s
[10:11:51.892] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:17:0)
[10:11:51.915] Build status: STARTED
[10:11:51.915] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:18:0) after 4m55s
[10:16:46.958] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:18:0)
[10:16:46.975] Build status: STARTED
[10:16:46.975] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:19:0) after 8m0s
[10:24:47.073] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:19:0)
[10:24:47.089] Build status: STARTED
[10:24:47.089] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:20:0) after 1m50s
[10:26:37.377] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:20:0)
[10:26:37.394] Build status: STARTED
[10:26:37.394] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:21:0) after 7m47s
[10:34:24.410] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:21:0)
[10:34:24.431] Build status: STARTED
[10:34:24.431] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:22:0) after 6m3s
[10:40:27.439] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:22:0)
[10:40:27.456] Build status: STARTED
[10:40:27.457] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:23:0) after 3m5s
[10:43:32.506] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:23:0)
[10:43:32.544] Build status: STARTED
[10:43:32.544] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:24:0) after 4m34s
[10:48:06.635] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:24:0)
[10:48:06.675] Build status: STARTED
[10:48:06.675] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:25:0) after 4m6s
[10:52:12.739] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:25:0)
[10:52:12.826] Build status: STARTED
[10:52:12.826] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:26:0) after 7m53s
[11:00:05.838] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:26:0)
[11:00:05.865] Build status: STARTED
[11:00:05.865] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:27:0) after 4m48s
[11:04:53.873] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:27:0)
[11:04:53.894] Build status: STARTED
[11:04:53.894] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:28:0) after 7m40s
[11:12:33.969] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:28:0)
[11:12:34.000] Build status: STARTED
[11:12:34.000] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:29:0) after 1m0s
[11:13:34.040] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:29:0)
[11:13:34.062] Build status: STARTED
[11:13:34.062] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:30:0) after 9m50s
[11:23:24.082] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:30:0)
[11:23:24.104] Build status: STARTED
[11:23:24.104] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:31:0) after 6m11s
[11:29:35.171] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:31:0)
[11:29:35.192] Build status: STARTED
[11:29:35.192] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:32:0) after 6m58s
[11:36:33.225] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:32:0)
[11:36:33.244] Build status: STARTED
[11:36:33.244] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:33:0) after 3m34s
[11:40:07.256] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:33:0)
[11:40:07.294] Build status: STARTED
[11:40:07.294] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:34:0) after 6m6s
[11:46:13.315] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:34:0)
[11:46:13.332] Build status: STARTED
[11:46:13.332] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:35:0) after 8m57s
[11:55:10.501] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:35:0)
[11:55:10.517] Build status: STARTED
[11:55:10.517] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:36:0) after 4m24s
[11:59:34.502] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:36:0)
[11:59:34.561] Build status: STARTED
[11:59:34.561] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:37:0) after 6m12s
[12:05:46.579] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:37:0)
[12:05:46.598] Build status: STARTED
[12:05:46.598] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:38:0) after 3m55s
[12:09:41.617] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:38:0)
[12:09:41.643] Build status: STARTED
[12:09:41.643] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:39:0) after 8m3s
[12:17:44.710] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:39:0)
[12:17:44.773] Build status: STARTED
[12:17:44.773] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:40:0) after 2m13s
[12:19:57.873] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:40:0)
[12:19:57.889] Build status: STARTED
[12:19:57.889] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:41:0) after 3m47s
[12:23:44.904] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:41:0)
[12:23:44.928] Build status: STARTED
[12:23:44.928] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:42:0) after 7m48s
[12:31:33.006] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:42:0)
[12:31:33.141] Build status: STARTED
[12:31:33.141] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846091807531239312:43:0) after 8m0s
[12:34:11.126] Received PubSub notification, asking Buildbucket for the build status
[12:34:11.161] Build:
{
"id": "8680661743654665409",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacPGO"
},
"number": 2883,
"createdBy": "project:chromium",
"createTime": "2026-05-27T09:07:47.874707224Z",
"startTime": "2026-05-27T09:08:30.145257552Z",
"endTime": "2026-05-27T12:34:10.876267274Z",
"updateTime": "2026-05-27T12:34:10.876267274Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5e4b31cecc1966d114670f0f87491f39ee847e3e",
"ref": "refs/heads/main"
}
}
}
[12:34:11.161] Invocation finished in 3h26m26.367691815s with status FAILED