[18:38:10.236] New invocation is queued and will start shortly
[18:38:11.296] Starting the invocation (attempt 1)
[18:38:11.331] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/d5f90f473fa4ffb38f25066e631651044c4f5da6"
[18:38:11.331] Popped gitiles commit info from properties and tags
[18:38:11.331] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[18:38:11.331] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[18:38:11.331] Buildbucket request:
{
"requestId": "8855749794963038512",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacPGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d5f90f473fa4ffb38f25066e631651044c4f5da6",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8855749794963038512"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacPGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[18:38:12.063] Scheduled build:
{
"id": "8690319733085191105",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacPGO"
},
"number": 1344,
"createdBy": "project:chromium",
"createTime": "2026-02-09T18:38:11.406377155Z",
"updateTime": "2026-02-09T18:38:11.406377155Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d5f90f473fa4ffb38f25066e631651044c4f5da6",
"ref": "refs/heads/main"
}
}
}
[18:38:12.063] Task URL: https://cr-buildbucket.appspot.com/build/8690319733085191105
[18:38:12.063] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:2:0) after 2m54s
[18:38:13.079] Received PubSub notification, asking Buildbucket for the build status
[18:38:13.095] Build status: SCHEDULED
[18:38:15.963] Received PubSub notification, asking Buildbucket for the build status
[18:38:16.028] Build status: STARTED
[18:41:06.095] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:2:0)
[18:41:06.205] Build status: STARTED
[18:41:06.205] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:5:0) after 5m25s
[18:46:31.271] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:5:0)
[18:46:31.289] Build status: STARTED
[18:46:31.289] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:6:0) after 7m16s
[18:53:47.334] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:6:0)
[18:53:47.509] Build status: STARTED
[18:53:47.509] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:7:0) after 9m38s
[19:03:25.537] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:7:0)
[19:03:25.564] Build status: STARTED
[19:03:25.564] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:8:0) after 2m50s
[19:06:15.582] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:8:0)
[19:06:15.611] Build status: STARTED
[19:06:15.611] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:9:0) after 3m26s
[19:09:41.694] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:9:0)
[19:09:41.713] Build status: STARTED
[19:09:41.713] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:10:0) after 5m30s
[19:15:11.736] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:10:0)
[19:15:11.749] Build status: STARTED
[19:15:11.749] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:11:0) after 9m57s
[19:25:08.778] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:11:0)
[19:25:08.798] Build status: STARTED
[19:25:08.798] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:12:0) after 1m22s
[19:26:30.831] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:12:0)
[19:26:30.849] Build status: STARTED
[19:26:30.849] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:13:0) after 3m39s
[19:30:09.867] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:13:0)
[19:30:09.884] Build status: STARTED
[19:30:09.884] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:14:0) after 4m13s
[19:34:22.929] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:14:0)
[19:34:22.947] Build status: STARTED
[19:34:22.948] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:15:0) after 9m36s
[19:43:58.977] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:15:0)
[19:43:59.005] Build status: STARTED
[19:43:59.005] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:16:0) after 8m47s
[19:52:46.027] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:16:0)
[19:52:46.053] Build status: STARTED
[19:52:46.053] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:17:0) after 4m8s
[19:56:54.098] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:17:0)
[19:56:54.153] Build status: STARTED
[19:56:54.153] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:18:0) after 1m7s
[19:58:01.228] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:18:0)
[19:58:01.243] Build status: STARTED
[19:58:01.243] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:19:0) after 7m32s
[20:05:33.309] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:19:0)
[20:05:33.328] Build status: STARTED
[20:05:33.328] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:20:0) after 7m23s
[20:12:56.483] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:20:0)
[20:12:56.537] Build status: STARTED
[20:12:56.537] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:21:0) after 4m47s
[20:17:43.557] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:21:0)
[20:17:43.572] Build status: STARTED
[20:17:43.572] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:22:0) after 3m19s
[20:21:02.733] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:22:0)
[20:21:02.748] Build status: STARTED
[20:21:02.748] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:23:0) after 8m6s
[20:29:08.816] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:23:0)
[20:29:08.833] Build status: STARTED
[20:29:08.833] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:24:0) after 4m12s
[20:33:21.094] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:24:0)
[20:33:21.118] Build status: STARTED
[20:33:21.118] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:25:0) after 9m4s
[20:42:25.189] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:25:0)
[20:42:25.213] Build status: STARTED
[20:42:25.213] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:26:0) after 3m21s
[20:45:46.248] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:26:0)
[20:45:47.280] Build status: STARTED
[20:45:47.280] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:27:0) after 6m22s
[20:52:09.293] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:27:0)
[20:52:09.320] Build status: STARTED
[20:52:09.320] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:28:0) after 3m48s
[20:55:57.339] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:28:0)
[20:55:57.360] Build status: STARTED
[20:55:57.360] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:29:0) after 4m13s
[21:00:10.472] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:29:0)
[21:00:10.542] Build status: STARTED
[21:00:10.542] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:30:0) after 9m29s
[21:09:39.563] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:30:0)
[21:09:39.577] Build status: STARTED
[21:09:39.577] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:31:0) after 4m38s
[21:14:17.601] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:31:0)
[21:14:17.622] Build status: STARTED
[21:14:17.622] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:32:0) after 7m17s
[21:21:34.717] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:32:0)
[21:21:34.731] Build status: STARTED
[21:21:34.731] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:33:0) after 2m47s
[21:24:21.810] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:33:0)
[21:24:21.825] Build status: STARTED
[21:24:21.825] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:34:0) after 6m22s
[21:30:43.845] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:34:0)
[21:30:43.865] Build status: STARTED
[21:30:43.865] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:35:0) after 2m33s
[21:33:16.887] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:35:0)
[21:33:16.901] Build status: STARTED
[21:33:16.901] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:36:0) after 7m29s
[21:40:45.926] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:36:0)
[21:40:45.940] Build status: STARTED
[21:40:45.940] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:37:0) after 9m59s
[21:50:45.099] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:37:0)
[21:50:45.130] Build status: STARTED
[21:50:45.130] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:38:0) after 5m55s
[21:56:40.149] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:38:0)
[21:56:40.166] Build status: STARTED
[21:56:40.166] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:39:0) after 4m9s
[22:00:49.238] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:39:0)
[22:00:49.259] Build status: STARTED
[22:00:49.259] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:40:0) after 2m29s
[22:03:18.371] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:40:0)
[22:03:18.387] Build status: STARTED
[22:03:18.387] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:41:0) after 5m22s
[22:08:40.496] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:41:0)
[22:08:40.532] Build status: STARTED
[22:08:40.532] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:42:0) after 5m11s
[22:13:51.612] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:42:0)
[22:13:51.631] Build status: STARTED
[22:13:51.631] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:43:0) after 3m18s
[22:17:09.733] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:43:0)
[22:17:09.748] Build status: STARTED
[22:17:09.749] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:44:0) after 1m19s
[22:18:28.770] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:44:0)
[22:18:28.928] Build status: STARTED
[22:18:28.928] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:45:0) after 9m14s
[22:27:43.013] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:45:0)
[22:27:43.071] Build status: STARTED
[22:27:43.071] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:46:0) after 7m40s
[22:35:23.091] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:46:0)
[22:35:23.191] Build status: STARTED
[22:35:23.191] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:47:0) after 5m13s
[22:40:36.213] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:47:0)
[22:40:36.230] Build status: STARTED
[22:40:36.230] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:48:0) after 3m33s
[22:44:09.302] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:48:0)
[22:44:09.355] Build status: STARTED
[22:44:09.355] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:49:0) after 8m25s
[22:52:34.336] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:49:0)
[22:52:34.484] Build status: STARTED
[22:52:34.484] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:50:0) after 8m56s
[23:01:30.499] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:50:0)
[23:01:30.516] Build status: STARTED
[23:01:30.516] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:51:0) after 1m30s
[23:03:00.609] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:51:0)
[23:03:00.626] Build status: STARTED
[23:03:00.626] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:52:0) after 9m23s
[23:12:23.607] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:52:0)
[23:12:23.622] Build status: STARTED
[23:12:23.622] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:53:0) after 5m21s
[23:17:44.696] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:53:0)
[23:17:44.718] Build status: STARTED
[23:17:44.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:54:0) after 5m53s
[23:23:37.789] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:54:0)
[23:23:37.805] Build status: STARTED
[23:23:37.805] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:55:0) after 2m51s
[23:26:28.824] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:55:0)
[23:26:28.841] Build status: STARTED
[23:26:28.841] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:56:0) after 6m35s
[23:33:03.898] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:56:0)
[23:33:03.917] Build status: STARTED
[23:33:03.917] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:57:0) after 7m10s
[23:40:14.019] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:57:0)
[23:40:14.035] Build status: STARTED
[23:40:14.035] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:58:0) after 7m6s
[23:47:20.111] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:58:0)
[23:47:20.127] Build status: STARTED
[23:47:20.127] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:59:0) after 7m6s
[23:54:26.163] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:59:0)
[23:54:26.223] Build status: STARTED
[23:54:26.223] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:60:0) after 1m30s
[23:55:56.324] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:60:0)
[23:55:56.346] Build status: STARTED
[23:55:56.346] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:61:0) after 4m59s
[00:00:55.371] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:61:0)
[00:00:55.443] Build status: STARTED
[00:00:55.443] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:62:0) after 9m49s
[00:10:44.664] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:62:0)
[00:10:44.686] Build status: STARTED
[00:10:44.686] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8855749794963038512:63:0) after 4m43s
[00:14:57.013] Received PubSub notification, asking Buildbucket for the build status
[00:14:57.030] Build:
{
"id": "8690319733085191105",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacPGO"
},
"number": 1344,
"createdBy": "project:chromium",
"createTime": "2026-02-09T18:38:11.406377155Z",
"startTime": "2026-02-09T18:38:15.488523506Z",
"endTime": "2026-02-10T00:14:56.789226404Z",
"updateTime": "2026-02-10T00:14:56.789226404Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d5f90f473fa4ffb38f25066e631651044c4f5da6",
"ref": "refs/heads/main"
}
}
}
[00:14:57.030] Invocation finished in 5h36m46.799504317s with status FAILED