[22:20:29.854] New invocation is queued and will start shortly
[22:20:30.921] Starting the invocation (attempt 1)
[22:20:30.947] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/0b23fa579f8f715237b41040595a1455ac36e50f"
[22:20:30.948] Popped gitiles commit info from properties and tags
[22:20:30.948] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[22:20:30.948] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[22:20:30.948] Buildbucket request:
{
"requestId": "8846857304656466048",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacPGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0b23fa579f8f715237b41040595a1455ac36e50f",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8846857304656466048"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacPGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[22:20:31.441] Scheduled build:
{
"id": "8681427242781884257",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacPGO"
},
"number": 2690,
"createdBy": "project:chromium",
"createTime": "2026-05-18T22:20:31.017554380Z",
"updateTime": "2026-05-18T22:20:31.017554380Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0b23fa579f8f715237b41040595a1455ac36e50f",
"ref": "refs/heads/main"
}
}
}
[22:20:31.441] Task URL: https://cr-buildbucket.appspot.com/build/8681427242781884257
[22:20:31.441] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846857304656466048:2:0) after 6m50s
[22:20:32.402] Received PubSub notification, asking Buildbucket for the build status
[22:20:32.417] Build status: SCHEDULED
[22:20:36.086] Received PubSub notification, asking Buildbucket for the build status
[22:20:36.131] Build status: STARTED
[22:27:21.492] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846857304656466048:2:0)
[22:27:21.532] Build status: STARTED
[22:27:21.532] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846857304656466048:5:0) after 5m3s
[22:32:24.605] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846857304656466048:5:0)
[22:32:24.663] Build status: STARTED
[22:32:24.664] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846857304656466048:6:0) after 3m22s
[22:35:46.757] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846857304656466048:6:0)
[22:35:46.779] Build status: STARTED
[22:35:46.779] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846857304656466048:7:0) after 8m53s
[22:44:39.795] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846857304656466048:7:0)
[22:44:39.817] Build status: STARTED
[22:44:39.817] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846857304656466048:8:0) after 4m31s
[22:49:10.863] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846857304656466048:8:0)
[22:49:10.909] Build status: STARTED
[22:49:10.909] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846857304656466048:9:0) after 1m32s
[22:50:43.004] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846857304656466048:9:0)
[22:50:43.018] Build status: STARTED
[22:50:43.018] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846857304656466048:10:0) after 5m36s
[22:56:19.115] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846857304656466048:10:0)
[22:56:19.177] Build status: STARTED
[22:56:19.177] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846857304656466048:11:0) after 4m26s
[23:00:45.290] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846857304656466048:11:0)
[23:00:45.309] Build status: STARTED
[23:00:45.309] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846857304656466048:12:0) after 7m51s
[23:08:36.346] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846857304656466048:12:0)
[23:08:36.372] Build status: STARTED
[23:08:36.372] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846857304656466048:13:0) after 3m30s
[23:12:06.392] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846857304656466048:13:0)
[23:12:06.409] Build status: STARTED
[23:12:06.409] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846857304656466048:14:0) after 3m18s
[23:15:24.479] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846857304656466048:14:0)
[23:15:24.501] Build status: STARTED
[23:15:24.501] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846857304656466048:15:0) after 4m28s
[23:19:52.521] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846857304656466048:15:0)
[23:19:52.537] Build status: STARTED
[23:19:52.537] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846857304656466048:16:0) after 2m4s
[23:21:56.603] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846857304656466048:16:0)
[23:21:56.620] Build status: STARTED
[23:21:56.620] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846857304656466048:17:0) after 6m57s
[23:28:53.671] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846857304656466048:17:0)
[23:28:53.741] Build status: STARTED
[23:28:53.741] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846857304656466048:18:0) after 7m25s
[23:36:18.864] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846857304656466048:18:0)
[23:36:18.926] Build status: STARTED
[23:36:18.926] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846857304656466048:19:0) after 2m15s
[23:38:33.944] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846857304656466048:19:0)
[23:38:34.008] Build status: STARTED
[23:38:34.008] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846857304656466048:20:0) after 3m4s
[23:41:38.031] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846857304656466048:20:0)
[23:41:38.049] Build status: STARTED
[23:41:38.049] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846857304656466048:21:0) after 8m43s
[23:50:21.127] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846857304656466048:21:0)
[23:50:21.150] Build status: STARTED
[23:50:21.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846857304656466048:22:0) after 3m11s
[23:53:32.138] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846857304656466048:22:0)
[23:53:32.201] Build status: STARTED
[23:53:32.202] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846857304656466048:23:0) after 1m18s
[23:54:50.218] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846857304656466048:23:0)
[23:54:50.244] Build status: STARTED
[23:54:50.244] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846857304656466048:24:0) after 5m11s
[00:00:01.313] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846857304656466048:24:0)
[00:00:01.375] Build status: STARTED
[00:00:01.375] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846857304656466048:25:0) after 7m7s
[00:07:08.391] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846857304656466048:25:0)
[00:07:08.409] Build status: STARTED
[00:07:08.409] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846857304656466048:26:0) after 9m23s
[00:16:31.535] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846857304656466048:26:0)
[00:16:31.556] Build status: STARTED
[00:16:31.556] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846857304656466048:27:0) after 9m26s
[00:25:57.760] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846857304656466048:27:0)
[00:25:57.796] Build status: STARTED
[00:25:57.796] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846857304656466048:28:0) after 9m16s
[00:35:13.918] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846857304656466048:28:0)
[00:35:13.995] Build status: STARTED
[00:35:13.995] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846857304656466048:29:0) after 6m11s
[00:41:25.153] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846857304656466048:29:0)
[00:41:25.211] Build status: STARTED
[00:41:25.211] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846857304656466048:30:0) after 7m35s
[00:49:00.232] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846857304656466048:30:0)
[00:49:00.261] Build status: STARTED
[00:49:00.261] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846857304656466048:31:0) after 2m34s
[00:51:34.329] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846857304656466048:31:0)
[00:51:34.351] Build status: STARTED
[00:51:34.351] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846857304656466048:32:0) after 1m50s
[00:53:24.369] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846857304656466048:32:0)
[00:53:24.387] Build status: STARTED
[00:53:24.387] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846857304656466048:33:0) after 8m15s
[01:01:39.425] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846857304656466048:33:0)
[01:01:39.467] Build status: STARTED
[01:01:39.467] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846857304656466048:34:0) after 2m19s
[01:03:58.459] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846857304656466048:34:0)
[01:03:58.506] Build status: STARTED
[01:03:58.506] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846857304656466048:35:0) after 6m35s
[01:10:33.578] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846857304656466048:35:0)
[01:10:33.696] Build status: STARTED
[01:10:33.696] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846857304656466048:36:0) after 5m13s
[01:15:46.732] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846857304656466048:36:0)
[01:15:46.746] Build status: STARTED
[01:15:46.746] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8846857304656466048:37:0) after 6m32s
[01:17:40.259] Received PubSub notification, asking Buildbucket for the build status
[01:17:40.276] Build:
{
"id": "8681427242781884257",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacPGO"
},
"number": 2690,
"createdBy": "project:chromium",
"createTime": "2026-05-18T22:20:31.017554380Z",
"startTime": "2026-05-18T22:20:35.917480090Z",
"endTime": "2026-05-19T01:17:39.907684969Z",
"updateTime": "2026-05-19T01:17:39.907684969Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0b23fa579f8f715237b41040595a1455ac36e50f",
"ref": "refs/heads/main"
}
}
}
[01:17:40.276] Invocation finished in 2h57m10.430695249s with status FAILED