[08:47:26.709] New invocation is queued and will start shortly
[08:47:28.083] Starting the invocation (attempt 1)
[08:47:28.101] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/0dd7d41d23914e6d6b74e758e988e73ce8ef8246"
[08:47:28.101] Popped gitiles commit info from properties and tags
[08:47:28.101] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[08:47:28.102] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[08:47:28.102] Buildbucket request:
{
"requestId": "8845277712093119792",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacPGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0dd7d41d23914e6d6b74e758e988e73ce8ef8246",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8845277712093119792"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacPGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[08:47:28.611] Scheduled build:
{
"id": "8679847649920388097",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacPGO"
},
"number": 3021,
"createdBy": "project:chromium",
"createTime": "2026-06-05T08:47:28.159711075Z",
"updateTime": "2026-06-05T08:47:28.159711075Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0dd7d41d23914e6d6b74e758e988e73ce8ef8246",
"ref": "refs/heads/main"
}
},
"canary": true
}
[08:47:28.611] Task URL: https://cr-buildbucket.appspot.com/build/8679847649920388097
[08:47:28.611] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845277712093119792:2:0) after 4m59s
[08:47:29.506] Received PubSub notification, asking Buildbucket for the build status
[08:47:29.522] Build status: SCHEDULED
[08:47:32.035] Received PubSub notification, asking Buildbucket for the build status
[08:47:32.256] Build status: STARTED
[08:52:27.647] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845277712093119792:2:0)
[08:52:27.740] Build status: STARTED
[08:52:27.740] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845277712093119792:5:0) after 6m33s
[08:59:00.753] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845277712093119792:5:0)
[08:59:00.776] Build status: STARTED
[08:59:00.776] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845277712093119792:6:0) after 4m4s
[09:03:04.790] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845277712093119792:6:0)
[09:03:04.817] Build status: STARTED
[09:03:04.817] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845277712093119792:7:0) after 1m26s
[09:04:30.864] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845277712093119792:7:0)
[09:04:30.883] Build status: STARTED
[09:04:30.883] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845277712093119792:8:0) after 9m12s
[09:13:42.917] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845277712093119792:8:0)
[09:13:42.947] Build status: STARTED
[09:13:42.947] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845277712093119792:9:0) after 6m24s
[09:20:07.038] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845277712093119792:9:0)
[09:20:07.182] Build status: STARTED
[09:20:07.182] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845277712093119792:10:0) after 5m20s
[09:25:27.213] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845277712093119792:10:0)
[09:25:27.230] Build status: STARTED
[09:25:27.230] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845277712093119792:11:0) after 4m13s
[09:29:40.292] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845277712093119792:11:0)
[09:29:40.309] Build status: STARTED
[09:29:40.309] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845277712093119792:12:0) after 4m56s
[09:34:36.358] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845277712093119792:12:0)
[09:34:36.374] Build status: STARTED
[09:34:36.375] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845277712093119792:13:0) after 8m6s
[09:42:42.391] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845277712093119792:13:0)
[09:42:42.407] Build status: STARTED
[09:42:42.407] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845277712093119792:14:0) after 6m33s
[09:49:15.382] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845277712093119792:14:0)
[09:49:15.399] Build status: STARTED
[09:49:15.399] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845277712093119792:15:0) after 3m22s
[09:52:37.368] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845277712093119792:15:0)
[09:52:37.415] Build status: STARTED
[09:52:37.415] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845277712093119792:16:0) after 1m6s
[09:53:43.429] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845277712093119792:16:0)
[09:53:43.448] Build status: STARTED
[09:53:43.449] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845277712093119792:17:0) after 5m55s
[09:59:38.531] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845277712093119792:17:0)
[09:59:38.549] Build status: STARTED
[09:59:38.549] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845277712093119792:18:0) after 9m41s
[10:09:19.568] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845277712093119792:18:0)
[10:09:19.585] Build status: STARTED
[10:09:19.586] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845277712093119792:19:0) after 8m39s
[10:17:58.695] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845277712093119792:19:0)
[10:17:58.711] Build status: STARTED
[10:17:58.712] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845277712093119792:20:0) after 2m43s
[10:20:41.735] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845277712093119792:20:0)
[10:20:41.752] Build status: STARTED
[10:20:41.752] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845277712093119792:21:0) after 1m10s
[10:21:51.801] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845277712093119792:21:0)
[10:21:51.833] Build status: STARTED
[10:21:51.833] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845277712093119792:22:0) after 5m58s
[10:27:49.852] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845277712093119792:22:0)
[10:27:49.875] Build status: STARTED
[10:27:49.875] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845277712093119792:23:0) after 8m34s
[10:36:23.891] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845277712093119792:23:0)
[10:36:23.914] Build status: STARTED
[10:36:23.914] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845277712093119792:24:0) after 1m28s
[10:37:51.929] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845277712093119792:24:0)
[10:37:51.958] Build status: STARTED
[10:37:51.958] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845277712093119792:25:0) after 1m33s
[10:39:25.098] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845277712093119792:25:0)
[10:39:25.135] Build status: STARTED
[10:39:25.135] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845277712093119792:26:0) after 8m41s
[10:48:06.132] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845277712093119792:26:0)
[10:48:06.149] Build status: STARTED
[10:48:06.149] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845277712093119792:27:0) after 8m41s
[10:56:47.166] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845277712093119792:27:0)
[10:56:47.184] Build status: STARTED
[10:56:47.185] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845277712093119792:28:0) after 9m18s
[11:06:05.198] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845277712093119792:28:0)
[11:06:05.220] Build status: STARTED
[11:06:05.220] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845277712093119792:29:0) after 6m18s
[11:12:23.253] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845277712093119792:29:0)
[11:12:23.309] Build status: STARTED
[11:12:23.310] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845277712093119792:30:0) after 1m39s
[11:14:02.295] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845277712093119792:30:0)
[11:14:02.313] Build status: STARTED
[11:14:02.313] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845277712093119792:31:0) after 5m57s
[11:19:59.351] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845277712093119792:31:0)
[11:19:59.374] Build status: STARTED
[11:19:59.374] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845277712093119792:32:0) after 8m52s
[11:28:51.383] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845277712093119792:32:0)
[11:28:51.400] Build status: STARTED
[11:28:51.400] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845277712093119792:33:0) after 6m28s
[11:35:19.419] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845277712093119792:33:0)
[11:35:19.439] Build status: STARTED
[11:35:19.439] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845277712093119792:34:0) after 7m50s
[11:43:09.455] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845277712093119792:34:0)
[11:43:09.473] Build status: STARTED
[11:43:09.473] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845277712093119792:35:0) after 4m11s
[11:47:20.488] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845277712093119792:35:0)
[11:47:20.506] Build status: STARTED
[11:47:20.506] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845277712093119792:36:0) after 8m29s
[11:55:49.523] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845277712093119792:36:0)
[11:55:49.549] Build status: STARTED
[11:55:49.549] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845277712093119792:37:0) after 3m35s
[11:59:24.570] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845277712093119792:37:0)
[11:59:24.588] Build status: STARTED
[11:59:24.589] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845277712093119792:38:0) after 6m29s
[12:05:53.608] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845277712093119792:38:0)
[12:05:53.646] Build status: STARTED
[12:05:53.646] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845277712093119792:39:0) after 8m30s
[12:06:29.386] Received PubSub notification, asking Buildbucket for the build status
[12:06:29.419] Build:
{
"id": "8679847649920388097",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacPGO"
},
"number": 3021,
"createdBy": "project:chromium",
"createTime": "2026-06-05T08:47:28.159711075Z",
"startTime": "2026-06-05T08:47:31.875389493Z",
"endTime": "2026-06-05T12:06:28.982307616Z",
"updateTime": "2026-06-05T12:06:28.982307616Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0dd7d41d23914e6d6b74e758e988e73ce8ef8246",
"ref": "refs/heads/main"
}
},
"canary": true
}
[12:06:29.419] Invocation finished in 3h19m2.714393329s with status FAILED