[20:18:23.143] New invocation is queued and will start shortly
[20:18:24.441] Starting the invocation (attempt 1)
[20:18:24.469] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/71a612db0060eb235db027ff4c808349ae8eddce"
[20:18:24.469] Popped gitiles commit info from properties and tags
[20:18:24.469] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[20:18:24.470] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[20:18:24.470] Buildbucket request:
{
"requestId": "8847952150862315312",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacPGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "71a612db0060eb235db027ff4c808349ae8eddce",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8847952150862315312"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacPGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[20:18:25.044] Scheduled build:
{
"id": "8682522088754959025",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacPGO"
},
"number": 2531,
"createdBy": "project:chromium",
"createTime": "2026-05-06T20:18:24.532374483Z",
"updateTime": "2026-05-06T20:18:24.532374483Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "71a612db0060eb235db027ff4c808349ae8eddce",
"ref": "refs/heads/main"
}
}
}
[20:18:25.045] Task URL: https://cr-buildbucket.appspot.com/build/8682522088754959025
[20:18:25.045] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847952150862315312:2:0) after 7m28s
[20:18:26.008] Received PubSub notification, asking Buildbucket for the build status
[20:18:26.040] Build status: SCHEDULED
[20:18:30.924] Received PubSub notification, asking Buildbucket for the build status
[20:18:30.942] Build status: STARTED
[20:25:53.095] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847952150862315312:2:0)
[20:25:53.123] Build status: STARTED
[20:25:53.123] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847952150862315312:5:0) after 7m54s
[20:33:47.155] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847952150862315312:5:0)
[20:33:47.171] Build status: STARTED
[20:33:47.171] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847952150862315312:6:0) after 4m40s
[20:38:27.295] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847952150862315312:6:0)
[20:38:27.320] Build status: STARTED
[20:38:27.320] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847952150862315312:7:0) after 1m8s
[20:39:35.635] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847952150862315312:7:0)
[20:39:35.652] Build status: STARTED
[20:39:35.652] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847952150862315312:8:0) after 8m15s
[20:47:50.836] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847952150862315312:8:0)
[20:47:50.851] Build status: STARTED
[20:47:50.851] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847952150862315312:9:0) after 7m5s
[20:54:55.957] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847952150862315312:9:0)
[20:54:55.978] Build status: STARTED
[20:54:55.978] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847952150862315312:10:0) after 5m22s
[21:00:18.006] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847952150862315312:10:0)
[21:00:18.029] Build status: STARTED
[21:00:18.029] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847952150862315312:11:0) after 7m29s
[21:07:47.149] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847952150862315312:11:0)
[21:07:47.262] Build status: STARTED
[21:07:47.263] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847952150862315312:12:0) after 3m18s
[21:11:05.280] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847952150862315312:12:0)
[21:11:05.308] Build status: STARTED
[21:11:05.308] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847952150862315312:13:0) after 2m6s
[21:13:11.331] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847952150862315312:13:0)
[21:13:11.349] Build status: STARTED
[21:13:11.349] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847952150862315312:14:0) after 5m44s
[21:18:55.506] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847952150862315312:14:0)
[21:18:55.545] Build status: STARTED
[21:18:55.545] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847952150862315312:15:0) after 8m9s
[21:27:04.620] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847952150862315312:15:0)
[21:27:04.645] Build status: STARTED
[21:27:04.646] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847952150862315312:16:0) after 6m33s
[21:33:37.710] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847952150862315312:16:0)
[21:33:37.744] Build status: STARTED
[21:33:37.744] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847952150862315312:17:0) after 7m50s
[21:41:27.966] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847952150862315312:17:0)
[21:41:27.985] Build status: STARTED
[21:41:27.985] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847952150862315312:18:0) after 3m4s
[21:44:32.098] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847952150862315312:18:0)
[21:44:32.121] Build status: STARTED
[21:44:32.121] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847952150862315312:19:0) after 3m8s
[21:47:40.217] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847952150862315312:19:0)
[21:47:40.235] Build status: STARTED
[21:47:40.235] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847952150862315312:20:0) after 5m49s
[21:53:29.307] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847952150862315312:20:0)
[21:53:29.331] Build status: STARTED
[21:53:29.331] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847952150862315312:21:0) after 5m33s
[21:59:02.352] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847952150862315312:21:0)
[21:59:02.368] Build status: STARTED
[21:59:02.368] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847952150862315312:22:0) after 1m36s
[22:00:38.385] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847952150862315312:22:0)
[22:00:38.404] Build status: STARTED
[22:00:38.404] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847952150862315312:23:0) after 5m58s
[22:06:36.480] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847952150862315312:23:0)
[22:06:36.503] Build status: STARTED
[22:06:36.503] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847952150862315312:24:0) after 7m32s
[22:14:08.638] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847952150862315312:24:0)
[22:14:08.655] Build status: STARTED
[22:14:08.655] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847952150862315312:25:0) after 1m12s
[22:15:20.732] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847952150862315312:25:0)
[22:15:20.772] Build status: STARTED
[22:15:20.772] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847952150862315312:26:0) after 5m13s
[22:20:33.863] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847952150862315312:26:0)
[22:20:33.880] Build status: STARTED
[22:20:33.880] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847952150862315312:27:0) after 2m43s
[22:23:16.888] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847952150862315312:27:0)
[22:23:16.913] Build status: STARTED
[22:23:16.913] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847952150862315312:28:0) after 9m37s
[22:32:53.961] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847952150862315312:28:0)
[22:32:54.017] Build status: STARTED
[22:32:54.018] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847952150862315312:29:0) after 2m32s
[22:35:26.105] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847952150862315312:29:0)
[22:35:26.141] Build status: STARTED
[22:35:26.141] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847952150862315312:30:0) after 9m29s
[22:44:55.176] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847952150862315312:30:0)
[22:44:55.263] Build status: STARTED
[22:44:55.263] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847952150862315312:31:0) after 9m55s
[22:54:50.296] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847952150862315312:31:0)
[22:54:50.312] Build status: STARTED
[22:54:50.312] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847952150862315312:32:0) after 7m23s
[23:02:13.480] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847952150862315312:32:0)
[23:02:13.499] Build status: STARTED
[23:02:13.499] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847952150862315312:33:0) after 2m48s
[23:05:01.960] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847952150862315312:33:0)
[23:05:01.982] Build status: STARTED
[23:05:01.982] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847952150862315312:34:0) after 6m14s
[23:11:16.240] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847952150862315312:34:0)
[23:11:16.263] Build status: STARTED
[23:11:16.263] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847952150862315312:35:0) after 2m21s
[23:13:37.256] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847952150862315312:35:0)
[23:13:37.288] Build status: STARTED
[23:13:37.288] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847952150862315312:36:0) after 8m27s
[23:22:04.358] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847952150862315312:36:0)
[23:22:04.375] Build status: STARTED
[23:22:04.375] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847952150862315312:37:0) after 2m31s
[23:24:35.399] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847952150862315312:37:0)
[23:24:35.423] Build status: STARTED
[23:24:35.423] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847952150862315312:38:0) after 9m28s
[23:26:55.851] Received PubSub notification, asking Buildbucket for the build status
[23:26:55.870] Build:
{
"id": "8682522088754959025",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacPGO"
},
"number": 2531,
"createdBy": "project:chromium",
"createTime": "2026-05-06T20:18:24.532374483Z",
"startTime": "2026-05-06T20:18:30.732673593Z",
"endTime": "2026-05-06T23:26:55.556094766Z",
"updateTime": "2026-05-06T23:26:55.556094766Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "71a612db0060eb235db027ff4c808349ae8eddce",
"ref": "refs/heads/main"
}
}
}
[23:26:55.870] Invocation finished in 3h8m32.731021971s with status FAILED