[12:44:43.570] New invocation is queued and will start shortly
[12:44:44.780] Starting the invocation (attempt 1)
[12:44:44.807] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/29fd6d5ef621f0024f5fb0a6f9d71f6ba7eb5385"
[12:44:44.807] Popped gitiles commit info from properties and tags
[12:44:44.807] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[12:44:44.807] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[12:44:44.808] Buildbucket request:
{
"requestId": "8847980692651792976",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacPGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "29fd6d5ef621f0024f5fb0a6f9d71f6ba7eb5385",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8847980692651792976"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacPGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[12:44:45.262] Scheduled build:
{
"id": "8682550630652637713",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacPGO"
},
"number": 2529,
"createdBy": "project:chromium",
"createTime": "2026-05-06T12:44:44.857277638Z",
"updateTime": "2026-05-06T12:44:44.857277638Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "29fd6d5ef621f0024f5fb0a6f9d71f6ba7eb5385",
"ref": "refs/heads/main"
}
}
}
[12:44:45.262] Task URL: https://cr-buildbucket.appspot.com/build/8682550630652637713
[12:44:45.262] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847980692651792976:2:0) after 6m25s
[12:44:46.239] Received PubSub notification, asking Buildbucket for the build status
[12:44:46.269] Build status: SCHEDULED
[12:44:48.988] Received PubSub notification, asking Buildbucket for the build status
[12:44:49.009] Build status: STARTED
[12:51:10.354] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847980692651792976:2:0)
[12:51:10.383] Build status: STARTED
[12:51:10.383] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847980692651792976:5:0) after 3m23s
[12:54:33.520] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847980692651792976:5:0)
[12:54:33.536] Build status: STARTED
[12:54:33.536] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847980692651792976:6:0) after 2m22s
[12:56:55.644] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847980692651792976:6:0)
[12:56:55.669] Build status: STARTED
[12:56:55.669] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847980692651792976:7:0) after 5m3s
[13:01:58.686] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847980692651792976:7:0)
[13:01:58.714] Build status: STARTED
[13:01:58.714] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847980692651792976:8:0) after 7m12s
[13:09:10.920] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847980692651792976:8:0)
[13:09:10.963] Build status: STARTED
[13:09:10.963] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847980692651792976:9:0) after 8m29s
[13:17:39.977] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847980692651792976:9:0)
[13:17:40.090] Build status: STARTED
[13:17:40.090] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847980692651792976:10:0) after 9m3s
[13:26:43.139] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847980692651792976:10:0)
[13:26:43.156] Build status: STARTED
[13:26:43.156] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847980692651792976:11:0) after 3m28s
[13:30:11.175] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847980692651792976:11:0)
[13:30:11.195] Build status: STARTED
[13:30:11.195] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847980692651792976:12:0) after 9m49s
[13:40:00.212] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847980692651792976:12:0)
[13:40:00.237] Build status: STARTED
[13:40:00.237] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847980692651792976:13:0) after 1m27s
[13:41:27.299] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847980692651792976:13:0)
[13:41:27.315] Build status: STARTED
[13:41:27.315] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847980692651792976:14:0) after 5m25s
[13:46:52.363] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847980692651792976:14:0)
[13:46:52.386] Build status: STARTED
[13:46:52.387] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847980692651792976:15:0) after 8m22s
[13:55:14.461] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847980692651792976:15:0)
[13:55:14.480] Build status: STARTED
[13:55:14.480] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847980692651792976:16:0) after 5m32s
[14:00:46.498] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847980692651792976:16:0)
[14:00:46.528] Build status: STARTED
[14:00:46.528] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847980692651792976:17:0) after 6m39s
[14:07:25.783] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847980692651792976:17:0)
[14:07:25.893] Build status: STARTED
[14:07:25.893] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847980692651792976:18:0) after 3m8s
[14:10:33.907] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847980692651792976:18:0)
[14:10:33.924] Build status: STARTED
[14:10:33.924] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847980692651792976:19:0) after 3m14s
[14:13:48.243] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847980692651792976:19:0)
[14:13:48.279] Build status: STARTED
[14:13:48.279] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847980692651792976:20:0) after 7m37s
[14:21:25.303] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847980692651792976:20:0)
[14:21:25.328] Build status: STARTED
[14:21:25.328] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847980692651792976:21:0) after 8m24s
[14:29:49.640] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847980692651792976:21:0)
[14:29:49.658] Build status: STARTED
[14:29:49.658] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847980692651792976:22:0) after 5m13s
[14:35:02.681] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847980692651792976:22:0)
[14:35:02.698] Build status: STARTED
[14:35:02.698] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847980692651792976:23:0) after 1m36s
[14:36:38.716] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847980692651792976:23:0)
[14:36:38.740] Build status: STARTED
[14:36:38.741] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847980692651792976:24:0) after 9m46s
[14:46:25.163] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847980692651792976:24:0)
[14:46:25.210] Build status: STARTED
[14:46:25.210] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847980692651792976:25:0) after 5m7s
[14:51:32.257] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847980692651792976:25:0)
[14:51:32.283] Build status: STARTED
[14:51:32.283] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847980692651792976:26:0) after 2m53s
[14:54:25.546] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847980692651792976:26:0)
[14:54:25.565] Build status: STARTED
[14:54:25.565] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847980692651792976:27:0) after 6m46s
[15:01:11.836] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847980692651792976:27:0)
[15:01:11.857] Build status: STARTED
[15:01:11.857] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847980692651792976:28:0) after 4m14s
[15:05:25.898] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847980692651792976:28:0)
[15:05:25.916] Build status: STARTED
[15:05:25.916] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847980692651792976:29:0) after 4m42s
[15:10:07.949] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847980692651792976:29:0)
[15:10:07.972] Build status: STARTED
[15:10:07.972] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847980692651792976:30:0) after 3m33s
[15:13:41.178] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847980692651792976:30:0)
[15:13:41.265] Build status: STARTED
[15:13:41.265] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847980692651792976:31:0) after 5m58s
[15:19:39.423] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847980692651792976:31:0)
[15:19:39.523] Build status: STARTED
[15:19:39.523] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847980692651792976:32:0) after 3m8s
[15:22:47.543] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847980692651792976:32:0)
[15:22:47.621] Build status: STARTED
[15:22:47.621] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847980692651792976:33:0) after 3m8s
[15:25:55.693] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847980692651792976:33:0)
[15:25:55.708] Build status: STARTED
[15:25:55.708] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847980692651792976:34:0) after 9m0s
[15:34:55.686] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847980692651792976:34:0)
[15:34:55.725] Build status: STARTED
[15:34:55.725] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847980692651792976:35:0) after 9m7s
[15:44:02.744] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847980692651792976:35:0)
[15:44:02.763] Build status: STARTED
[15:44:02.763] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847980692651792976:36:0) after 7m40s
[15:51:42.924] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847980692651792976:36:0)
[15:51:42.942] Build status: STARTED
[15:51:42.942] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847980692651792976:37:0) after 8m56s
[16:00:39.115] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847980692651792976:37:0)
[16:00:39.132] Build status: STARTED
[16:00:39.132] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847980692651792976:38:0) after 7m9s
[16:07:48.312] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847980692651792976:38:0)
[16:07:48.334] Build status: STARTED
[16:07:48.334] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847980692651792976:39:0) after 7m19s
[16:15:07.357] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847980692651792976:39:0)
[16:15:07.384] Build status: STARTED
[16:15:07.384] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847980692651792976:40:0) after 4m23s
[16:19:30.584] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847980692651792976:40:0)
[16:19:30.602] Build status: STARTED
[16:19:30.602] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847980692651792976:41:0) after 4m20s
[16:23:50.844] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847980692651792976:41:0)
[16:23:50.889] Build status: STARTED
[16:23:50.889] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8847980692651792976:42:0) after 7m24s
[16:29:12.334] Received PubSub notification, asking Buildbucket for the build status
[16:29:12.356] Build:
{
"id": "8682550630652637713",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacPGO"
},
"number": 2529,
"createdBy": "project:chromium",
"createTime": "2026-05-06T12:44:44.857277638Z",
"startTime": "2026-05-06T12:44:48.758521225Z",
"endTime": "2026-05-06T16:29:12.008386228Z",
"updateTime": "2026-05-06T16:29:12.008386228Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "29fd6d5ef621f0024f5fb0a6f9d71f6ba7eb5385",
"ref": "refs/heads/main"
}
}
}
[16:29:12.356] Invocation finished in 3h44m28.788710696s with status FAILED