[18:01:36.953] New invocation is queued and will start shortly
[18:01:38.413] Starting the invocation (attempt 1)
[18:01:38.437] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/ac2e7f580734b6dd4b059f4c60fc2463fc823bb6"
[18:01:38.437] Popped gitiles commit info from properties and tags
[18:01:38.437] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[18:01:38.437] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[18:01:38.437] Buildbucket request:
{
"requestId": "8858560600753704624",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacPGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ac2e7f580734b6dd4b059f4c60fc2463fc823bb6",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8858560600753704624"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacPGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[18:01:38.908] Scheduled build:
{
"id": "8693130538463630577",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacPGO"
},
"number": 1120,
"createdBy": "project:chromium",
"createTime": "2026-01-09T18:01:38.508267680Z",
"updateTime": "2026-01-09T18:01:38.508267680Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ac2e7f580734b6dd4b059f4c60fc2463fc823bb6",
"ref": "refs/heads/main"
}
}
}
[18:01:38.908] Task URL: https://cr-buildbucket.appspot.com/build/8693130538463630577
[18:01:38.909] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858560600753704624:2:0) after 3m15s
[18:01:38.984] Received PubSub notification, asking Buildbucket for the build status
[18:01:38.995] Build status: SCHEDULED
[18:02:53.768] Received PubSub notification, asking Buildbucket for the build status
[18:02:53.786] Build status: STARTED
[18:04:53.919] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858560600753704624:2:0)
[18:04:53.978] Build status: STARTED
[18:04:53.978] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858560600753704624:5:0) after 8m7s
[18:13:00.995] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858560600753704624:5:0)
[18:13:01.009] Build status: STARTED
[18:13:01.009] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858560600753704624:6:0) after 3m17s
[18:16:18.035] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858560600753704624:6:0)
[18:16:18.067] Build status: STARTED
[18:16:18.067] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858560600753704624:7:0) after 6m24s
[18:22:42.050] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858560600753704624:7:0)
[18:22:42.075] Build status: STARTED
[18:22:42.075] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858560600753704624:8:0) after 6m56s
[18:29:38.170] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858560600753704624:8:0)
[18:29:38.266] Build status: STARTED
[18:29:38.267] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858560600753704624:9:0) after 1m23s
[18:31:01.284] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858560600753704624:9:0)
[18:31:01.303] Build status: STARTED
[18:31:01.303] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858560600753704624:10:0) after 3m19s
[18:34:20.347] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858560600753704624:10:0)
[18:34:20.362] Build status: STARTED
[18:34:20.362] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858560600753704624:11:0) after 1m8s
[18:35:28.384] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858560600753704624:11:0)
[18:35:28.439] Build status: STARTED
[18:35:28.439] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858560600753704624:12:0) after 1m16s
[18:36:44.503] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858560600753704624:12:0)
[18:36:44.528] Build status: STARTED
[18:36:44.528] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858560600753704624:13:0) after 3m57s
[18:40:41.555] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858560600753704624:13:0)
[18:40:41.647] Build status: STARTED
[18:40:41.647] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858560600753704624:14:0) after 3m38s
[18:44:19.652] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858560600753704624:14:0)
[18:44:19.670] Build status: STARTED
[18:44:19.670] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858560600753704624:15:0) after 3m15s
[18:47:34.743] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858560600753704624:15:0)
[18:47:34.777] Build status: STARTED
[18:47:34.777] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858560600753704624:16:0) after 1m36s
[18:49:10.793] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858560600753704624:16:0)
[18:49:10.809] Build status: STARTED
[18:49:10.809] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858560600753704624:17:0) after 7m47s
[18:56:57.933] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858560600753704624:17:0)
[18:56:57.951] Build status: STARTED
[18:56:57.951] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858560600753704624:18:0) after 2m7s
[18:59:04.968] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858560600753704624:18:0)
[18:59:04.992] Build status: STARTED
[18:59:04.992] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858560600753704624:19:0) after 2m24s
[19:01:29.032] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858560600753704624:19:0)
[19:01:29.053] Build status: STARTED
[19:01:29.053] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858560600753704624:20:0) after 8m2s
[19:09:31.261] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858560600753704624:20:0)
[19:09:31.285] Build status: STARTED
[19:09:31.285] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858560600753704624:21:0) after 4m11s
[19:13:42.351] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858560600753704624:21:0)
[19:13:42.372] Build status: STARTED
[19:13:42.372] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858560600753704624:22:0) after 9m20s
[19:23:02.527] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858560600753704624:22:0)
[19:23:02.545] Build status: STARTED
[19:23:02.545] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858560600753704624:23:0) after 7m2s
[19:30:04.700] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858560600753704624:23:0)
[19:30:04.767] Build status: STARTED
[19:30:04.767] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858560600753704624:24:0) after 5m2s
[19:35:06.957] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858560600753704624:24:0)
[19:35:06.976] Build status: STARTED
[19:35:06.976] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858560600753704624:25:0) after 3m6s
[19:38:13.065] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858560600753704624:25:0)
[19:38:13.083] Build status: STARTED
[19:38:13.083] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858560600753704624:26:0) after 6m14s
[19:44:27.102] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858560600753704624:26:0)
[19:44:27.151] Build status: STARTED
[19:44:27.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858560600753704624:27:0) after 5m5s
[19:49:32.199] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858560600753704624:27:0)
[19:49:32.214] Build status: STARTED
[19:49:32.214] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858560600753704624:28:0) after 7m37s
[19:57:09.269] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858560600753704624:28:0)
[19:57:09.286] Build status: STARTED
[19:57:09.286] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858560600753704624:29:0) after 4m24s
[20:01:33.296] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858560600753704624:29:0)
[20:01:33.313] Build status: STARTED
[20:01:33.313] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858560600753704624:30:0) after 5m55s
[20:07:28.478] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858560600753704624:30:0)
[20:07:28.558] Build status: STARTED
[20:07:28.558] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858560600753704624:31:0) after 3m6s
[20:10:34.700] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858560600753704624:31:0)
[20:10:34.726] Build status: STARTED
[20:10:34.726] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858560600753704624:32:0) after 2m51s
[20:13:25.745] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858560600753704624:32:0)
[20:13:25.757] Build status: STARTED
[20:13:25.758] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858560600753704624:33:0) after 8m13s
[20:21:38.761] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858560600753704624:33:0)
[20:21:38.776] Build status: STARTED
[20:21:38.776] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858560600753704624:34:0) after 4m20s
[20:25:58.865] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858560600753704624:34:0)
[20:25:58.881] Build status: STARTED
[20:25:58.881] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858560600753704624:35:0) after 2m52s
[20:28:50.917] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858560600753704624:35:0)
[20:28:50.988] Build status: STARTED
[20:28:50.988] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858560600753704624:36:0) after 4m53s
[20:33:44.087] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858560600753704624:36:0)
[20:33:44.117] Build status: STARTED
[20:33:44.117] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858560600753704624:37:0) after 6m34s
[20:40:18.251] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858560600753704624:37:0)
[20:40:18.266] Build status: STARTED
[20:40:18.266] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858560600753704624:38:0) after 3m18s
[20:43:36.286] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858560600753704624:38:0)
[20:43:36.302] Build status: STARTED
[20:43:36.302] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858560600753704624:39:0) after 8m4s
[20:51:40.349] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858560600753704624:39:0)
[20:51:40.364] Build status: STARTED
[20:51:40.364] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858560600753704624:40:0) after 3m6s
[20:54:46.479] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858560600753704624:40:0)
[20:54:46.568] Build status: STARTED
[20:54:46.568] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858560600753704624:41:0) after 2m36s
[20:55:05.538] Received PubSub notification, asking Buildbucket for the build status
[20:55:05.554] Build:
{
"id": "8693130538463630577",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacPGO"
},
"number": 1120,
"createdBy": "project:chromium",
"createTime": "2026-01-09T18:01:38.508267680Z",
"startTime": "2026-01-09T18:02:53.266361200Z",
"endTime": "2026-01-09T20:55:05.324520845Z",
"updateTime": "2026-01-09T20:55:05.324520845Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ac2e7f580734b6dd4b059f4c60fc2463fc823bb6",
"ref": "refs/heads/main"
}
}
}
[20:55:05.554] Invocation finished in 2h53m28.613889488s with status FAILED