[01:52:26.682] New invocation is queued and will start shortly
[01:52:27.965] Starting the invocation (attempt 1)
[01:52:27.989] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/b4167edf62fb08825a4ef516e62599cf84e67fe3"
[01:52:27.989] Popped gitiles commit info from properties and tags
[01:52:27.989] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[01:52:27.989] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[01:52:27.989] Buildbucket request:
{
"requestId": "8850377251782147920",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacPGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b4167edf62fb08825a4ef516e62599cf84e67fe3",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8850377251782147920"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacPGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[01:52:28.487] Scheduled build:
{
"id": "8684947189697522449",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacPGO"
},
"number": 2070,
"createdBy": "project:chromium",
"createTime": "2026-04-10T01:52:28.048483256Z",
"updateTime": "2026-04-10T01:52:28.048483256Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b4167edf62fb08825a4ef516e62599cf84e67fe3",
"ref": "refs/heads/main"
}
}
}
[01:52:28.487] Task URL: https://cr-buildbucket.appspot.com/build/8684947189697522449
[01:52:28.487] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850377251782147920:2:0) after 4m33s
[01:52:29.428] Received PubSub notification, asking Buildbucket for the build status
[01:52:29.569] Build status: SCHEDULED
[01:57:01.507] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850377251782147920:2:0)
[01:57:01.526] Build status: SCHEDULED
[01:57:01.526] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850377251782147920:4:0) after 8m29s
[02:05:30.543] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850377251782147920:4:0)
[02:05:30.601] Build status: SCHEDULED
[02:05:30.601] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850377251782147920:5:0) after 7m19s
[02:12:49.707] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850377251782147920:5:0)
[02:12:49.727] Build status: SCHEDULED
[02:12:49.727] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850377251782147920:6:0) after 1m7s
[02:13:56.735] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850377251782147920:6:0)
[02:13:56.759] Build status: SCHEDULED
[02:13:56.759] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850377251782147920:7:0) after 2m9s
[02:16:05.777] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850377251782147920:7:0)
[02:16:05.795] Build status: SCHEDULED
[02:16:05.796] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850377251782147920:8:0) after 7m7s
[02:23:12.812] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850377251782147920:8:0)
[02:23:12.825] Build status: SCHEDULED
[02:23:12.825] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850377251782147920:9:0) after 6m0s
[02:29:12.911] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850377251782147920:9:0)
[02:29:12.930] Build status: SCHEDULED
[02:29:12.930] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850377251782147920:10:0) after 9m0s
[02:38:13.053] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850377251782147920:10:0)
[02:38:13.070] Build status: SCHEDULED
[02:38:13.070] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850377251782147920:11:0) after 5m30s
[02:43:43.113] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850377251782147920:11:0)
[02:43:43.148] Build status: SCHEDULED
[02:43:43.148] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850377251782147920:12:0) after 5m29s
[02:49:12.222] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850377251782147920:12:0)
[02:49:12.240] Build status: SCHEDULED
[02:49:12.240] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850377251782147920:13:0) after 3m4s
[02:52:16.281] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850377251782147920:13:0)
[02:52:16.362] Build status: SCHEDULED
[02:52:16.362] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850377251782147920:14:0) after 2m4s
[02:54:20.437] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850377251782147920:14:0)
[02:54:20.496] Build status: SCHEDULED
[02:54:20.496] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850377251782147920:15:0) after 1m11s
[02:55:31.514] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850377251782147920:15:0)
[02:55:31.533] Build status: SCHEDULED
[02:55:31.533] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850377251782147920:16:0) after 8m42s
[03:04:13.561] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850377251782147920:16:0)
[03:04:13.578] Build status: SCHEDULED
[03:04:13.578] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850377251782147920:17:0) after 2m22s
[03:06:35.599] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850377251782147920:17:0)
[03:06:35.614] Build status: SCHEDULED
[03:06:35.614] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850377251782147920:18:0) after 3m15s
[03:09:50.740] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850377251782147920:18:0)
[03:09:50.757] Build status: SCHEDULED
[03:09:50.757] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850377251782147920:19:0) after 7m7s
[03:16:57.923] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850377251782147920:19:0)
[03:16:57.942] Build status: SCHEDULED
[03:16:57.942] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850377251782147920:20:0) after 5m49s
[03:22:46.962] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850377251782147920:20:0)
[03:22:46.982] Build status: SCHEDULED
[03:22:46.982] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850377251782147920:21:0) after 8m25s
[03:31:12.048] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850377251782147920:21:0)
[03:31:12.066] Build status: SCHEDULED
[03:31:12.066] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850377251782147920:22:0) after 3m8s
[03:34:20.087] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850377251782147920:22:0)
[03:34:20.110] Build status: SCHEDULED
[03:34:20.110] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850377251782147920:23:0) after 3m0s
[03:37:20.127] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850377251782147920:23:0)
[03:37:20.146] Build status: SCHEDULED
[03:37:20.146] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850377251782147920:24:0) after 9m59s
[03:47:19.218] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850377251782147920:24:0)
[03:47:19.245] Build status: SCHEDULED
[03:47:19.245] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850377251782147920:25:0) after 5m53s
[03:53:12.267] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850377251782147920:25:0)
[03:53:12.285] Build status: SCHEDULED
[03:53:12.285] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850377251782147920:26:0) after 4m8s
[03:57:20.299] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850377251782147920:26:0)
[03:57:20.317] Build status: SCHEDULED
[03:57:20.317] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850377251782147920:27:0) after 8m45s
[04:06:05.466] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850377251782147920:27:0)
[04:06:05.537] Build status: SCHEDULED
[04:06:05.537] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850377251782147920:28:0) after 9m54s
[04:15:59.571] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850377251782147920:28:0)
[04:15:59.634] Build status: SCHEDULED
[04:15:59.634] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850377251782147920:29:0) after 6m37s
[04:19:27.787] Received PubSub notification, asking Buildbucket for the build status
[04:19:27.820] Build:
{
"id": "8684947189697522449",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacPGO"
},
"number": 2070,
"createdBy": "project:chromium",
"createTime": "2026-04-10T01:52:28.048483256Z",
"endTime": "2026-04-10T04:18:23.929767031Z",
"updateTime": "2026-04-10T04:18:23.929767031Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b4167edf62fb08825a4ef516e62599cf84e67fe3",
"ref": "refs/heads/main"
}
}
}
[04:19:27.820] Invocation finished in 2h27m1.143890016s with status FAILED