[05:02:41.379] New invocation is queued and will start shortly
[05:02:42.572] Starting the invocation (attempt 1)
[05:02:42.603] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/d2ace72ac314b8ae1dac7bc1dcb193f70e4290a0"
[05:02:42.603] Popped gitiles commit info from properties and tags
[05:02:42.603] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[05:02:42.603] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[05:02:42.603] Buildbucket request:
{
"requestId": "8858337815654867424",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacPGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d2ace72ac314b8ae1dac7bc1dcb193f70e4290a0",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8858337815654867424"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacPGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[05:02:43.131] Scheduled build:
{
"id": "8692907753615724481",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacPGO"
},
"number": 1132,
"createdBy": "project:chromium",
"createTime": "2026-01-12T05:02:42.695387474Z",
"updateTime": "2026-01-12T05:02:42.695387474Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d2ace72ac314b8ae1dac7bc1dcb193f70e4290a0",
"ref": "refs/heads/main"
}
}
}
[05:02:43.131] Task URL: https://cr-buildbucket.appspot.com/build/8692907753615724481
[05:02:43.131] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:2:0) after 7m6s
[05:02:44.074] Received PubSub notification, asking Buildbucket for the build status
[05:02:44.163] Build status: SCHEDULED
[05:03:56.328] Received PubSub notification, asking Buildbucket for the build status
[05:03:56.346] Build status: STARTED
[05:09:49.146] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:2:0)
[05:09:49.172] Build status: STARTED
[05:09:49.172] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:5:0) after 6m3s
[05:15:52.455] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:5:0)
[05:15:52.466] Build status: STARTED
[05:15:52.466] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:6:0) after 2m41s
[05:18:33.483] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:6:0)
[05:18:33.497] Build status: STARTED
[05:18:33.497] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:7:0) after 7m15s
[05:25:48.529] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:7:0)
[05:25:48.555] Build status: STARTED
[05:25:48.556] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:8:0) after 5m27s
[05:31:15.584] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:8:0)
[05:31:15.620] Build status: STARTED
[05:31:15.620] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:9:0) after 6m15s
[05:37:30.652] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:9:0)
[05:37:30.711] Build status: STARTED
[05:37:30.711] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:10:0) after 8m50s
[05:46:20.900] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:10:0)
[05:46:21.046] Build status: STARTED
[05:46:21.046] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:11:0) after 2m32s
[05:48:53.451] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:11:0)
[05:48:53.463] Build status: STARTED
[05:48:53.463] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:12:0) after 6m18s
[05:55:11.776] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:12:0)
[05:55:11.800] Build status: STARTED
[05:55:11.800] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:13:0) after 8m27s
[06:03:39.153] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:13:0)
[06:03:39.170] Build status: STARTED
[06:03:39.170] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:14:0) after 2m7s
[06:05:46.360] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:14:0)
[06:05:46.377] Build status: STARTED
[06:05:46.377] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:15:0) after 4m1s
[06:09:47.444] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:15:0)
[06:09:47.457] Build status: STARTED
[06:09:47.457] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:16:0) after 9m41s
[06:19:28.891] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:16:0)
[06:19:28.904] Build status: STARTED
[06:19:28.904] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:17:0) after 4m22s
[06:23:50.961] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:17:0)
[06:23:50.977] Build status: STARTED
[06:23:50.977] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:18:0) after 7m50s
[06:31:40.994] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:18:0)
[06:31:41.016] Build status: STARTED
[06:31:41.016] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:19:0) after 4m18s
[06:35:59.030] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:19:0)
[06:35:59.043] Build status: STARTED
[06:35:59.043] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:20:0) after 2m46s
[06:38:45.024] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:20:0)
[06:38:45.063] Build status: STARTED
[06:38:45.063] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:21:0) after 9m20s
[06:48:05.083] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:21:0)
[06:48:05.175] Build status: STARTED
[06:48:05.175] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:22:0) after 7m13s
[06:55:18.277] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:22:0)
[06:55:18.347] Build status: STARTED
[06:55:18.347] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:23:0) after 6m23s
[07:01:41.523] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:23:0)
[07:01:41.573] Build status: STARTED
[07:01:41.574] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:24:0) after 5m23s
[07:07:04.787] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:24:0)
[07:07:04.801] Build status: STARTED
[07:07:04.801] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:25:0) after 8m24s
[07:15:28.797] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:25:0)
[07:15:28.815] Build status: STARTED
[07:15:28.815] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:26:0) after 7m51s
[07:23:19.886] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:26:0)
[07:23:19.912] Build status: STARTED
[07:23:19.912] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:27:0) after 9m40s
[07:32:59.920] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:27:0)
[07:32:59.934] Build status: STARTED
[07:32:59.934] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:28:0) after 8m56s
[07:41:55.948] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:28:0)
[07:41:55.964] Build status: STARTED
[07:41:55.964] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:29:0) after 9m8s
[07:51:03.984] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:29:0)
[07:51:04.024] Build status: STARTED
[07:51:04.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:30:0) after 5m45s
[07:56:49.085] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:30:0)
[07:56:49.102] Build status: STARTED
[07:56:49.102] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:31:0) after 1m23s
[07:58:12.193] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:31:0)
[07:58:12.225] Build status: STARTED
[07:58:12.225] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:32:0) after 6m48s
[08:05:00.242] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:32:0)
[08:05:00.290] Build status: STARTED
[08:05:00.290] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:33:0) after 9m37s
[08:14:37.681] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:33:0)
[08:14:37.696] Build status: STARTED
[08:14:37.696] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:34:0) after 1m29s
[08:16:06.713] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:34:0)
[08:16:06.734] Build status: STARTED
[08:16:06.734] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:35:0) after 8m24s
[08:24:31.067] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:35:0)
[08:24:31.085] Build status: STARTED
[08:24:31.085] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:36:0) after 5m45s
[08:30:16.251] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:36:0)
[08:30:16.267] Build status: STARTED
[08:30:16.267] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:37:0) after 4m27s
[08:34:43.389] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:37:0)
[08:34:43.439] Build status: STARTED
[08:34:43.439] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:38:0) after 8m24s
[08:43:08.001] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:38:0)
[08:43:08.017] Build status: STARTED
[08:43:08.017] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:39:0) after 4m37s
[08:47:45.037] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:39:0)
[08:47:45.056] Build status: STARTED
[08:47:45.056] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:40:0) after 8m36s
[08:56:21.640] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:40:0)
[08:56:21.682] Build status: STARTED
[08:56:21.682] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:41:0) after 9m36s
[09:05:57.671] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:41:0)
[09:05:57.689] Build status: STARTED
[09:05:57.689] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:42:0) after 7m49s
[09:13:46.795] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:42:0)
[09:13:46.832] Build status: STARTED
[09:13:46.832] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:43:0) after 4m36s
[09:18:22.948] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:43:0)
[09:18:22.962] Build status: STARTED
[09:18:22.962] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:44:0) after 9m39s
[09:28:01.978] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:44:0)
[09:28:01.995] Build status: STARTED
[09:28:01.995] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:45:0) after 5m15s
[09:33:17.167] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:45:0)
[09:33:17.181] Build status: STARTED
[09:33:17.181] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:46:0) after 5m34s
[09:38:51.196] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:46:0)
[09:38:51.212] Build status: STARTED
[09:38:51.212] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:47:0) after 4m46s
[09:43:37.370] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:47:0)
[09:43:37.384] Build status: STARTED
[09:43:37.384] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:48:0) after 4m31s
[09:48:08.415] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:48:0)
[09:48:08.430] Build status: STARTED
[09:48:08.431] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:49:0) after 9m39s
[09:57:47.716] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:49:0)
[09:57:47.734] Build status: STARTED
[09:57:47.734] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:50:0) after 2m59s
[10:00:46.748] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:50:0)
[10:00:46.787] Build status: STARTED
[10:00:46.787] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:51:0) after 5m27s
[10:06:13.801] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:51:0)
[10:06:13.819] Build status: STARTED
[10:06:13.819] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:52:0) after 2m12s
[10:08:25.836] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:52:0)
[10:08:25.902] Build status: STARTED
[10:08:25.902] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:53:0) after 5m47s
[10:14:13.109] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:53:0)
[10:14:13.125] Build status: STARTED
[10:14:13.125] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:54:0) after 3m53s
[10:18:06.299] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:54:0)
[10:18:06.325] Build status: STARTED
[10:18:06.325] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:55:0) after 4m8s
[10:22:14.342] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:55:0)
[10:22:14.358] Build status: STARTED
[10:22:14.358] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858337815654867424:56:0) after 8m32s
[10:28:07.164] Received PubSub notification, asking Buildbucket for the build status
[10:28:07.204] Build:
{
"id": "8692907753615724481",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacPGO"
},
"number": 1132,
"createdBy": "project:chromium",
"createTime": "2026-01-12T05:02:42.695387474Z",
"startTime": "2026-01-12T05:03:55.883793669Z",
"endTime": "2026-01-12T10:28:06.849919646Z",
"updateTime": "2026-01-12T10:28:06.849919646Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d2ace72ac314b8ae1dac7bc1dcb193f70e4290a0",
"ref": "refs/heads/main"
}
}
}
[10:28:07.204] Invocation finished in 5h25m25.837311494s with status FAILED