[01:51:29.637] New invocation is queued and will start shortly
[01:51:30.809] Starting the invocation (attempt 1)
[01:51:30.829] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/80ca20f5678052a8e7cf0d61b1db6bcf8f664cce"
[01:51:30.829] Popped gitiles commit info from properties and tags
[01:51:30.829] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[01:51:30.830] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[01:51:30.830] Buildbucket request:
{
"requestId": "8850196117666496080",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacPGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "80ca20f5678052a8e7cf0d61b1db6bcf8f664cce",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8850196117666496080"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacPGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[01:51:31.330] Scheduled build:
{
"id": "8684766055690944177",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacPGO"
},
"number": 2084,
"createdBy": "project:chromium",
"createTime": "2026-04-12T01:51:30.898106222Z",
"updateTime": "2026-04-12T01:51:30.898106222Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "80ca20f5678052a8e7cf0d61b1db6bcf8f664cce",
"ref": "refs/heads/main"
}
}
}
[01:51:31.330] Task URL: https://cr-buildbucket.appspot.com/build/8684766055690944177
[01:51:31.330] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:2:0) after 6m24s
[01:51:32.356] Received PubSub notification, asking Buildbucket for the build status
[01:51:32.374] Build status: SCHEDULED
[01:51:34.817] Received PubSub notification, asking Buildbucket for the build status
[01:51:34.854] Build status: STARTED
[01:57:55.348] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:2:0)
[01:57:55.415] Build status: STARTED
[01:57:55.415] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:5:0) after 8m15s
[02:06:10.917] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:5:0)
[02:06:10.939] Build status: STARTED
[02:06:10.939] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:6:0) after 2m56s
[02:09:06.961] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:6:0)
[02:09:06.976] Build status: STARTED
[02:09:06.976] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:7:0) after 3m17s
[02:12:24.014] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:7:0)
[02:12:24.034] Build status: STARTED
[02:12:24.034] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:8:0) after 4m32s
[02:16:56.105] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:8:0)
[02:16:56.133] Build status: STARTED
[02:16:56.133] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:9:0) after 3m46s
[02:20:42.412] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:9:0)
[02:20:42.459] Build status: STARTED
[02:20:42.459] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:10:0) after 4m56s
[02:25:38.745] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:10:0)
[02:25:38.763] Build status: STARTED
[02:25:38.763] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:11:0) after 7m53s
[02:33:31.784] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:11:0)
[02:33:31.800] Build status: STARTED
[02:33:31.800] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:12:0) after 5m11s
[02:38:42.838] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:12:0)
[02:38:42.852] Build status: STARTED
[02:38:42.852] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:13:0) after 4m38s
[02:43:21.205] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:13:0)
[02:43:21.226] Build status: STARTED
[02:43:21.226] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:14:0) after 7m51s
[02:51:12.338] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:14:0)
[02:51:12.368] Build status: STARTED
[02:51:12.368] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:15:0) after 8m22s
[02:59:34.384] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:15:0)
[02:59:34.467] Build status: STARTED
[02:59:34.467] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:16:0) after 8m8s
[03:07:42.482] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:16:0)
[03:07:42.503] Build status: STARTED
[03:07:42.503] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:17:0) after 2m19s
[03:10:01.559] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:17:0)
[03:10:01.574] Build status: STARTED
[03:10:01.574] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:18:0) after 6m14s
[03:16:15.594] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:18:0)
[03:16:15.621] Build status: STARTED
[03:16:15.621] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:19:0) after 1m5s
[03:17:20.599] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:19:0)
[03:17:20.636] Build status: STARTED
[03:17:20.636] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:20:0) after 4m58s
[03:22:18.653] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:20:0)
[03:22:18.671] Build status: STARTED
[03:22:18.671] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:21:0) after 1m11s
[03:23:29.726] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:21:0)
[03:23:29.812] Build status: STARTED
[03:23:29.812] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:22:0) after 6m53s
[03:30:22.816] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:22:0)
[03:30:22.835] Build status: STARTED
[03:30:22.835] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:23:0) after 1m35s
[03:31:57.853] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:23:0)
[03:31:57.870] Build status: STARTED
[03:31:57.870] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:24:0) after 6m6s
[03:38:03.939] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:24:0)
[03:38:03.963] Build status: STARTED
[03:38:03.963] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:25:0) after 8m0s
[03:46:03.981] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:25:0)
[03:46:04.005] Build status: STARTED
[03:46:04.005] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:26:0) after 1m34s
[03:47:38.429] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:26:0)
[03:47:38.453] Build status: STARTED
[03:47:38.453] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:27:0) after 8m51s
[03:56:29.440] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:27:0)
[03:56:29.457] Build status: STARTED
[03:56:29.457] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:28:0) after 6m20s
[04:02:49.447] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:28:0)
[04:02:49.499] Build status: STARTED
[04:02:49.500] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:29:0) after 4m38s
[04:07:27.539] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:29:0)
[04:07:27.558] Build status: STARTED
[04:07:27.558] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:30:0) after 3m3s
[04:10:30.716] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:30:0)
[04:10:30.772] Build status: STARTED
[04:10:30.772] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:31:0) after 8m16s
[04:18:46.939] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:31:0)
[04:18:46.956] Build status: STARTED
[04:18:46.956] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:32:0) after 1m8s
[04:19:55.102] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:32:0)
[04:19:55.120] Build status: STARTED
[04:19:55.120] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:33:0) after 8m31s
[04:28:26.293] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:33:0)
[04:28:26.379] Build status: STARTED
[04:28:26.379] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:34:0) after 7m7s
[04:35:33.393] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:34:0)
[04:35:33.415] Build status: STARTED
[04:35:33.415] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:35:0) after 8m16s
[04:43:49.467] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:35:0)
[04:43:49.530] Build status: STARTED
[04:43:49.530] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:36:0) after 1m52s
[04:45:41.534] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:36:0)
[04:45:41.551] Build status: STARTED
[04:45:41.552] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:37:0) after 9m54s
[04:55:35.642] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:37:0)
[04:55:35.659] Build status: STARTED
[04:55:35.659] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:38:0) after 7m12s
[05:02:47.689] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:38:0)
[05:02:47.705] Build status: STARTED
[05:02:47.705] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:39:0) after 4m10s
[05:06:57.777] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:39:0)
[05:06:57.795] Build status: STARTED
[05:06:57.795] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:40:0) after 9m51s
[05:16:48.809] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:40:0)
[05:16:48.828] Build status: STARTED
[05:16:48.828] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:41:0) after 4m57s
[05:21:46.144] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:41:0)
[05:21:46.159] Build status: STARTED
[05:21:46.159] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:42:0) after 8m28s
[05:30:14.137] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:42:0)
[05:30:14.157] Build status: STARTED
[05:30:14.157] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:43:0) after 5m53s
[05:36:07.377] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:43:0)
[05:36:07.446] Build status: STARTED
[05:36:07.446] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:44:0) after 9m37s
[05:45:44.496] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:44:0)
[05:45:44.527] Build status: STARTED
[05:45:44.528] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:45:0) after 6m1s
[05:51:45.526] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:45:0)
[05:51:45.545] Build status: STARTED
[05:51:45.545] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:46:0) after 5m14s
[05:56:59.561] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:46:0)
[05:56:59.620] Build status: STARTED
[05:56:59.620] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:47:0) after 4m33s
[06:01:33.127] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:47:0)
[06:01:33.159] Build status: STARTED
[06:01:33.159] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:48:0) after 1m4s
[06:02:37.193] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:48:0)
[06:02:37.210] Build status: STARTED
[06:02:37.210] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:49:0) after 9m32s
[06:12:09.331] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:49:0)
[06:12:09.375] Build status: STARTED
[06:12:09.376] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:50:0) after 4m57s
[06:17:06.406] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:50:0)
[06:17:06.499] Build status: STARTED
[06:17:06.499] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:51:0) after 8m31s
[06:25:37.562] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:51:0)
[06:25:37.585] Build status: STARTED
[06:25:37.585] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:52:0) after 7m11s
[06:32:48.622] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:52:0)
[06:32:48.636] Build status: STARTED
[06:32:48.636] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:53:0) after 5m33s
[06:38:21.746] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:53:0)
[06:38:21.771] Build status: STARTED
[06:38:21.771] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:54:0) after 7m26s
[06:45:48.403] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:54:0)
[06:45:48.434] Build status: STARTED
[06:45:48.434] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:55:0) after 9m19s
[06:55:07.484] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:55:0)
[06:55:07.548] Build status: STARTED
[06:55:07.548] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:56:0) after 6m34s
[07:01:41.565] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:56:0)
[07:01:41.586] Build status: STARTED
[07:01:41.586] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:57:0) after 6m18s
[07:07:59.603] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:57:0)
[07:07:59.622] Build status: STARTED
[07:07:59.622] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:58:0) after 8m41s
[07:16:40.682] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:58:0)
[07:16:40.699] Build status: STARTED
[07:16:40.699] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:59:0) after 8m35s
[07:25:16.197] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:59:0)
[07:25:16.311] Build status: STARTED
[07:25:16.311] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:60:0) after 6m32s
[07:31:48.729] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:60:0)
[07:31:48.748] Build status: STARTED
[07:31:48.748] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:61:0) after 1m0s
[07:32:48.824] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:61:0)
[07:32:48.901] Build status: STARTED
[07:32:48.901] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:62:0) after 7m23s
[07:40:11.921] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:62:0)
[07:40:12.103] Build status: STARTED
[07:40:12.103] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:63:0) after 8m41s
[07:48:53.121] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:63:0)
[07:48:53.136] Build status: STARTED
[07:48:53.136] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:64:0) after 9m18s
[07:58:11.584] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:64:0)
[07:58:11.607] Build status: STARTED
[07:58:11.607] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:65:0) after 6m42s
[08:04:53.659] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:65:0)
[08:04:53.675] Build status: STARTED
[08:04:53.675] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:66:0) after 5m21s
[08:10:14.828] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:66:0)
[08:10:14.852] Build status: STARTED
[08:10:14.852] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8850196117666496080:67:0) after 9m33s
[08:14:21.798] Received PubSub notification, asking Buildbucket for the build status
[08:14:21.817] Build:
{
"id": "8684766055690944177",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacPGO"
},
"number": 2084,
"createdBy": "project:chromium",
"createTime": "2026-04-12T01:51:30.898106222Z",
"startTime": "2026-04-12T01:51:34.590579763Z",
"endTime": "2026-04-12T08:14:20.343132530Z",
"updateTime": "2026-04-12T08:14:20.343132530Z",
"status": "SUCCESS",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "80ca20f5678052a8e7cf0d61b1db6bcf8f664cce",
"ref": "refs/heads/main"
}
}
}
[08:14:21.817] Invocation finished in 6h22m52.185954753s with status SUCCEEDED