[09:20:34.307] New invocation is queued and will start shortly
[09:20:35.994] Starting the invocation (attempt 1)
[09:20:36.027] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/bdd6350bab8e6fc35a80bf7a13a53237e2a6801b"
[09:20:36.027] Popped gitiles commit info from properties and tags
[09:20:36.027] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[09:20:36.027] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[09:20:36.027] Buildbucket request:
{
"requestId": "8845909806710709744",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacPGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "bdd6350bab8e6fc35a80bf7a13a53237e2a6801b",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8845909806710709744"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacPGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[09:20:36.575] Scheduled build:
{
"id": "8680479744188491473",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacPGO"
},
"number": 2909,
"createdBy": "project:chromium",
"createTime": "2026-05-29T09:20:36.090024765Z",
"updateTime": "2026-05-29T09:20:36.090024765Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "bdd6350bab8e6fc35a80bf7a13a53237e2a6801b",
"ref": "refs/heads/main"
}
}
}
[09:20:36.575] Task URL: https://cr-buildbucket.appspot.com/build/8680479744188491473
[09:20:36.575] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:2:0) after 1m22s
[09:20:37.529] Received PubSub notification, asking Buildbucket for the build status
[09:20:37.548] Build status: SCHEDULED
[09:21:25.126] Received PubSub notification, asking Buildbucket for the build status
[09:21:25.149] Build status: STARTED
[09:21:58.653] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:2:0)
[09:21:58.679] Build status: STARTED
[09:21:58.679] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:5:0) after 5m23s
[09:27:21.696] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:5:0)
[09:27:21.715] Build status: STARTED
[09:27:21.715] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:6:0) after 6m36s
[09:33:57.803] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:6:0)
[09:33:57.820] Build status: STARTED
[09:33:57.820] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:7:0) after 7m20s
[09:41:17.846] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:7:0)
[09:41:17.863] Build status: STARTED
[09:41:17.863] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:8:0) after 1m10s
[09:42:27.880] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:8:0)
[09:42:27.899] Build status: STARTED
[09:42:27.899] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:9:0) after 1m55s
[09:44:22.930] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:9:0)
[09:44:22.959] Build status: STARTED
[09:44:22.959] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:10:0) after 8m24s
[09:52:46.975] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:10:0)
[09:52:46.991] Build status: STARTED
[09:52:46.991] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:11:0) after 6m22s
[09:59:08.999] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:11:0)
[09:59:09.024] Build status: STARTED
[09:59:09.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:12:0) after 3m54s
[10:03:03.226] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:12:0)
[10:03:03.253] Build status: STARTED
[10:03:03.253] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:13:0) after 9m56s
[10:12:59.269] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:13:0)
[10:12:59.296] Build status: STARTED
[10:12:59.296] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:14:0) after 5m31s
[10:18:30.285] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:14:0)
[10:18:30.309] Build status: STARTED
[10:18:30.309] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:15:0) after 9m14s
[10:27:44.379] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:15:0)
[10:27:44.392] Build status: STARTED
[10:27:44.392] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:16:0) after 2m55s
[10:30:39.602] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:16:0)
[10:30:39.625] Build status: STARTED
[10:30:39.625] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:17:0) after 6m53s
[10:37:32.634] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:17:0)
[10:37:32.657] Build status: STARTED
[10:37:32.657] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:18:0) after 4m5s
[10:41:37.681] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:18:0)
[10:41:37.697] Build status: STARTED
[10:41:37.697] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:19:0) after 9m48s
[10:51:25.745] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:19:0)
[10:51:25.803] Build status: STARTED
[10:51:25.803] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:20:0) after 7m40s
[10:59:05.896] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:20:0)
[10:59:05.914] Build status: STARTED
[10:59:05.914] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:21:0) after 9m8s
[11:08:14.074] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:21:0)
[11:08:14.091] Build status: STARTED
[11:08:14.091] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:22:0) after 4m12s
[11:12:26.263] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:22:0)
[11:12:26.279] Build status: STARTED
[11:12:26.279] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:23:0) after 1m30s
[11:13:56.509] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:23:0)
[11:13:56.527] Build status: STARTED
[11:13:56.527] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:24:0) after 3m6s
[11:17:02.592] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:24:0)
[11:17:02.608] Build status: STARTED
[11:17:02.608] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:25:0) after 7m36s
[11:24:38.708] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:25:0)
[11:24:38.773] Build status: STARTED
[11:24:38.773] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:26:0) after 8m25s
[11:33:03.838] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:26:0)
[11:33:03.858] Build status: STARTED
[11:33:03.858] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:27:0) after 6m6s
[11:39:09.879] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:27:0)
[11:39:09.899] Build status: STARTED
[11:39:09.899] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:28:0) after 2m15s
[11:41:24.936] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:28:0)
[11:41:25.017] Build status: STARTED
[11:41:25.017] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:29:0) after 2m58s
[11:44:23.056] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:29:0)
[11:44:23.070] Build status: STARTED
[11:44:23.070] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:30:0) after 5m16s
[11:49:39.089] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:30:0)
[11:49:39.113] Build status: STARTED
[11:49:39.113] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:31:0) after 2m53s
[11:52:32.134] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:31:0)
[11:52:32.156] Build status: STARTED
[11:52:32.156] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:32:0) after 4m51s
[11:57:23.182] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:32:0)
[11:57:23.209] Build status: STARTED
[11:57:23.209] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:33:0) after 5m34s
[12:02:57.272] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:33:0)
[12:02:57.293] Build status: STARTED
[12:02:57.293] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:34:0) after 7m22s
[12:10:19.320] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:34:0)
[12:10:19.336] Build status: STARTED
[12:10:19.336] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:35:0) after 3m44s
[12:14:03.346] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:35:0)
[12:14:03.390] Build status: STARTED
[12:14:03.390] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:36:0) after 8m17s
[12:22:20.447] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:36:0)
[12:22:20.473] Build status: STARTED
[12:22:20.473] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:37:0) after 6m58s
[12:29:18.490] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:37:0)
[12:29:18.517] Build status: STARTED
[12:29:18.517] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:38:0) after 6m24s
[12:35:42.548] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:38:0)
[12:35:42.601] Build status: STARTED
[12:35:42.601] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:39:0) after 7m43s
[12:43:25.659] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:39:0)
[12:43:25.675] Build status: STARTED
[12:43:25.675] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:40:0) after 5m38s
[12:49:03.734] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:40:0)
[12:49:03.752] Build status: STARTED
[12:49:03.752] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:41:0) after 2m41s
[12:51:44.775] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:41:0)
[12:51:44.793] Build status: STARTED
[12:51:44.793] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:42:0) after 7m39s
[12:59:23.814] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:42:0)
[12:59:23.830] Build status: STARTED
[12:59:23.830] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:43:0) after 5m13s
[13:04:36.854] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:43:0)
[13:04:36.876] Build status: STARTED
[13:04:36.876] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:44:0) after 6m40s
[13:11:16.947] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:44:0)
[13:11:16.967] Build status: STARTED
[13:11:16.967] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:45:0) after 5m57s
[13:17:14.043] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:45:0)
[13:17:14.063] Build status: STARTED
[13:17:14.063] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:46:0) after 3m46s
[13:21:00.183] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:46:0)
[13:21:00.269] Build status: STARTED
[13:21:00.269] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:47:0) after 6m48s
[13:27:48.313] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:47:0)
[13:27:48.327] Build status: STARTED
[13:27:48.327] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:48:0) after 7m24s
[13:35:12.364] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:48:0)
[13:35:12.386] Build status: STARTED
[13:35:12.387] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:49:0) after 7m12s
[13:42:24.386] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:49:0)
[13:42:24.474] Build status: STARTED
[13:42:24.474] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:50:0) after 4m16s
[13:46:40.594] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:50:0)
[13:46:41.081] Build status: STARTED
[13:46:41.081] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:51:0) after 2m31s
[13:49:12.133] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:51:0)
[13:49:12.149] Build status: STARTED
[13:49:12.149] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:52:0) after 7m17s
[13:56:29.118] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:52:0)
[13:56:29.136] Build status: STARTED
[13:56:29.136] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:53:0) after 2m23s
[13:58:52.160] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:53:0)
[13:58:52.179] Build status: STARTED
[13:58:52.179] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:54:0) after 3m43s
[14:02:35.289] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:54:0)
[14:02:35.310] Build status: STARTED
[14:02:35.310] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:55:0) after 6m53s
[14:09:28.395] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:55:0)
[14:09:28.412] Build status: STARTED
[14:09:28.412] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:56:0) after 1m30s
[14:10:58.482] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:56:0)
[14:10:58.586] Build status: STARTED
[14:10:58.586] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:57:0) after 5m41s
[14:16:39.606] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:57:0)
[14:16:39.721] Build status: STARTED
[14:16:39.721] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:58:0) after 6m27s
[14:23:06.739] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:58:0)
[14:23:06.766] Build status: STARTED
[14:23:06.766] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:59:0) after 4m7s
[14:27:13.786] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:59:0)
[14:27:13.811] Build status: STARTED
[14:27:13.811] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:60:0) after 7m45s
[14:34:58.882] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:60:0)
[14:34:58.899] Build status: STARTED
[14:34:58.899] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:61:0) after 3m44s
[14:38:43.010] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:61:0)
[14:38:43.033] Build status: STARTED
[14:38:43.033] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:62:0) after 2m53s
[14:41:36.057] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:62:0)
[14:41:36.075] Build status: STARTED
[14:41:36.075] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:63:0) after 5m53s
[14:47:29.143] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:63:0)
[14:47:29.163] Build status: STARTED
[14:47:29.163] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:64:0) after 4m30s
[14:51:59.234] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:64:0)
[14:51:59.255] Build status: STARTED
[14:51:59.255] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:65:0) after 9m58s
[15:01:57.269] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:65:0)
[15:01:57.287] Build status: STARTED
[15:01:57.287] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:66:0) after 6m31s
[15:08:28.432] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:66:0)
[15:08:28.451] Build status: STARTED
[15:08:28.451] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:67:0) after 3m21s
[15:11:49.440] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:67:0)
[15:11:49.459] Build status: STARTED
[15:11:49.459] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:68:0) after 1m47s
[15:13:36.493] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:68:0)
[15:13:36.508] Build status: STARTED
[15:13:36.508] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8845909806710709744:69:0) after 8m3s
[15:15:59.021] Received PubSub notification, asking Buildbucket for the build status
[15:15:59.050] Build:
{
"id": "8680479744188491473",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacPGO"
},
"number": 2909,
"createdBy": "project:chromium",
"createTime": "2026-05-29T09:20:36.090024765Z",
"startTime": "2026-05-29T09:21:23.586308867Z",
"endTime": "2026-05-29T15:15:58.610968687Z",
"updateTime": "2026-05-29T15:15:58.610968687Z",
"status": "SUCCESS",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "bdd6350bab8e6fc35a80bf7a13a53237e2a6801b",
"ref": "refs/heads/main"
}
}
}
[15:15:59.050] Invocation finished in 5h55m24.749874051s with status SUCCEEDED