[15:15:56.670] New invocation is queued and will start shortly
[15:15:57.757] Starting the invocation (attempt 1)
[15:15:57.783] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/626e7afa47443efd098df5ae005c52df003326f1"
[15:15:57.783] Popped gitiles commit info from properties and tags
[15:15:57.783] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[15:15:57.783] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[15:15:57.783] Buildbucket request:
{
"requestId": "8838911482179106496",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacPGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "626e7afa47443efd098df5ae005c52df003326f1",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8838911482179106496"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacPGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[15:15:58.321] Scheduled build:
{
"id": "8673481420283547745",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacPGO"
},
"number": 4410,
"createdBy": "project:chromium",
"createTime": "2026-08-14T15:15:57.856337340Z",
"updateTime": "2026-08-14T15:15:57.856337340Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "626e7afa47443efd098df5ae005c52df003326f1",
"ref": "refs/heads/main"
}
}
}
[15:15:58.321] Task URL: https://cr-buildbucket.appspot.com/build/8673481420283547745
[15:15:58.321] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:2:0) after 9m33s
[15:15:59.259] Received PubSub notification, asking Buildbucket for the build status
[15:15:59.373] Build status: SCHEDULED
[15:16:03.352] Received PubSub notification, asking Buildbucket for the build status
[15:16:03.370] Build status: STARTED
[15:25:31.426] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:2:0)
[15:25:31.447] Build status: STARTED
[15:25:31.447] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:5:0) after 5m27s
[15:30:58.490] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:5:0)
[15:30:58.515] Build status: STARTED
[15:30:58.515] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:6:0) after 7m18s
[15:38:16.591] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:6:0)
[15:38:16.612] Build status: STARTED
[15:38:16.612] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:7:0) after 2m4s
[15:40:20.637] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:7:0)
[15:40:20.660] Build status: STARTED
[15:40:20.661] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:8:0) after 6m2s
[15:46:22.727] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:8:0)
[15:46:22.753] Build status: STARTED
[15:46:22.753] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:9:0) after 6m46s
[15:53:08.823] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:9:0)
[15:53:08.880] Build status: STARTED
[15:53:08.880] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:10:0) after 5m19s
[15:58:27.978] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:10:0)
[15:58:28.004] Build status: STARTED
[15:58:28.004] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:11:0) after 3m45s
[16:02:13.070] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:11:0)
[16:02:13.101] Build status: STARTED
[16:02:13.101] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:12:0) after 8m31s
[16:10:44.120] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:12:0)
[16:10:44.136] Build status: STARTED
[16:10:44.136] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:13:0) after 7m17s
[16:18:01.161] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:13:0)
[16:18:01.217] Build status: STARTED
[16:18:01.217] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:14:0) after 9m16s
[16:27:17.332] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:14:0)
[16:27:17.371] Build status: STARTED
[16:27:17.371] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:15:0) after 9m51s
[16:37:08.395] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:15:0)
[16:37:08.416] Build status: STARTED
[16:37:08.416] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:16:0) after 4m49s
[16:41:57.489] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:16:0)
[16:41:57.515] Build status: STARTED
[16:41:57.515] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:17:0) after 3m12s
[16:45:09.584] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:17:0)
[16:45:09.610] Build status: STARTED
[16:45:09.610] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:18:0) after 3m44s
[16:48:53.680] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:18:0)
[16:48:53.718] Build status: STARTED
[16:48:53.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:19:0) after 8m19s
[16:57:12.827] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:19:0)
[16:57:12.847] Build status: STARTED
[16:57:12.847] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:20:0) after 7m45s
[17:04:57.983] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:20:0)
[17:04:58.007] Build status: STARTED
[17:04:58.007] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:21:0) after 6m45s
[17:11:43.075] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:21:0)
[17:11:43.181] Build status: STARTED
[17:11:43.181] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:22:0) after 2m15s
[17:13:58.235] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:22:0)
[17:13:58.270] Build status: STARTED
[17:13:58.270] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:23:0) after 9m35s
[17:23:33.289] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:23:0)
[17:23:33.306] Build status: STARTED
[17:23:33.306] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:24:0) after 7m37s
[17:31:10.352] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:24:0)
[17:31:10.377] Build status: STARTED
[17:31:10.377] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:25:0) after 9m33s
[17:40:43.412] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:25:0)
[17:40:43.510] Build status: STARTED
[17:40:43.511] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:26:0) after 8m8s
[17:48:51.659] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:26:0)
[17:48:51.677] Build status: STARTED
[17:48:51.677] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:27:0) after 7m0s
[17:55:51.799] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:27:0)
[17:55:51.818] Build status: STARTED
[17:55:51.818] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:28:0) after 4m56s
[18:00:47.875] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:28:0)
[18:00:47.909] Build status: STARTED
[18:00:47.909] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:29:0) after 7m33s
[18:08:21.221] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:29:0)
[18:08:21.247] Build status: STARTED
[18:08:21.247] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:30:0) after 2m9s
[18:10:30.265] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:30:0)
[18:10:30.318] Build status: STARTED
[18:10:30.318] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:31:0) after 7m50s
[18:18:20.363] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:31:0)
[18:18:20.392] Build status: STARTED
[18:18:20.392] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:32:0) after 1m42s
[18:20:02.466] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:32:0)
[18:20:02.486] Build status: STARTED
[18:20:02.486] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:33:0) after 9m21s
[18:29:23.645] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:33:0)
[18:29:23.667] Build status: STARTED
[18:29:23.667] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:34:0) after 6m0s
[18:35:23.773] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:34:0)
[18:35:23.855] Build status: STARTED
[18:35:23.855] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:35:0) after 2m0s
[18:37:23.984] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:35:0)
[18:37:24.000] Build status: STARTED
[18:37:24.000] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:36:0) after 3m51s
[18:41:15.021] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:36:0)
[18:41:15.065] Build status: STARTED
[18:41:15.065] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:37:0) after 7m0s
[18:48:15.080] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:37:0)
[18:48:15.096] Build status: STARTED
[18:48:15.096] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:38:0) after 8m57s
[18:57:12.255] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:38:0)
[18:57:12.273] Build status: STARTED
[18:57:12.273] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:39:0) after 9m15s
[19:06:27.289] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:39:0)
[19:06:27.317] Build status: STARTED
[19:06:27.317] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:40:0) after 1m35s
[19:08:02.341] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:40:0)
[19:08:02.362] Build status: STARTED
[19:08:02.362] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:41:0) after 4m18s
[19:12:20.382] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:41:0)
[19:12:20.410] Build status: STARTED
[19:12:20.410] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:42:0) after 9m8s
[19:21:28.407] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:42:0)
[19:21:28.519] Build status: STARTED
[19:21:28.519] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:43:0) after 1m29s
[19:22:57.829] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:43:0)
[19:22:57.853] Build status: STARTED
[19:22:57.853] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:44:0) after 2m4s
[19:25:01.872] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:44:0)
[19:25:01.905] Build status: STARTED
[19:25:01.905] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:45:0) after 8m39s
[19:33:40.994] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:45:0)
[19:33:41.015] Build status: STARTED
[19:33:41.015] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:46:0) after 6m51s
[19:40:32.045] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:46:0)
[19:40:32.068] Build status: STARTED
[19:40:32.068] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:47:0) after 7m4s
[19:47:36.144] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:47:0)
[19:47:36.184] Build status: STARTED
[19:47:36.184] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:48:0) after 5m57s
[19:53:33.330] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:48:0)
[19:53:33.376] Build status: STARTED
[19:53:33.376] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:49:0) after 7m14s
[20:00:47.436] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:49:0)
[20:00:47.466] Build status: STARTED
[20:00:47.466] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:50:0) after 3m49s
[20:04:36.516] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:50:0)
[20:04:36.544] Build status: STARTED
[20:04:36.544] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:51:0) after 7m31s
[20:12:07.650] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:51:0)
[20:12:07.672] Build status: STARTED
[20:12:07.672] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:52:0) after 6m22s
[20:18:29.795] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:52:0)
[20:18:29.821] Build status: STARTED
[20:18:29.821] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:53:0) after 2m10s
[20:20:39.882] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:53:0)
[20:20:39.903] Build status: STARTED
[20:20:39.903] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:54:0) after 2m26s
[20:23:05.877] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:54:0)
[20:23:05.911] Build status: STARTED
[20:23:05.911] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:55:0) after 7m43s
[20:30:49.038] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:55:0)
[20:30:49.059] Build status: STARTED
[20:30:49.059] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:56:0) after 7m16s
[20:38:05.083] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:56:0)
[20:38:05.112] Build status: STARTED
[20:38:05.112] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:57:0) after 4m47s
[20:42:52.132] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:57:0)
[20:42:52.206] Build status: STARTED
[20:42:52.206] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:58:0) after 6m1s
[20:48:53.283] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:58:0)
[20:48:53.303] Build status: STARTED
[20:48:53.303] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:59:0) after 9m41s
[20:58:34.326] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:59:0)
[20:58:34.356] Build status: STARTED
[20:58:34.356] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:60:0) after 8m12s
[21:06:46.543] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:60:0)
[21:06:46.608] Build status: STARTED
[21:06:46.608] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:61:0) after 6m46s
[21:13:32.684] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:61:0)
[21:13:32.712] Build status: STARTED
[21:13:32.712] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:62:0) after 2m34s
[21:16:06.833] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:62:0)
[21:16:06.854] Build status: STARTED
[21:16:06.854] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:63:0) after 3m25s
[21:19:31.874] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:63:0)
[21:19:31.894] Build status: STARTED
[21:19:31.894] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:64:0) after 4m54s
[21:24:26.177] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:64:0)
[21:24:26.214] Build status: STARTED
[21:24:26.214] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:65:0) after 8m44s
[21:33:10.236] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:65:0)
[21:33:10.253] Build status: STARTED
[21:33:10.253] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:66:0) after 3m59s
[21:37:09.328] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:66:0)
[21:37:09.361] Build status: STARTED
[21:37:09.361] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:67:0) after 3m34s
[21:40:43.383] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:67:0)
[21:40:43.404] Build status: STARTED
[21:40:43.404] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8838911482179106496:68:0) after 5m19s
[21:43:26.678] Received PubSub notification, asking Buildbucket for the build status
[21:43:26.697] Build:
{
"id": "8673481420283547745",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacPGO"
},
"number": 4410,
"createdBy": "project:chromium",
"createTime": "2026-08-14T15:15:57.856337340Z",
"startTime": "2026-08-14T15:16:02.921465639Z",
"endTime": "2026-08-14T21:43:26.274199948Z",
"updateTime": "2026-08-14T21:43:26.274199948Z",
"status": "SUCCESS",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "626e7afa47443efd098df5ae005c52df003326f1",
"ref": "refs/heads/main"
}
}
}
[21:43:26.697] Invocation finished in 6h27m30.032253146s with status SUCCEEDED