[20:43:17.539] New invocation is queued and will start shortly
[20:43:18.763] Starting the invocation (attempt 1)
[20:43:18.793] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/2dff19e862049c37d453e717ac9c56ad39281023"
[20:43:18.793] Popped gitiles commit info from properties and tags
[20:43:18.793] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[20:43:18.793] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[20:43:18.793] Buildbucket request:
{
"requestId": "8835357605544410288",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacPGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2dff19e862049c37d453e717ac9c56ad39281023",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8835357605544410288"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacPGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[20:43:19.675] Scheduled build:
{
"id": "8669927543472690129",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacPGO"
},
"number": 4687,
"createdBy": "project:chromium",
"createTime": "2026-09-22T20:43:18.894851796Z",
"updateTime": "2026-09-22T20:43:18.894851796Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2dff19e862049c37d453e717ac9c56ad39281023",
"ref": "refs/heads/main"
}
}
}
[20:43:19.675] Task URL: https://cr-buildbucket.appspot.com/build/8669927543472690129
[20:43:19.675] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8835357605544410288:2:0) after 4m33s
[20:43:20.646] Received PubSub notification, asking Buildbucket for the build status
[20:43:20.674] Build status: SCHEDULED
[20:44:05.440] Received PubSub notification, asking Buildbucket for the build status
[20:44:05.459] Build status: STARTED
[20:47:52.886] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8835357605544410288:2:0)
[20:47:52.908] Build status: STARTED
[20:47:52.908] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8835357605544410288:5:0) after 1m47s
[20:49:39.931] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8835357605544410288:5:0)
[20:49:40.009] Build status: STARTED
[20:49:40.009] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8835357605544410288:6:0) after 5m43s
[20:55:23.825] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8835357605544410288:6:0)
[20:55:23.849] Build status: STARTED
[20:55:23.849] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8835357605544410288:7:0) after 2m3s
[20:57:27.087] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8835357605544410288:7:0)
[20:57:27.114] Build status: STARTED
[20:57:27.114] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8835357605544410288:8:0) after 5m51s
[21:03:18.558] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8835357605544410288:8:0)
[21:03:18.581] Build status: STARTED
[21:03:18.581] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8835357605544410288:9:0) after 4m25s
[21:07:43.614] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8835357605544410288:9:0)
[21:07:43.638] Build status: STARTED
[21:07:43.638] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8835357605544410288:10:0) after 4m45s
[21:12:28.709] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8835357605544410288:10:0)
[21:12:28.740] Build status: STARTED
[21:12:28.740] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8835357605544410288:11:0) after 2m33s
[21:15:01.866] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8835357605544410288:11:0)
[21:15:01.892] Build status: STARTED
[21:15:01.892] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8835357605544410288:12:0) after 8m43s
[21:23:44.907] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8835357605544410288:12:0)
[21:23:44.930] Build status: STARTED
[21:23:44.930] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8835357605544410288:13:0) after 7m49s
[21:31:34.152] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8835357605544410288:13:0)
[21:31:34.178] Build status: STARTED
[21:31:34.178] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8835357605544410288:14:0) after 1m30s
[21:33:04.326] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8835357605544410288:14:0)
[21:33:04.344] Build status: STARTED
[21:33:04.344] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8835357605544410288:15:0) after 6m33s
[21:39:37.488] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8835357605544410288:15:0)
[21:39:37.514] Build status: STARTED
[21:39:37.514] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8835357605544410288:16:0) after 2m55s
[21:42:32.586] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8835357605544410288:16:0)
[21:42:32.602] Build status: STARTED
[21:42:32.602] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8835357605544410288:17:0) after 8m58s
[21:51:30.644] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8835357605544410288:17:0)
[21:51:30.663] Build status: STARTED
[21:51:30.664] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8835357605544410288:18:0) after 1m3s
[21:52:33.681] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8835357605544410288:18:0)
[21:52:33.701] Build status: STARTED
[21:52:33.701] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8835357605544410288:19:0) after 9m45s
[22:02:18.824] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8835357605544410288:19:0)
[22:02:18.842] Build status: STARTED
[22:02:18.842] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8835357605544410288:20:0) after 2m27s
[22:04:45.823] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8835357605544410288:20:0)
[22:04:45.859] Build status: STARTED
[22:04:45.859] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8835357605544410288:21:0) after 8m22s
[22:13:07.834] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8835357605544410288:21:0)
[22:13:07.861] Build status: STARTED
[22:13:07.862] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8835357605544410288:22:0) after 7m17s
[22:20:24.883] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8835357605544410288:22:0)
[22:20:24.902] Build status: STARTED
[22:20:24.902] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8835357605544410288:23:0) after 1m8s
[22:21:32.962] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8835357605544410288:23:0)
[22:21:33.007] Build status: STARTED
[22:21:33.007] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8835357605544410288:24:0) after 4m39s
[22:26:12.067] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8835357605544410288:24:0)
[22:26:12.170] Build status: STARTED
[22:26:12.170] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8835357605544410288:25:0) after 6m10s
[22:32:22.192] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8835357605544410288:25:0)
[22:32:22.251] Build status: STARTED
[22:32:22.251] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8835357605544410288:26:0) after 1m3s
[22:33:25.294] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8835357605544410288:26:0)
[22:33:25.312] Build status: STARTED
[22:33:25.312] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8835357605544410288:27:0) after 1m25s
[22:34:50.405] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8835357605544410288:27:0)
[22:34:50.426] Build status: STARTED
[22:34:50.426] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8835357605544410288:28:0) after 2m40s
[22:37:30.669] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8835357605544410288:28:0)
[22:37:30.744] Build status: STARTED
[22:37:30.744] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8835357605544410288:29:0) after 2m51s
[22:40:21.796] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8835357605544410288:29:0)
[22:40:21.825] Build status: STARTED
[22:40:21.825] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8835357605544410288:30:0) after 1m45s
[22:42:06.837] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8835357605544410288:30:0)
[22:42:06.857] Build status: STARTED
[22:42:06.857] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8835357605544410288:31:0) after 9m4s
[22:51:10.942] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8835357605544410288:31:0)
[22:51:10.959] Build status: STARTED
[22:51:10.959] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8835357605544410288:32:0) after 1m55s
[22:53:05.956] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8835357605544410288:32:0)
[22:53:05.987] Build status: STARTED
[22:53:05.987] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8835357605544410288:33:0) after 5m35s
[22:58:41.185] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8835357605544410288:33:0)
[22:58:41.232] Build status: STARTED
[22:58:41.232] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8835357605544410288:34:0) after 5m5s
[23:03:46.314] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8835357605544410288:34:0)
[23:03:46.334] Build status: STARTED
[23:03:46.334] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8835357605544410288:35:0) after 9m47s
[23:13:33.430] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8835357605544410288:35:0)
[23:13:33.464] Build status: STARTED
[23:13:33.464] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8835357605544410288:36:0) after 5m7s
[23:18:40.485] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8835357605544410288:36:0)
[23:18:40.506] Build status: STARTED
[23:18:40.506] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8835357605544410288:37:0) after 6m21s
[23:25:01.505] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8835357605544410288:37:0)
[23:25:01.532] Build status: STARTED
[23:25:01.533] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8835357605544410288:38:0) after 2m11s
[23:27:12.601] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8835357605544410288:38:0)
[23:27:12.624] Build status: STARTED
[23:27:12.624] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8835357605544410288:39:0) after 7m39s
[23:31:08.899] Received PubSub notification, asking Buildbucket for the build status
[23:31:08.919] Build:
{
"id": "8669927543472690129",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacPGO"
},
"number": 4687,
"createdBy": "project:chromium",
"createTime": "2026-09-22T20:43:18.894851796Z",
"startTime": "2026-09-22T20:44:04.895634270Z",
"endTime": "2026-09-22T23:31:08.611216739Z",
"updateTime": "2026-09-22T23:31:08.611216739Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2dff19e862049c37d453e717ac9c56ad39281023",
"ref": "refs/heads/main"
}
}
}
[23:31:08.919] Invocation finished in 2h47m51.384524409s with status FAILED