[21:56:35.196] New invocation is queued and will start shortly
[21:56:36.295] Starting the invocation (attempt 1)
[21:56:36.316] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/db2fcdb48d673c97fa4ee03de85eb30aef39343f"
[21:56:36.316] Popped gitiles commit info from properties and tags
[21:56:36.316] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[21:56:36.316] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[21:56:36.316] Buildbucket request:
{
"requestId": "8864706411391372784",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacPGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "db2fcdb48d673c97fa4ee03de85eb30aef39343f",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8864706411391372784"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacPGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[21:56:36.777] Scheduled build:
{
"id": "8699276349496792593",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacPGO"
},
"number": 159,
"createdBy": "project:chromium",
"createTime": "2025-11-02T21:56:36.372036951Z",
"updateTime": "2025-11-02T21:56:36.372036951Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "db2fcdb48d673c97fa4ee03de85eb30aef39343f",
"ref": "refs/heads/main"
}
}
}
[21:56:36.777] Task URL: https://cr-buildbucket.appspot.com/build/8699276349496792593
[21:56:36.777] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8864706411391372784:2:0) after 4m45s
[21:56:37.271] Received PubSub notification, asking Buildbucket for the build status
[21:56:37.286] Build status: SCHEDULED
[21:56:39.654] Received PubSub notification, asking Buildbucket for the build status
[21:56:39.670] Build status: STARTED
[22:01:21.791] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8864706411391372784:2:0)
[22:01:21.859] Build status: STARTED
[22:01:21.859] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8864706411391372784:5:0) after 2m32s
[22:03:53.874] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8864706411391372784:5:0)
[22:03:53.889] Build status: STARTED
[22:03:53.890] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8864706411391372784:6:0) after 4m13s
[22:08:06.906] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8864706411391372784:6:0)
[22:08:06.924] Build status: STARTED
[22:08:06.924] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8864706411391372784:7:0) after 4m43s
[22:12:50.011] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8864706411391372784:7:0)
[22:12:50.044] Build status: STARTED
[22:12:50.044] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8864706411391372784:8:0) after 9m47s
[22:22:37.058] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8864706411391372784:8:0)
[22:22:37.086] Build status: STARTED
[22:22:37.086] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8864706411391372784:9:0) after 4m13s
[22:26:50.344] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8864706411391372784:9:0)
[22:26:50.363] Build status: STARTED
[22:26:50.363] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8864706411391372784:10:0) after 3m19s
[22:30:09.472] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8864706411391372784:10:0)
[22:30:09.493] Build status: STARTED
[22:30:09.493] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8864706411391372784:11:0) after 7m9s
[22:37:18.610] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8864706411391372784:11:0)
[22:37:18.674] Build status: STARTED
[22:37:18.674] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8864706411391372784:12:0) after 5m56s
[22:43:14.679] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8864706411391372784:12:0)
[22:43:14.697] Build status: STARTED
[22:43:14.697] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8864706411391372784:13:0) after 8m26s
[22:51:40.799] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8864706411391372784:13:0)
[22:51:40.818] Build status: STARTED
[22:51:40.818] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8864706411391372784:14:0) after 6m46s
[22:58:26.835] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8864706411391372784:14:0)
[22:58:26.855] Build status: STARTED
[22:58:26.855] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8864706411391372784:15:0) after 7m7s
[23:05:33.904] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8864706411391372784:15:0)
[23:05:33.926] Build status: STARTED
[23:05:33.926] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8864706411391372784:16:0) after 4m17s
[23:09:51.241] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8864706411391372784:16:0)
[23:09:51.256] Build status: STARTED
[23:09:51.256] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8864706411391372784:17:0) after 5m22s
[23:15:13.646] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8864706411391372784:17:0)
[23:15:13.668] Build status: STARTED
[23:15:13.668] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8864706411391372784:18:0) after 6m25s
[23:21:38.752] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8864706411391372784:18:0)
[23:21:38.861] Build status: STARTED
[23:21:38.861] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8864706411391372784:19:0) after 8m9s
[23:29:48.055] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8864706411391372784:19:0)
[23:29:48.075] Build status: STARTED
[23:29:48.075] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8864706411391372784:20:0) after 1m0s
[23:30:48.291] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8864706411391372784:20:0)
[23:30:48.314] Build status: STARTED
[23:30:48.314] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8864706411391372784:21:0) after 6m24s
[23:37:12.328] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8864706411391372784:21:0)
[23:37:12.350] Build status: STARTED
[23:37:12.350] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8864706411391372784:22:0) after 1m36s
[23:38:48.379] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8864706411391372784:22:0)
[23:38:48.397] Build status: STARTED
[23:38:48.397] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8864706411391372784:23:0) after 4m50s
[23:43:38.414] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8864706411391372784:23:0)
[23:43:38.428] Build status: STARTED
[23:43:38.428] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8864706411391372784:24:0) after 5m42s
[23:49:20.546] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8864706411391372784:24:0)
[23:49:20.562] Build status: STARTED
[23:49:20.562] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8864706411391372784:25:0) after 7m43s
[23:57:03.579] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8864706411391372784:25:0)
[23:57:03.634] Build status: STARTED
[23:57:03.634] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8864706411391372784:26:0) after 7m39s
[00:04:43.245] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8864706411391372784:26:0)
[00:04:43.282] Build status: STARTED
[00:04:43.282] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8864706411391372784:27:0) after 2m7s
[00:06:50.298] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8864706411391372784:27:0)
[00:06:50.319] Build status: STARTED
[00:06:50.319] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8864706411391372784:28:0) after 8m12s
[00:15:02.335] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8864706411391372784:28:0)
[00:15:02.354] Build status: STARTED
[00:15:02.354] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8864706411391372784:29:0) after 5m31s
[00:20:33.370] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8864706411391372784:29:0)
[00:20:33.384] Build status: STARTED
[00:20:33.384] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8864706411391372784:30:0) after 6m46s
[00:27:19.401] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8864706411391372784:30:0)
[00:27:19.425] Build status: STARTED
[00:27:19.425] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8864706411391372784:31:0) after 8m39s
[00:35:58.441] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8864706411391372784:31:0)
[00:35:58.456] Build status: STARTED
[00:35:58.456] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8864706411391372784:32:0) after 2m8s
[00:38:06.474] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8864706411391372784:32:0)
[00:38:06.495] Build status: STARTED
[00:38:06.495] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8864706411391372784:33:0) after 6m19s
[00:44:25.593] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8864706411391372784:33:0)
[00:44:25.630] Build status: STARTED
[00:44:25.630] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8864706411391372784:34:0) after 2m58s
[00:47:23.625] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8864706411391372784:34:0)
[00:47:23.641] Build status: STARTED
[00:47:23.641] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8864706411391372784:35:0) after 6m5s
[00:53:28.673] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8864706411391372784:35:0)
[00:53:28.691] Build status: STARTED
[00:53:28.691] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8864706411391372784:36:0) after 3m13s
[00:56:41.866] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8864706411391372784:36:0)
[00:56:41.882] Build status: STARTED
[00:56:41.883] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8864706411391372784:37:0) after 5m51s
[01:02:32.985] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8864706411391372784:37:0)
[01:02:33.066] Build status: STARTED
[01:02:33.066] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8864706411391372784:38:0) after 2m35s
[01:05:08.176] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8864706411391372784:38:0)
[01:05:08.197] Build status: STARTED
[01:05:08.197] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8864706411391372784:39:0) after 7m24s
[01:05:31.305] Received PubSub notification, asking Buildbucket for the build status
[01:05:31.321] Build:
{
"id": "8699276349496792593",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacPGO"
},
"number": 159,
"createdBy": "project:chromium",
"createTime": "2025-11-02T21:56:36.372036951Z",
"startTime": "2025-11-02T21:56:39.401651368Z",
"endTime": "2025-11-03T01:05:31.010526547Z",
"updateTime": "2025-11-03T01:05:31.010526547Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "db2fcdb48d673c97fa4ee03de85eb30aef39343f",
"ref": "refs/heads/main"
}
}
}
[01:05:31.321] Invocation finished in 3h8m56.138787799s with status FAILED