[22:17:44.289] New invocation is queued and will start shortly
[22:17:45.458] Starting the invocation (attempt 1)
[22:17:45.488] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/3d27c3885185d0dfe7469fdccc48a01187942e0b"
[22:17:45.488] Popped gitiles commit info from properties and tags
[22:17:45.488] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[22:17:45.488] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[22:17:45.488] Buildbucket request:
{
"requestId": "8842327629985832320",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacPGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3d27c3885185d0dfe7469fdccc48a01187942e0b",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8842327629985832320"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacPGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[22:17:46.165] Scheduled build:
{
"id": "8676897567860525057",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacPGO"
},
"number": 3674,
"createdBy": "project:chromium",
"createTime": "2026-07-07T22:17:45.651531833Z",
"updateTime": "2026-07-07T22:17:45.651531833Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3d27c3885185d0dfe7469fdccc48a01187942e0b",
"ref": "refs/heads/main"
}
}
}
[22:17:46.165] Task URL: https://cr-buildbucket.appspot.com/build/8676897567860525057
[22:17:46.165] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842327629985832320:2:0) after 5m59s
[22:17:47.167] Received PubSub notification, asking Buildbucket for the build status
[22:17:47.193] Build status: SCHEDULED
[22:18:20.495] Received PubSub notification, asking Buildbucket for the build status
[22:18:20.513] Build status: STARTED
[22:23:45.162] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842327629985832320:2:0)
[22:23:45.179] Build status: STARTED
[22:23:45.179] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842327629985832320:5:0) after 6m47s
[22:30:32.172] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842327629985832320:5:0)
[22:30:32.192] Build status: STARTED
[22:30:32.192] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842327629985832320:6:0) after 8m36s
[22:39:08.209] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842327629985832320:6:0)
[22:39:08.231] Build status: STARTED
[22:39:08.231] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842327629985832320:7:0) after 9m32s
[22:48:40.440] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842327629985832320:7:0)
[22:48:40.455] Build status: STARTED
[22:48:40.455] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842327629985832320:8:0) after 8m11s
[22:56:51.475] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842327629985832320:8:0)
[22:56:51.493] Build status: STARTED
[22:56:51.493] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842327629985832320:9:0) after 7m58s
[23:04:49.717] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842327629985832320:9:0)
[23:04:49.733] Build status: STARTED
[23:04:49.733] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842327629985832320:10:0) after 4m41s
[23:09:30.936] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842327629985832320:10:0)
[23:09:30.953] Build status: STARTED
[23:09:30.953] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842327629985832320:11:0) after 4m23s
[23:13:54.005] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842327629985832320:11:0)
[23:13:54.024] Build status: STARTED
[23:13:54.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842327629985832320:12:0) after 1m54s
[23:15:48.026] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842327629985832320:12:0)
[23:15:48.186] Build status: STARTED
[23:15:48.186] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842327629985832320:13:0) after 8m45s
[23:24:33.438] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842327629985832320:13:0)
[23:24:33.455] Build status: STARTED
[23:24:33.455] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842327629985832320:14:0) after 3m49s
[23:28:22.739] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842327629985832320:14:0)
[23:28:22.761] Build status: STARTED
[23:28:22.761] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842327629985832320:15:0) after 9m35s
[23:37:57.798] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842327629985832320:15:0)
[23:37:57.814] Build status: STARTED
[23:37:57.814] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842327629985832320:16:0) after 7m42s
[23:45:40.023] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842327629985832320:16:0)
[23:45:40.041] Build status: STARTED
[23:45:40.041] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842327629985832320:17:0) after 3m4s
[23:48:44.204] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842327629985832320:17:0)
[23:48:44.229] Build status: STARTED
[23:48:44.229] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842327629985832320:18:0) after 6m7s
[23:54:51.462] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842327629985832320:18:0)
[23:54:51.504] Build status: STARTED
[23:54:51.504] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842327629985832320:19:0) after 9m59s
[00:04:50.604] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842327629985832320:19:0)
[00:04:50.689] Build status: STARTED
[00:04:50.689] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842327629985832320:20:0) after 1m51s
[00:06:41.738] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842327629985832320:20:0)
[00:06:41.777] Build status: STARTED
[00:06:41.777] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842327629985832320:21:0) after 8m47s
[00:15:29.223] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842327629985832320:21:0)
[00:15:29.407] Build status: STARTED
[00:15:29.407] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842327629985832320:22:0) after 8m14s
[00:23:43.443] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842327629985832320:22:0)
[00:23:43.459] Build status: STARTED
[00:23:43.459] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842327629985832320:23:0) after 1m37s
[00:25:20.498] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842327629985832320:23:0)
[00:25:20.591] Build status: STARTED
[00:25:20.591] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842327629985832320:24:0) after 6m32s
[00:31:52.668] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842327629985832320:24:0)
[00:31:52.723] Build status: STARTED
[00:31:52.723] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842327629985832320:25:0) after 1m58s
[00:33:50.876] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842327629985832320:25:0)
[00:33:50.899] Build status: STARTED
[00:33:50.899] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842327629985832320:26:0) after 8m21s
[00:42:11.905] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842327629985832320:26:0)
[00:42:11.931] Build status: STARTED
[00:42:11.931] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842327629985832320:27:0) after 5m15s
[00:47:27.033] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842327629985832320:27:0)
[00:47:27.052] Build status: STARTED
[00:47:27.052] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842327629985832320:28:0) after 5m20s
[00:52:47.057] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842327629985832320:28:0)
[00:52:47.073] Build status: STARTED
[00:52:47.074] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842327629985832320:29:0) after 3m15s
[00:56:02.135] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842327629985832320:29:0)
[00:56:02.167] Build status: STARTED
[00:56:02.167] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842327629985832320:30:0) after 8m53s
[01:04:55.213] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842327629985832320:30:0)
[01:04:55.232] Build status: STARTED
[01:04:55.232] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842327629985832320:31:0) after 3m30s
[01:08:25.288] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842327629985832320:31:0)
[01:08:25.319] Build status: STARTED
[01:08:25.319] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842327629985832320:32:0) after 2m45s
[01:11:10.442] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842327629985832320:32:0)
[01:11:10.463] Build status: STARTED
[01:11:10.463] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842327629985832320:33:0) after 2m13s
[01:13:23.484] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842327629985832320:33:0)
[01:13:23.504] Build status: STARTED
[01:13:23.504] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842327629985832320:34:0) after 7m42s
[01:21:05.519] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842327629985832320:34:0)
[01:21:05.540] Build status: STARTED
[01:21:05.540] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842327629985832320:35:0) after 2m31s
[01:23:36.632] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842327629985832320:35:0)
[01:23:36.647] Build status: STARTED
[01:23:36.647] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842327629985832320:36:0) after 9m19s
[01:32:55.818] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842327629985832320:36:0)
[01:32:55.837] Build status: STARTED
[01:32:55.837] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842327629985832320:37:0) after 4m7s
[01:37:02.868] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842327629985832320:37:0)
[01:37:02.904] Build status: STARTED
[01:37:02.904] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842327629985832320:38:0) after 4m7s
[01:40:54.826] Received PubSub notification, asking Buildbucket for the build status
[01:40:54.895] Build:
{
"id": "8676897567860525057",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacPGO"
},
"number": 3674,
"createdBy": "project:chromium",
"createTime": "2026-07-07T22:17:45.651531833Z",
"startTime": "2026-07-07T22:18:20.135033311Z",
"endTime": "2026-07-08T01:40:54.591957107Z",
"updateTime": "2026-07-08T01:40:54.591957107Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3d27c3885185d0dfe7469fdccc48a01187942e0b",
"ref": "refs/heads/main"
}
}
}
[01:40:54.895] Invocation finished in 3h23m10.654072085s with status FAILED