[04:25:05.707] New invocation is queued and will start shortly
[04:25:07.045] Starting the invocation (attempt 1)
[04:25:07.067] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/13542b5f5d5e653b0308443178503b0bc74316de"
[04:25:07.067] Popped gitiles commit info from properties and tags
[04:25:07.067] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[04:25:07.067] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[04:25:07.067] Buildbucket request:
{
"requestId": "8842304517837088720",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacPGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "13542b5f5d5e653b0308443178503b0bc74316de",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8842304517837088720"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacPGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[04:25:07.624] Scheduled build:
{
"id": "8676874455677346817",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacPGO"
},
"number": 3676,
"createdBy": "project:chromium",
"createTime": "2026-07-08T04:25:07.147108834Z",
"updateTime": "2026-07-08T04:25:07.147108834Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "13542b5f5d5e653b0308443178503b0bc74316de",
"ref": "refs/heads/main"
}
}
}
[04:25:07.624] Task URL: https://cr-buildbucket.appspot.com/build/8676874455677346817
[04:25:07.624] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:2:0) after 6m55s
[04:25:08.560] Received PubSub notification, asking Buildbucket for the build status
[04:25:08.621] Build status: SCHEDULED
[04:25:11.862] Received PubSub notification, asking Buildbucket for the build status
[04:25:11.901] Build status: STARTED
[04:32:02.638] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:2:0)
[04:32:02.661] Build status: STARTED
[04:32:02.661] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:5:0) after 7m13s
[04:39:15.680] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:5:0)
[04:39:15.697] Build status: STARTED
[04:39:15.697] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:6:0) after 5m33s
[04:44:48.713] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:6:0)
[04:44:48.733] Build status: STARTED
[04:44:48.733] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:7:0) after 7m41s
[04:52:29.748] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:7:0)
[04:52:29.769] Build status: STARTED
[04:52:29.769] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:8:0) after 6m8s
[04:58:37.786] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:8:0)
[04:58:37.812] Build status: STARTED
[04:58:37.812] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:9:0) after 6m14s
[05:04:51.829] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:9:0)
[05:04:51.853] Build status: STARTED
[05:04:51.853] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:10:0) after 2m20s
[05:07:11.911] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:10:0)
[05:07:11.929] Build status: STARTED
[05:07:11.929] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:11:0) after 7m22s
[05:14:33.959] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:11:0)
[05:14:33.997] Build status: STARTED
[05:14:33.997] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:12:0) after 7m21s
[05:21:55.069] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:12:0)
[05:21:55.090] Build status: STARTED
[05:21:55.090] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:13:0) after 5m56s
[05:27:51.165] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:13:0)
[05:27:51.235] Build status: STARTED
[05:27:51.235] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:14:0) after 1m57s
[05:29:48.224] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:14:0)
[05:29:48.248] Build status: STARTED
[05:29:48.248] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:15:0) after 2m10s
[05:31:58.310] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:15:0)
[05:31:58.327] Build status: STARTED
[05:31:58.327] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:16:0) after 7m20s
[05:39:18.476] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:16:0)
[05:39:18.510] Build status: STARTED
[05:39:18.511] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:17:0) after 3m51s
[05:43:09.530] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:17:0)
[05:43:09.556] Build status: STARTED
[05:43:09.556] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:18:0) after 4m2s
[05:47:11.577] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:18:0)
[05:47:11.598] Build status: STARTED
[05:47:11.598] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:19:0) after 4m46s
[05:51:57.616] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:19:0)
[05:51:57.636] Build status: STARTED
[05:51:57.637] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:20:0) after 2m9s
[05:54:06.714] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:20:0)
[05:54:06.794] Build status: STARTED
[05:54:06.794] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:21:0) after 1m40s
[05:55:46.867] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:21:0)
[05:55:46.884] Build status: STARTED
[05:55:46.884] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:22:0) after 2m7s
[05:57:54.043] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:22:0)
[05:57:54.062] Build status: STARTED
[05:57:54.062] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:23:0) after 9m40s
[06:07:34.217] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:23:0)
[06:07:34.242] Build status: STARTED
[06:07:34.242] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:24:0) after 8m40s
[06:16:14.310] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:24:0)
[06:16:14.339] Build status: STARTED
[06:16:14.339] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:25:0) after 2m13s
[06:18:27.402] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:25:0)
[06:18:27.419] Build status: STARTED
[06:18:27.419] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:26:0) after 3m41s
[06:22:08.437] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:26:0)
[06:22:08.458] Build status: STARTED
[06:22:08.458] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:27:0) after 7m7s
[06:29:15.621] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:27:0)
[06:29:15.639] Build status: STARTED
[06:29:15.639] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:28:0) after 4m54s
[06:34:09.674] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:28:0)
[06:34:09.694] Build status: STARTED
[06:34:09.694] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:29:0) after 1m51s
[06:36:00.759] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:29:0)
[06:36:00.779] Build status: STARTED
[06:36:00.779] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:30:0) after 8m16s
[06:44:16.797] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:30:0)
[06:44:16.856] Build status: STARTED
[06:44:16.856] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:31:0) after 1m8s
[06:45:24.877] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:31:0)
[06:45:24.959] Build status: STARTED
[06:45:24.959] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:32:0) after 4m4s
[06:49:29.052] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:32:0)
[06:49:29.072] Build status: STARTED
[06:49:29.072] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:33:0) after 2m49s
[06:52:18.089] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:33:0)
[06:52:18.108] Build status: STARTED
[06:52:18.108] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:34:0) after 9m12s
[07:01:30.152] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:34:0)
[07:01:30.178] Build status: STARTED
[07:01:30.178] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:35:0) after 1m38s
[07:03:08.350] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:35:0)
[07:03:08.386] Build status: STARTED
[07:03:08.386] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:36:0) after 5m59s
[07:09:07.405] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:36:0)
[07:09:07.471] Build status: STARTED
[07:09:07.471] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:37:0) after 3m8s
[07:12:15.527] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:37:0)
[07:12:15.572] Build status: STARTED
[07:12:15.572] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:38:0) after 3m52s
[07:16:07.590] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:38:0)
[07:16:07.613] Build status: STARTED
[07:16:07.613] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:39:0) after 9m20s
[07:25:27.864] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:39:0)
[07:25:28.004] Build status: STARTED
[07:25:28.004] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:40:0) after 2m24s
[07:27:52.066] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:40:0)
[07:27:52.110] Build status: STARTED
[07:27:52.110] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:41:0) after 8m20s
[07:36:12.222] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:41:0)
[07:36:12.238] Build status: STARTED
[07:36:12.238] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:42:0) after 3m50s
[07:40:02.317] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:42:0)
[07:40:02.337] Build status: STARTED
[07:40:02.337] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8842304517837088720:43:0) after 9m52s
[07:46:28.424] Received PubSub notification, asking Buildbucket for the build status
[07:46:28.442] Build:
{
"id": "8676874455677346817",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacPGO"
},
"number": 3676,
"createdBy": "project:chromium",
"createTime": "2026-07-08T04:25:07.147108834Z",
"startTime": "2026-07-08T04:25:10.995333207Z",
"endTime": "2026-07-08T07:46:11.428936271Z",
"updateTime": "2026-07-08T07:46:11.428936271Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "13542b5f5d5e653b0308443178503b0bc74316de",
"ref": "refs/heads/main"
}
}
}
[07:46:28.442] Invocation finished in 3h21m22.739427616s with status FAILED