[07:20:54.855] New invocation is queued and will start shortly
[07:20:56.020] Starting the invocation (attempt 1)
[07:20:56.048] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/ae924d8680e255ac04b53b3b9e17bad8dd2c8f18"
[07:20:56.048] Popped gitiles commit info from properties and tags
[07:20:56.048] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[07:20:56.048] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[07:20:56.048] Buildbucket request:
{
"requestId": "8857241955713612128",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacPGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ae924d8680e255ac04b53b3b9e17bad8dd2c8f18",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8857241955713612128"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacPGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[07:20:57.473] Scheduled build:
{
"id": "8691811893733770577",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacPGO"
},
"number": 1252,
"createdBy": "project:chromium",
"createTime": "2026-01-24T07:20:56.119864349Z",
"updateTime": "2026-01-24T07:20:56.119864349Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ae924d8680e255ac04b53b3b9e17bad8dd2c8f18",
"ref": "refs/heads/main"
}
}
}
[07:20:57.473] Task URL: https://cr-buildbucket.appspot.com/build/8691811893733770577
[07:20:57.473] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:2:0) after 8m30s
[07:20:57.999] Received PubSub notification, asking Buildbucket for the build status
[07:20:58.084] Build status: SCHEDULED
[07:22:08.990] Received PubSub notification, asking Buildbucket for the build status
[07:22:09.009] Build status: STARTED
[07:29:27.489] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:2:0)
[07:29:27.515] Build status: STARTED
[07:29:27.515] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:5:0) after 7m24s
[07:36:51.530] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:5:0)
[07:36:51.561] Build status: STARTED
[07:36:51.562] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:6:0) after 4m9s
[07:41:00.724] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:6:0)
[07:41:00.747] Build status: STARTED
[07:41:00.747] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:7:0) after 9m2s
[07:50:03.017] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:7:0)
[07:50:03.034] Build status: STARTED
[07:50:03.034] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:8:0) after 5m5s
[07:55:08.055] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:8:0)
[07:55:08.075] Build status: STARTED
[07:55:08.075] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:9:0) after 8m35s
[08:03:43.105] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:9:0)
[08:03:43.130] Build status: STARTED
[08:03:43.130] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:10:0) after 5m10s
[08:08:53.140] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:10:0)
[08:08:53.170] Build status: STARTED
[08:08:53.170] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:11:0) after 5m29s
[08:14:22.253] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:11:0)
[08:14:22.268] Build status: STARTED
[08:14:22.268] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:12:0) after 1m44s
[08:16:06.334] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:12:0)
[08:16:06.350] Build status: STARTED
[08:16:06.350] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:13:0) after 4m34s
[08:20:40.371] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:13:0)
[08:20:40.391] Build status: STARTED
[08:20:40.391] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:14:0) after 1m49s
[08:22:29.419] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:14:0)
[08:22:29.474] Build status: STARTED
[08:22:29.474] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:15:0) after 5m38s
[08:28:07.588] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:15:0)
[08:28:07.607] Build status: STARTED
[08:28:07.607] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:16:0) after 8m48s
[08:36:55.629] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:16:0)
[08:36:55.667] Build status: STARTED
[08:36:55.667] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:17:0) after 8m31s
[08:45:26.681] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:17:0)
[08:45:26.694] Build status: STARTED
[08:45:26.694] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:18:0) after 7m53s
[08:53:19.715] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:18:0)
[08:53:19.732] Build status: STARTED
[08:53:19.732] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:19:0) after 3m38s
[08:56:57.856] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:19:0)
[08:56:57.870] Build status: STARTED
[08:56:57.870] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:20:0) after 8m44s
[09:05:41.924] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:20:0)
[09:05:41.939] Build status: STARTED
[09:05:41.939] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:21:0) after 1m27s
[09:07:08.922] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:21:0)
[09:07:08.938] Build status: STARTED
[09:07:08.938] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:22:0) after 6m2s
[09:13:11.115] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:22:0)
[09:13:11.141] Build status: STARTED
[09:13:11.142] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:23:0) after 6m16s
[09:19:27.451] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:23:0)
[09:19:27.467] Build status: STARTED
[09:19:27.467] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:24:0) after 8m54s
[09:28:21.571] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:24:0)
[09:28:21.613] Build status: STARTED
[09:28:21.613] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:25:0) after 5m39s
[09:34:00.673] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:25:0)
[09:34:00.689] Build status: STARTED
[09:34:00.689] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:26:0) after 2m23s
[09:36:23.924] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:26:0)
[09:36:23.937] Build status: STARTED
[09:36:23.937] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:27:0) after 3m20s
[09:39:44.124] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:27:0)
[09:39:44.152] Build status: STARTED
[09:39:44.152] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:28:0) after 9m26s
[09:49:10.187] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:28:0)
[09:49:10.214] Build status: STARTED
[09:49:10.214] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:29:0) after 7m5s
[09:56:15.614] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:29:0)
[09:56:15.629] Build status: STARTED
[09:56:15.629] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:30:0) after 3m26s
[09:59:41.706] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:30:0)
[09:59:41.746] Build status: STARTED
[09:59:41.746] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:31:0) after 9m53s
[10:09:34.762] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:31:0)
[10:09:34.941] Build status: STARTED
[10:09:34.941] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:32:0) after 2m0s
[10:11:34.967] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:32:0)
[10:11:35.033] Build status: STARTED
[10:11:35.033] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:33:0) after 9m56s
[10:21:31.244] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:33:0)
[10:21:31.269] Build status: STARTED
[10:21:31.269] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:34:0) after 8m38s
[10:30:09.357] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:34:0)
[10:30:09.374] Build status: STARTED
[10:30:09.374] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:35:0) after 6m5s
[10:36:14.491] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:35:0)
[10:36:14.506] Build status: STARTED
[10:36:14.506] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:36:0) after 2m21s
[10:38:35.598] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:36:0)
[10:38:35.614] Build status: STARTED
[10:38:35.614] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:37:0) after 9m56s
[10:48:31.631] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:37:0)
[10:48:31.645] Build status: STARTED
[10:48:31.645] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:38:0) after 7m15s
[10:55:46.720] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:38:0)
[10:55:46.734] Build status: STARTED
[10:55:46.734] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:39:0) after 7m15s
[11:03:01.972] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:39:0)
[11:03:01.993] Build status: STARTED
[11:03:01.993] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:40:0) after 8m38s
[11:11:40.149] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:40:0)
[11:11:40.265] Build status: STARTED
[11:11:40.265] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:41:0) after 1m25s
[11:13:05.279] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:41:0)
[11:13:05.292] Build status: STARTED
[11:13:05.292] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:42:0) after 7m1s
[11:20:06.402] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:42:0)
[11:20:06.415] Build status: STARTED
[11:20:06.415] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:43:0) after 9m40s
[11:29:46.422] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:43:0)
[11:29:46.447] Build status: STARTED
[11:29:46.447] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:44:0) after 2m7s
[11:31:53.532] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:44:0)
[11:31:53.549] Build status: STARTED
[11:31:53.549] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:45:0) after 3m49s
[11:35:42.566] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:45:0)
[11:35:42.584] Build status: STARTED
[11:35:42.584] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:46:0) after 1m14s
[11:36:56.599] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:46:0)
[11:36:56.614] Build status: STARTED
[11:36:56.614] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:47:0) after 8m13s
[11:45:09.730] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:47:0)
[11:45:09.755] Build status: STARTED
[11:45:09.755] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:48:0) after 5m42s
[11:50:52.154] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:48:0)
[11:50:52.170] Build status: STARTED
[11:50:52.170] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:49:0) after 8m30s
[11:59:22.184] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:49:0)
[11:59:22.253] Build status: STARTED
[11:59:22.253] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:50:0) after 1m20s
[12:00:42.270] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:50:0)
[12:00:42.308] Build status: STARTED
[12:00:42.309] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:51:0) after 3m33s
[12:04:15.381] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:51:0)
[12:04:15.395] Build status: STARTED
[12:04:15.395] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:52:0) after 7m59s
[12:12:14.423] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:52:0)
[12:12:14.490] Build status: STARTED
[12:12:14.490] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8857241955713612128:53:0) after 8m25s
[12:18:18.333] Received PubSub notification, asking Buildbucket for the build status
[12:18:18.357] Build:
{
"id": "8691811893733770577",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacPGO"
},
"number": 1252,
"createdBy": "project:chromium",
"createTime": "2026-01-24T07:20:56.119864349Z",
"startTime": "2026-01-24T07:22:08.182472336Z",
"endTime": "2026-01-24T12:18:18.111001695Z",
"updateTime": "2026-01-24T12:18:18.111001695Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ae924d8680e255ac04b53b3b9e17bad8dd2c8f18",
"ref": "refs/heads/main"
}
}
}
[12:18:18.357] Invocation finished in 4h57m23.509090996s with status FAILED