[04:05:14.358] New invocation is queued and will start shortly
[04:05:15.384] Starting the invocation (attempt 1)
[04:05:15.412] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/f04174047acec2bac211566c80fb07db313b3861"
[04:05:15.412] Popped gitiles commit info from properties and tags
[04:05:15.412] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[04:05:15.412] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[04:05:15.412] Buildbucket request:
{
"requestId": "8848285166843459664",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64PGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f04174047acec2bac211566c80fb07db313b3861",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8848285166843459664"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacArm64PGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[04:05:16.136] Scheduled build:
{
"id": "8682855105006286321",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64PGO"
},
"number": 2521,
"createdBy": "project:chromium",
"createTime": "2026-05-03T04:05:15.486971606Z",
"updateTime": "2026-05-03T04:05:15.486971606Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f04174047acec2bac211566c80fb07db313b3861",
"ref": "refs/heads/main"
}
}
}
[04:05:16.136] Task URL: https://cr-buildbucket.appspot.com/build/8682855105006286321
[04:05:16.136] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:2:0) after 7m9s
[04:05:17.079] Received PubSub notification, asking Buildbucket for the build status
[04:05:17.098] Build status: SCHEDULED
[04:05:19.714] Received PubSub notification, asking Buildbucket for the build status
[04:05:19.733] Build status: STARTED
[04:12:25.155] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:2:0)
[04:12:25.173] Build status: STARTED
[04:12:25.173] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:5:0) after 1m27s
[04:13:52.184] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:5:0)
[04:13:52.202] Build status: STARTED
[04:13:52.202] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:6:0) after 8m24s
[04:22:16.218] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:6:0)
[04:22:16.269] Build status: STARTED
[04:22:16.269] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:7:0) after 1m5s
[04:23:21.289] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:7:0)
[04:23:21.310] Build status: STARTED
[04:23:21.310] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:8:0) after 4m58s
[04:28:19.374] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:8:0)
[04:28:19.466] Build status: STARTED
[04:28:19.467] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:9:0) after 5m59s
[04:34:18.479] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:9:0)
[04:34:18.497] Build status: STARTED
[04:34:18.497] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:10:0) after 7m36s
[04:41:54.511] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:10:0)
[04:41:54.532] Build status: STARTED
[04:41:54.532] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:11:0) after 6m11s
[04:48:05.545] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:11:0)
[04:48:05.565] Build status: STARTED
[04:48:05.565] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:12:0) after 3m26s
[04:51:31.674] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:12:0)
[04:51:31.758] Build status: STARTED
[04:51:31.758] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:13:0) after 4m56s
[04:56:27.773] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:13:0)
[04:56:27.796] Build status: STARTED
[04:56:27.796] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:14:0) after 9m39s
[05:06:06.846] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:14:0)
[05:06:06.863] Build status: STARTED
[05:06:06.863] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:15:0) after 8m7s
[05:14:13.844] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:15:0)
[05:14:13.859] Build status: STARTED
[05:14:13.859] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:16:0) after 4m54s
[05:19:08.004] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:16:0)
[05:19:08.030] Build status: STARTED
[05:19:08.030] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:17:0) after 1m52s
[05:21:00.021] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:17:0)
[05:21:00.035] Build status: STARTED
[05:21:00.035] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:18:0) after 8m11s
[05:29:11.048] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:18:0)
[05:29:11.066] Build status: STARTED
[05:29:11.066] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:19:0) after 5m42s
[05:34:53.160] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:19:0)
[05:34:53.210] Build status: STARTED
[05:34:53.210] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:20:0) after 4m37s
[05:39:30.292] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:20:0)
[05:39:30.306] Build status: STARTED
[05:39:30.306] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:21:0) after 1m50s
[05:41:20.372] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:21:0)
[05:41:20.387] Build status: STARTED
[05:41:20.387] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:22:0) after 1m6s
[05:42:26.403] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:22:0)
[05:42:26.416] Build status: STARTED
[05:42:26.416] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:23:0) after 6m7s
[05:48:33.432] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:23:0)
[05:48:33.492] Build status: STARTED
[05:48:33.493] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:24:0) after 2m41s
[05:51:14.540] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:24:0)
[05:51:14.593] Build status: STARTED
[05:51:14.593] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:25:0) after 1m2s
[05:52:16.609] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:25:0)
[05:52:16.631] Build status: STARTED
[05:52:16.631] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:26:0) after 8m30s
[06:00:46.651] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:26:0)
[06:00:46.668] Build status: STARTED
[06:00:46.668] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:27:0) after 3m25s
[06:04:11.683] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:27:0)
[06:04:11.699] Build status: STARTED
[06:04:11.700] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:28:0) after 4m35s
[06:08:46.766] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:28:0)
[06:08:46.792] Build status: STARTED
[06:08:46.792] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:29:0) after 6m37s
[06:15:23.818] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:29:0)
[06:15:23.862] Build status: STARTED
[06:15:23.862] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:30:0) after 8m8s
[06:23:31.980] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:30:0)
[06:23:32.002] Build status: STARTED
[06:23:32.002] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:31:0) after 1m38s
[06:25:10.017] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:31:0)
[06:25:10.030] Build status: STARTED
[06:25:10.030] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:32:0) after 5m3s
[06:30:13.080] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:32:0)
[06:30:13.159] Build status: STARTED
[06:30:13.159] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:33:0) after 4m2s
[06:34:15.162] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:33:0)
[06:34:15.180] Build status: STARTED
[06:34:15.180] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:34:0) after 3m54s
[06:38:09.213] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:34:0)
[06:38:09.234] Build status: STARTED
[06:38:09.234] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:35:0) after 8m8s
[06:46:17.251] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:35:0)
[06:46:17.273] Build status: STARTED
[06:46:17.273] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:36:0) after 3m39s
[06:49:56.302] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:36:0)
[06:49:56.322] Build status: STARTED
[06:49:56.322] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:37:0) after 5m26s
[06:55:22.378] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:37:0)
[06:55:22.397] Build status: STARTED
[06:55:22.397] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:38:0) after 6m31s
[07:01:53.412] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:38:0)
[07:01:53.428] Build status: STARTED
[07:01:53.429] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:39:0) after 8m23s
[07:10:16.444] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:39:0)
[07:10:16.524] Build status: STARTED
[07:10:16.524] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:40:0) after 1m16s
[07:11:32.536] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:40:0)
[07:11:32.554] Build status: STARTED
[07:11:32.554] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:41:0) after 6m52s
[07:18:24.570] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:41:0)
[07:18:24.589] Build status: STARTED
[07:18:24.589] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:42:0) after 3m30s
[07:21:54.598] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:42:0)
[07:21:54.621] Build status: STARTED
[07:21:54.621] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:43:0) after 5m33s
[07:27:27.686] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:43:0)
[07:27:27.704] Build status: STARTED
[07:27:27.704] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:44:0) after 3m35s
[07:31:02.780] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:44:0)
[07:31:02.860] Build status: STARTED
[07:31:02.860] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:45:0) after 8m57s
[07:39:59.877] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:45:0)
[07:40:00.180] Build status: STARTED
[07:40:00.180] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:46:0) after 4m28s
[07:44:28.236] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:46:0)
[07:44:28.260] Build status: STARTED
[07:44:28.260] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:47:0) after 4m36s
[07:49:04.274] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:47:0)
[07:49:04.369] Build status: STARTED
[07:49:04.369] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:48:0) after 6m56s
[07:56:00.354] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:48:0)
[07:56:00.419] Build status: STARTED
[07:56:00.419] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:49:0) after 7m56s
[08:03:56.488] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:49:0)
[08:03:56.604] Build status: STARTED
[08:03:56.604] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:50:0) after 6m2s
[08:09:58.625] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:50:0)
[08:09:58.645] Build status: STARTED
[08:09:58.645] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:51:0) after 9m12s
[08:19:10.663] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:51:0)
[08:19:10.681] Build status: STARTED
[08:19:10.681] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:52:0) after 7m24s
[08:26:34.705] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:52:0)
[08:26:34.725] Build status: STARTED
[08:26:34.725] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:53:0) after 2m23s
[08:28:57.742] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:53:0)
[08:28:57.764] Build status: STARTED
[08:28:57.764] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:54:0) after 8m27s
[08:37:24.781] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:54:0)
[08:37:24.797] Build status: STARTED
[08:37:24.797] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:55:0) after 1m27s
[08:38:51.960] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:55:0)
[08:38:52.061] Build status: STARTED
[08:38:52.061] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:56:0) after 4m12s
[08:43:04.080] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:56:0)
[08:43:04.151] Build status: STARTED
[08:43:04.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:57:0) after 5m2s
[08:48:06.229] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:57:0)
[08:48:06.245] Build status: STARTED
[08:48:06.245] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:58:0) after 9m16s
[08:57:22.262] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:58:0)
[08:57:22.281] Build status: STARTED
[08:57:22.281] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8848285166843459664:59:0) after 8m48s
[09:04:06.852] Received PubSub notification, asking Buildbucket for the build status
[09:04:06.868] Build:
{
"id": "8682855105006286321",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64PGO"
},
"number": 2521,
"createdBy": "project:chromium",
"createTime": "2026-05-03T04:05:15.486971606Z",
"startTime": "2026-05-03T04:05:19.513893314Z",
"endTime": "2026-05-03T09:04:05.407135249Z",
"updateTime": "2026-05-03T09:04:05.407135249Z",
"status": "SUCCESS",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f04174047acec2bac211566c80fb07db313b3861",
"ref": "refs/heads/main"
}
}
}
[09:04:06.868] Invocation finished in 4h58m52.517034605s with status SUCCEEDED