[07:16:46.699] New invocation is queued and will start shortly
[07:16:48.062] Starting the invocation (attempt 1)
[07:16:48.084] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/120ed7383801d92fdc3ebf98a222df433aea8e31"
[07:16:48.084] Popped gitiles commit info from properties and tags
[07:16:48.084] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[07:16:48.084] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[07:16:48.084] Buildbucket request:
{
"requestId": "8848635504113519328",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxPGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "120ed7383801d92fdc3ebf98a222df433aea8e31",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8848635504113519328"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxPGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[07:16:48.599] Scheduled build:
{
"id": "8683205441939558273",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxPGO"
},
"number": 20463,
"createdBy": "project:chromium",
"createTime": "2026-04-29T07:16:48.151024206Z",
"updateTime": "2026-04-29T07:16:48.151024206Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "120ed7383801d92fdc3ebf98a222df433aea8e31",
"ref": "refs/heads/main"
}
}
}
[07:16:48.599] Task URL: https://cr-buildbucket.appspot.com/build/8683205441939558273
[07:16:48.599] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:2:0) after 4m3s
[07:16:49.545] Received PubSub notification, asking Buildbucket for the build status
[07:16:49.564] Build status: SCHEDULED
[07:16:54.985] Received PubSub notification, asking Buildbucket for the build status
[07:16:55.005] Build status: STARTED
[07:20:51.699] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:2:0)
[07:20:51.719] Build status: STARTED
[07:20:51.719] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:5:0) after 3m16s
[07:24:07.781] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:5:0)
[07:24:07.835] Build status: STARTED
[07:24:07.835] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:6:0) after 7m59s
[07:32:06.917] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:6:0)
[07:32:06.940] Build status: STARTED
[07:32:06.940] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:7:0) after 3m47s
[07:35:53.976] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:7:0)
[07:35:54.002] Build status: STARTED
[07:35:54.002] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:8:0) after 3m22s
[07:39:16.034] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:8:0)
[07:39:16.106] Build status: STARTED
[07:39:16.106] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:9:0) after 5m28s
[07:44:44.124] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:9:0)
[07:44:44.146] Build status: STARTED
[07:44:44.146] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:10:0) after 9m31s
[07:54:15.212] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:10:0)
[07:54:15.226] Build status: STARTED
[07:54:15.226] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:11:0) after 4m15s
[07:58:30.245] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:11:0)
[07:58:30.268] Build status: STARTED
[07:58:30.268] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:12:0) after 1m18s
[07:59:48.291] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:12:0)
[07:59:48.308] Build status: STARTED
[07:59:48.308] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:13:0) after 5m32s
[08:05:20.327] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:13:0)
[08:05:20.351] Build status: STARTED
[08:05:20.351] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:14:0) after 9m30s
[08:14:50.368] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:14:0)
[08:14:50.397] Build status: STARTED
[08:14:50.397] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:15:0) after 9m47s
[08:24:37.415] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:15:0)
[08:24:37.431] Build status: STARTED
[08:24:37.431] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:16:0) after 7m52s
[08:32:29.862] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:16:0)
[08:32:29.883] Build status: STARTED
[08:32:29.883] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:17:0) after 7m43s
[08:40:13.497] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:17:0)
[08:40:13.540] Build status: STARTED
[08:40:13.540] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:18:0) after 3m42s
[08:43:55.559] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:18:0)
[08:43:55.572] Build status: STARTED
[08:43:55.572] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:19:0) after 7m22s
[08:51:17.587] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:19:0)
[08:51:17.603] Build status: STARTED
[08:51:17.603] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:20:0) after 6m17s
[08:57:34.746] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:20:0)
[08:57:34.762] Build status: STARTED
[08:57:34.762] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:21:0) after 7m4s
[09:04:38.786] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:21:0)
[09:04:38.844] Build status: STARTED
[09:04:38.844] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:22:0) after 3m36s
[09:08:14.877] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:22:0)
[09:08:14.900] Build status: STARTED
[09:08:14.900] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:23:0) after 7m9s
[09:15:23.920] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:23:0)
[09:15:23.940] Build status: STARTED
[09:15:23.940] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:24:0) after 4m49s
[09:20:12.984] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:24:0)
[09:20:13.003] Build status: STARTED
[09:20:13.003] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:25:0) after 2m17s
[09:22:30.076] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:25:0)
[09:22:30.104] Build status: STARTED
[09:22:30.104] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:26:0) after 7m35s
[09:30:05.124] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:26:0)
[09:30:05.233] Build status: STARTED
[09:30:05.233] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:27:0) after 1m27s
[09:31:32.250] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:27:0)
[09:31:32.278] Build status: STARTED
[09:31:32.278] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:28:0) after 2m31s
[09:34:03.310] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:28:0)
[09:34:03.336] Build status: STARTED
[09:34:03.336] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:29:0) after 5m9s
[09:39:12.356] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:29:0)
[09:39:12.389] Build status: STARTED
[09:39:12.389] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:30:0) after 7m5s
[09:46:17.459] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:30:0)
[09:46:17.491] Build status: STARTED
[09:46:17.491] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:31:0) after 8m9s
[09:54:26.507] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:31:0)
[09:54:26.520] Build status: STARTED
[09:54:26.520] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:32:0) after 9m18s
[10:03:44.541] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:32:0)
[10:03:44.644] Build status: STARTED
[10:03:44.644] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:33:0) after 8m24s
[10:12:08.663] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:33:0)
[10:12:08.704] Build status: STARTED
[10:12:08.704] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:34:0) after 4m4s
[10:16:12.808] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:34:0)
[10:16:12.835] Build status: STARTED
[10:16:12.835] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:35:0) after 9m4s
[10:25:16.911] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:35:0)
[10:25:16.928] Build status: STARTED
[10:25:16.928] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:36:0) after 9m35s
[10:34:51.960] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:36:0)
[10:34:52.183] Build status: STARTED
[10:34:52.183] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:37:0) after 5m34s
[10:40:26.173] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:37:0)
[10:40:26.191] Build status: STARTED
[10:40:26.191] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:38:0) after 6m48s
[10:47:14.209] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:38:0)
[10:47:14.227] Build status: STARTED
[10:47:14.227] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:39:0) after 1m36s
[10:48:50.245] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:39:0)
[10:48:50.259] Build status: STARTED
[10:48:50.259] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:40:0) after 5m6s
[10:53:56.314] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:40:0)
[10:53:56.338] Build status: STARTED
[10:53:56.338] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:41:0) after 7m39s
[11:01:35.353] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:41:0)
[11:01:35.366] Build status: STARTED
[11:01:35.366] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:42:0) after 6m36s
[11:08:11.397] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:42:0)
[11:08:11.417] Build status: STARTED
[11:08:11.417] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:43:0) after 2m10s
[11:10:21.438] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:43:0)
[11:10:21.466] Build status: STARTED
[11:10:21.466] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:44:0) after 7m42s
[11:18:03.481] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:44:0)
[11:18:03.501] Build status: STARTED
[11:18:03.501] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:45:0) after 5m45s
[11:23:48.527] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:45:0)
[11:23:48.550] Build status: STARTED
[11:23:48.550] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:46:0) after 8m43s
[11:32:31.621] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:46:0)
[11:32:31.704] Build status: STARTED
[11:32:31.704] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:47:0) after 5m4s
[11:37:35.710] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:47:0)
[11:37:35.727] Build status: STARTED
[11:37:35.727] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:48:0) after 4m41s
[11:42:16.797] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:48:0)
[11:42:16.816] Build status: STARTED
[11:42:16.816] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:49:0) after 5m46s
[11:48:02.817] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:49:0)
[11:48:02.914] Build status: STARTED
[11:48:02.914] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:50:0) after 1m11s
[11:49:14.019] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:50:0)
[11:49:14.045] Build status: STARTED
[11:49:14.045] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:51:0) after 1m54s
[11:51:08.027] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:51:0)
[11:51:08.071] Build status: STARTED
[11:51:08.071] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:52:0) after 2m31s
[11:53:39.114] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:52:0)
[11:53:39.137] Build status: STARTED
[11:53:39.137] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:53:0) after 4m7s
[11:57:46.156] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:53:0)
[11:57:46.174] Build status: STARTED
[11:57:46.174] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:54:0) after 3m20s
[12:01:06.195] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:54:0)
[12:01:06.209] Build status: STARTED
[12:01:06.209] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:55:0) after 4m38s
[12:05:44.228] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:55:0)
[12:05:44.247] Build status: STARTED
[12:05:44.247] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:56:0) after 6m58s
[12:12:42.265] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:56:0)
[12:12:42.300] Build status: STARTED
[12:12:42.300] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:57:0) after 2m21s
[12:15:03.316] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:57:0)
[12:15:03.334] Build status: STARTED
[12:15:03.334] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:58:0) after 7m5s
[12:22:08.350] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:58:0)
[12:22:08.422] Build status: STARTED
[12:22:08.422] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:59:0) after 7m50s
[12:29:58.489] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:59:0)
[12:29:58.518] Build status: STARTED
[12:29:58.518] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:60:0) after 2m17s
[12:32:15.539] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:60:0)
[12:32:15.556] Build status: STARTED
[12:32:15.556] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:61:0) after 3m31s
[12:35:46.639] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:61:0)
[12:35:46.654] Build status: STARTED
[12:35:46.654] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:62:0) after 7m43s
[12:43:29.668] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:62:0)
[12:43:29.684] Build status: STARTED
[12:43:29.684] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8848635504113519328:63:0) after 8m7s
[12:44:35.284] Received PubSub notification, asking Buildbucket for the build status
[12:44:35.301] Build:
{
"id": "8683205441939558273",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxPGO"
},
"number": 20463,
"createdBy": "project:chromium",
"createTime": "2026-04-29T07:16:48.151024206Z",
"startTime": "2026-04-29T07:16:54.800967355Z",
"endTime": "2026-04-29T12:44:31.759199451Z",
"updateTime": "2026-04-29T12:44:31.759199451Z",
"status": "SUCCESS",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "120ed7383801d92fdc3ebf98a222df433aea8e31",
"ref": "refs/heads/main"
}
}
}
[12:44:35.301] Invocation finished in 5h27m48.607134217s with status SUCCEEDED