[23:29:54.929] New invocation is queued and will start shortly
[23:29:56.142] Starting the invocation (attempt 1)
[23:29:56.173] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/a423bf4ab6419ad1e5ca273190282c632c8b560e"
[23:29:56.173] Popped gitiles commit info from properties and tags
[23:29:56.173] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[23:29:56.173] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[23:29:56.173] Buildbucket request:
{
"requestId": "8851292188610891552",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxPGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a423bf4ab6419ad1e5ca273190282c632c8b560e",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8851292188610891552"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxPGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[23:29:56.775] Scheduled build:
{
"id": "8685862126526336305",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxPGO"
},
"number": 20192,
"createdBy": "project:chromium",
"createTime": "2026-03-30T23:29:56.294869392Z",
"updateTime": "2026-03-30T23:29:56.294869392Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a423bf4ab6419ad1e5ca273190282c632c8b560e",
"ref": "refs/heads/main"
}
}
}
[23:29:56.775] Task URL: https://cr-buildbucket.appspot.com/build/8685862126526336305
[23:29:56.775] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:2:0) after 2m16s
[23:29:58.389] Received PubSub notification, asking Buildbucket for the build status
[23:29:58.415] Build status: SCHEDULED
[23:30:08.473] Received PubSub notification, asking Buildbucket for the build status
[23:30:08.554] Build status: STARTED
[23:32:12.772] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:2:0)
[23:32:12.797] Build status: STARTED
[23:32:12.797] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:5:0) after 6m3s
[23:38:15.812] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:5:0)
[23:38:15.847] Build status: STARTED
[23:38:15.847] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:6:0) after 6m32s
[23:44:47.819] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:6:0)
[23:44:47.869] Build status: STARTED
[23:44:47.869] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:7:0) after 3m46s
[23:48:34.012] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:7:0)
[23:48:34.064] Build status: STARTED
[23:48:34.064] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:8:0) after 1m1s
[23:49:35.146] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:8:0)
[23:49:35.169] Build status: STARTED
[23:49:35.169] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:9:0) after 3m12s
[23:52:47.166] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:9:0)
[23:52:47.277] Build status: STARTED
[23:52:47.277] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:10:0) after 7m42s
[00:00:29.385] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:10:0)
[00:00:29.407] Build status: STARTED
[00:00:29.407] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:11:0) after 5m23s
[00:05:52.411] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:11:0)
[00:05:52.434] Build status: STARTED
[00:05:52.434] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:12:0) after 3m58s
[00:09:50.600] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:12:0)
[00:09:50.619] Build status: STARTED
[00:09:50.619] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:13:0) after 4m8s
[00:13:58.648] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:13:0)
[00:13:58.677] Build status: STARTED
[00:13:58.677] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:14:0) after 4m20s
[00:18:18.700] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:14:0)
[00:18:18.717] Build status: STARTED
[00:18:18.717] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:15:0) after 6m24s
[00:24:42.742] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:15:0)
[00:24:42.827] Build status: STARTED
[00:24:42.827] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:16:0) after 6m5s
[00:30:47.853] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:16:0)
[00:30:47.874] Build status: STARTED
[00:30:47.874] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:17:0) after 6m17s
[00:37:04.916] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:17:0)
[00:37:04.935] Build status: STARTED
[00:37:04.935] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:18:0) after 7m50s
[00:44:54.957] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:18:0)
[00:44:54.980] Build status: STARTED
[00:44:54.981] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:19:0) after 5m55s
[00:50:50.013] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:19:0)
[00:50:50.216] Build status: STARTED
[00:50:50.216] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:20:0) after 9m59s
[01:00:49.273] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:20:0)
[01:00:49.395] Build status: STARTED
[01:00:49.395] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:21:0) after 7m41s
[01:08:30.452] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:21:0)
[01:08:30.474] Build status: STARTED
[01:08:30.474] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:22:0) after 9m56s
[01:18:26.496] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:22:0)
[01:18:26.518] Build status: STARTED
[01:18:26.518] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:23:0) after 8m16s
[01:26:42.625] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:23:0)
[01:26:42.641] Build status: STARTED
[01:26:42.641] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:24:0) after 1m45s
[01:28:27.808] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:24:0)
[01:28:27.852] Build status: STARTED
[01:28:27.852] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:25:0) after 3m20s
[01:31:47.875] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:25:0)
[01:31:47.926] Build status: STARTED
[01:31:47.926] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:26:0) after 2m18s
[01:34:05.999] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:26:0)
[01:34:06.021] Build status: STARTED
[01:34:06.022] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:27:0) after 9m56s
[01:44:02.068] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:27:0)
[01:44:02.121] Build status: STARTED
[01:44:02.121] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:28:0) after 7m17s
[01:51:19.145] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:28:0)
[01:51:19.167] Build status: STARTED
[01:51:19.167] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:29:0) after 4m1s
[01:55:20.316] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:29:0)
[01:55:20.381] Build status: STARTED
[01:55:20.381] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:30:0) after 9m20s
[02:04:40.401] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:30:0)
[02:04:40.474] Build status: STARTED
[02:04:40.474] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:31:0) after 9m21s
[02:14:01.518] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:31:0)
[02:14:01.535] Build status: STARTED
[02:14:01.535] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:32:0) after 4m34s
[02:18:35.598] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:32:0)
[02:18:35.616] Build status: STARTED
[02:18:35.616] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:33:0) after 2m36s
[02:21:11.700] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:33:0)
[02:21:11.720] Build status: STARTED
[02:21:11.720] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:34:0) after 5m27s
[02:26:38.746] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:34:0)
[02:26:38.792] Build status: STARTED
[02:26:38.792] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:35:0) after 2m51s
[02:29:29.877] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:35:0)
[02:29:29.917] Build status: STARTED
[02:29:29.917] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:36:0) after 5m19s
[02:34:48.999] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:36:0)
[02:34:49.015] Build status: STARTED
[02:34:49.015] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:37:0) after 4m5s
[02:38:54.054] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:37:0)
[02:38:54.072] Build status: STARTED
[02:38:54.072] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:38:0) after 9m18s
[02:48:12.146] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:38:0)
[02:48:12.174] Build status: STARTED
[02:48:12.174] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:39:0) after 2m5s
[02:50:17.227] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:39:0)
[02:50:17.246] Build status: STARTED
[02:50:17.246] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:40:0) after 8m29s
[02:58:46.277] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:40:0)
[02:58:46.299] Build status: STARTED
[02:58:46.299] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:41:0) after 4m48s
[03:03:34.377] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:41:0)
[03:03:34.395] Build status: STARTED
[03:03:34.395] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:42:0) after 2m16s
[03:05:50.419] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:42:0)
[03:05:50.443] Build status: STARTED
[03:05:50.443] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:43:0) after 5m17s
[03:11:07.929] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:43:0)
[03:11:07.950] Build status: STARTED
[03:11:07.950] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:44:0) after 4m16s
[03:15:24.021] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:44:0)
[03:15:24.077] Build status: STARTED
[03:15:24.077] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:45:0) after 1m4s
[03:16:28.100] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:45:0)
[03:16:28.118] Build status: STARTED
[03:16:28.118] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:46:0) after 5m42s
[03:22:10.243] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:46:0)
[03:22:10.259] Build status: STARTED
[03:22:10.259] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:47:0) after 7m18s
[03:29:28.403] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:47:0)
[03:29:28.418] Build status: STARTED
[03:29:28.418] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:48:0) after 2m15s
[03:31:43.488] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:48:0)
[03:31:43.510] Build status: STARTED
[03:31:43.510] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:49:0) after 6m54s
[03:38:37.582] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:49:0)
[03:38:37.602] Build status: STARTED
[03:38:37.602] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:50:0) after 4m20s
[03:42:57.623] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:50:0)
[03:42:57.685] Build status: STARTED
[03:42:57.685] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:51:0) after 5m38s
[03:48:35.704] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:51:0)
[03:48:35.733] Build status: STARTED
[03:48:35.733] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:52:0) after 5m14s
[03:53:49.811] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:52:0)
[03:53:49.831] Build status: STARTED
[03:53:49.831] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:53:0) after 2m44s
[03:56:33.850] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:53:0)
[03:56:33.876] Build status: STARTED
[03:56:33.876] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:54:0) after 2m11s
[03:58:44.932] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:54:0)
[03:58:44.954] Build status: STARTED
[03:58:44.954] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:55:0) after 2m16s
[04:01:00.979] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:55:0)
[04:01:01.005] Build status: STARTED
[04:01:01.005] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:56:0) after 5m29s
[04:06:30.091] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:56:0)
[04:06:30.110] Build status: STARTED
[04:06:30.110] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:57:0) after 1m50s
[04:08:20.184] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:57:0)
[04:08:20.205] Build status: STARTED
[04:08:20.205] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:58:0) after 3m45s
[04:12:05.226] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:58:0)
[04:12:05.243] Build status: STARTED
[04:12:05.243] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:59:0) after 1m10s
[04:13:15.282] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:59:0)
[04:13:15.298] Build status: STARTED
[04:13:15.298] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8851292188610891552:60:0) after 7m31s
[04:20:39.050] Received PubSub notification, asking Buildbucket for the build status
[04:20:39.068] Build:
{
"id": "8685862126526336305",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxPGO"
},
"number": 20192,
"createdBy": "project:chromium",
"createTime": "2026-03-30T23:29:56.294869392Z",
"startTime": "2026-03-30T23:30:07.843939560Z",
"endTime": "2026-03-31T04:20:38.755717517Z",
"updateTime": "2026-03-31T04:20:38.755717517Z",
"status": "SUCCESS",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a423bf4ab6419ad1e5ca273190282c632c8b560e",
"ref": "refs/heads/main"
}
}
}
[04:20:39.068] Invocation finished in 4h50m44.146229712s with status SUCCEEDED