[04:58:06.467] New invocation is queued and will start shortly
[04:58:07.570] Starting the invocation (attempt 1)
[04:58:07.598] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/32c14a3f967716b7e4acc7a11eeee9c7ccd1aad0"
[04:58:07.598] Popped gitiles commit info from properties and tags
[04:58:07.598] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[04:58:07.598] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[04:58:07.598] Buildbucket request:
{
"requestId": "8856888552461443744",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxPGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "32c14a3f967716b7e4acc7a11eeee9c7ccd1aad0",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8856888552461443744"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxPGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[04:58:08.296] Scheduled build:
{
"id": "8691458490399971009",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxPGO"
},
"number": 19481,
"createdBy": "project:chromium",
"createTime": "2026-01-28T04:58:07.802322179Z",
"updateTime": "2026-01-28T04:58:07.802322179Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "32c14a3f967716b7e4acc7a11eeee9c7ccd1aad0",
"ref": "refs/heads/main"
}
}
}
[04:58:08.296] Task URL: https://cr-buildbucket.appspot.com/build/8691458490399971009
[04:58:08.296] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:2:0) after 7m31s
[04:58:09.241] Received PubSub notification, asking Buildbucket for the build status
[04:58:09.274] Build status: SCHEDULED
[04:58:13.175] Received PubSub notification, asking Buildbucket for the build status
[04:58:13.195] Build status: STARTED
[05:05:39.315] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:2:0)
[05:05:39.342] Build status: STARTED
[05:05:39.342] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:5:0) after 1m14s
[05:06:53.403] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:5:0)
[05:06:53.420] Build status: STARTED
[05:06:53.420] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:6:0) after 6m28s
[05:13:21.444] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:6:0)
[05:13:21.460] Build status: STARTED
[05:13:21.460] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:7:0) after 8m34s
[05:21:55.481] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:7:0)
[05:21:55.496] Build status: STARTED
[05:21:55.496] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:8:0) after 4m29s
[05:26:24.513] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:8:0)
[05:26:24.526] Build status: STARTED
[05:26:24.526] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:9:0) after 8m5s
[05:34:29.599] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:9:0)
[05:34:29.621] Build status: STARTED
[05:34:29.621] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:10:0) after 5m25s
[05:39:54.769] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:10:0)
[05:39:54.785] Build status: STARTED
[05:39:54.785] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:11:0) after 4m54s
[05:44:48.856] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:11:0)
[05:44:48.978] Build status: STARTED
[05:44:48.978] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:12:0) after 6m32s
[05:51:21.026] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:12:0)
[05:51:21.040] Build status: STARTED
[05:51:21.040] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:13:0) after 4m34s
[05:55:55.074] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:13:0)
[05:55:55.094] Build status: STARTED
[05:55:55.094] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:14:0) after 2m33s
[05:58:28.110] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:14:0)
[05:58:28.132] Build status: STARTED
[05:58:28.132] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:15:0) after 7m29s
[06:05:57.228] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:15:0)
[06:05:57.242] Build status: STARTED
[06:05:57.242] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:16:0) after 2m53s
[06:08:50.286] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:16:0)
[06:08:50.302] Build status: STARTED
[06:08:50.302] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:17:0) after 3m4s
[06:11:54.409] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:17:0)
[06:11:54.427] Build status: STARTED
[06:11:54.427] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:18:0) after 4m39s
[06:16:33.451] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:18:0)
[06:16:33.471] Build status: STARTED
[06:16:33.471] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:19:0) after 4m51s
[06:21:24.503] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:19:0)
[06:21:24.534] Build status: STARTED
[06:21:24.534] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:20:0) after 3m55s
[06:25:19.549] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:20:0)
[06:25:19.567] Build status: STARTED
[06:25:19.567] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:21:0) after 5m52s
[06:31:11.633] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:21:0)
[06:31:11.754] Build status: STARTED
[06:31:11.754] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:22:0) after 2m16s
[06:33:27.770] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:22:0)
[06:33:27.785] Build status: STARTED
[06:33:27.785] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:23:0) after 4m7s
[06:37:34.818] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:23:0)
[06:37:34.881] Build status: STARTED
[06:37:34.881] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:24:0) after 5m42s
[06:43:16.899] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:24:0)
[06:43:16.916] Build status: STARTED
[06:43:16.916] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:25:0) after 8m15s
[06:51:31.937] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:25:0)
[06:51:31.994] Build status: STARTED
[06:51:31.994] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:26:0) after 4m22s
[06:55:54.012] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:26:0)
[06:55:54.031] Build status: STARTED
[06:55:54.031] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:27:0) after 4m44s
[07:00:38.052] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:27:0)
[07:00:38.069] Build status: STARTED
[07:00:38.069] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:28:0) after 3m13s
[07:03:51.076] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:28:0)
[07:03:51.090] Build status: STARTED
[07:03:51.090] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:29:0) after 6m13s
[07:10:04.109] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:29:0)
[07:10:04.125] Build status: STARTED
[07:10:04.125] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:30:0) after 8m13s
[07:18:17.193] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:30:0)
[07:18:17.237] Build status: STARTED
[07:18:17.237] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:31:0) after 6m46s
[07:25:03.300] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:31:0)
[07:25:03.370] Build status: STARTED
[07:25:03.370] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:32:0) after 5m0s
[07:30:03.397] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:32:0)
[07:30:03.461] Build status: STARTED
[07:30:03.461] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:33:0) after 2m35s
[07:32:38.500] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:33:0)
[07:32:38.519] Build status: STARTED
[07:32:38.519] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:34:0) after 9m33s
[07:42:11.540] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:34:0)
[07:42:11.555] Build status: STARTED
[07:42:11.555] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:35:0) after 1m3s
[07:43:14.636] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:35:0)
[07:43:14.647] Build status: STARTED
[07:43:14.647] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:36:0) after 6m19s
[07:49:33.664] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:36:0)
[07:49:33.701] Build status: STARTED
[07:49:33.701] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:37:0) after 8m58s
[07:58:31.727] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:37:0)
[07:58:31.809] Build status: STARTED
[07:58:31.809] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:38:0) after 6m52s
[08:05:23.833] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:38:0)
[08:05:23.893] Build status: STARTED
[08:05:23.893] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:39:0) after 1m16s
[08:06:39.914] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:39:0)
[08:06:39.935] Build status: STARTED
[08:06:39.935] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:40:0) after 1m31s
[08:08:10.941] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:40:0)
[08:08:10.953] Build status: STARTED
[08:08:10.953] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:41:0) after 6m8s
[08:14:18.931] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:41:0)
[08:14:18.950] Build status: STARTED
[08:14:18.950] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:42:0) after 5m0s
[08:19:18.974] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:42:0)
[08:19:18.989] Build status: STARTED
[08:19:18.989] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:43:0) after 4m6s
[08:23:25.061] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:43:0)
[08:23:25.089] Build status: STARTED
[08:23:25.089] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:44:0) after 6m31s
[08:29:56.178] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:44:0)
[08:29:56.193] Build status: STARTED
[08:29:56.193] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:45:0) after 5m34s
[08:35:30.249] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:45:0)
[08:35:30.264] Build status: STARTED
[08:35:30.265] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:46:0) after 7m39s
[08:43:09.409] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:46:0)
[08:43:09.427] Build status: STARTED
[08:43:09.427] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:47:0) after 1m25s
[08:44:34.446] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:47:0)
[08:44:34.462] Build status: STARTED
[08:44:34.462] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:48:0) after 2m51s
[08:47:25.478] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:48:0)
[08:47:25.493] Build status: STARTED
[08:47:25.493] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:49:0) after 7m0s
[08:54:25.599] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:49:0)
[08:54:25.616] Build status: STARTED
[08:54:25.616] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:50:0) after 7m17s
[09:01:42.593] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:50:0)
[09:01:42.616] Build status: STARTED
[09:01:42.617] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:51:0) after 5m13s
[09:06:55.722] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:51:0)
[09:06:55.754] Build status: STARTED
[09:06:55.754] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:52:0) after 2m6s
[09:09:01.776] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:52:0)
[09:09:01.797] Build status: STARTED
[09:09:01.797] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:53:0) after 1m12s
[09:10:13.846] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:53:0)
[09:10:13.905] Build status: STARTED
[09:10:13.905] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:54:0) after 6m37s
[09:16:50.971] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:54:0)
[09:16:50.988] Build status: STARTED
[09:16:50.988] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:55:0) after 4m11s
[09:21:01.987] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:55:0)
[09:21:02.000] Build status: STARTED
[09:21:02.001] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:56:0) after 8m0s
[09:29:02.018] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:56:0)
[09:29:02.073] Build status: STARTED
[09:29:02.073] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:57:0) after 2m23s
[09:31:25.147] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:57:0)
[09:31:25.161] Build status: STARTED
[09:31:25.161] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:58:0) after 5m54s
[09:37:19.221] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:58:0)
[09:37:19.236] Build status: STARTED
[09:37:19.236] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:59:0) after 3m26s
[09:40:45.253] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:59:0)
[09:40:45.276] Build status: STARTED
[09:40:45.276] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:60:0) after 7m12s
[09:47:57.329] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:60:0)
[09:47:57.375] Build status: STARTED
[09:47:57.376] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:61:0) after 4m40s
[09:52:37.428] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:61:0)
[09:52:37.442] Build status: STARTED
[09:52:37.442] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:62:0) after 2m57s
[09:55:34.465] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:62:0)
[09:55:34.480] Build status: STARTED
[09:55:34.480] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:63:0) after 7m22s
[10:02:56.554] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:63:0)
[10:02:56.568] Build status: STARTED
[10:02:56.568] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:64:0) after 9m48s
[10:12:44.600] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:64:0)
[10:12:44.614] Build status: STARTED
[10:12:44.614] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8856888552461443744:65:0) after 6m15s
[10:18:09.493] Received PubSub notification, asking Buildbucket for the build status
[10:18:09.515] Build:
{
"id": "8691458490399971009",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxPGO"
},
"number": 19481,
"createdBy": "project:chromium",
"createTime": "2026-01-28T04:58:07.802322179Z",
"startTime": "2026-01-28T04:58:12.877386605Z",
"endTime": "2026-01-28T10:18:08.051071534Z",
"updateTime": "2026-01-28T10:18:08.051071534Z",
"status": "SUCCESS",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "32c14a3f967716b7e4acc7a11eeee9c7ccd1aad0",
"ref": "refs/heads/main"
}
}
}
[10:18:09.515] Invocation finished in 5h20m3.063236447s with status SUCCEEDED