[23:05:04.376] New invocation is queued and will start shortly
[23:05:05.604] Starting the invocation (attempt 1)
[23:05:05.645] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/b2948153fadd05f9082f75967a7def2ac32a7167"
[23:05:05.645] Popped gitiles commit info from properties and tags
[23:05:05.645] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[23:05:05.645] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[23:05:05.645] Buildbucket request:
{
"requestId": "8847307485043112304",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxPGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b2948153fadd05f9082f75967a7def2ac32a7167",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8847307485043112304"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxPGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[23:05:06.303] Scheduled build:
{
"id": "8681877422992178065",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxPGO"
},
"number": 20588,
"createdBy": "project:chromium",
"createTime": "2026-05-13T23:05:05.713968344Z",
"updateTime": "2026-05-13T23:05:05.713968344Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b2948153fadd05f9082f75967a7def2ac32a7167",
"ref": "refs/heads/main"
}
}
}
[23:05:06.304] Task URL: https://cr-buildbucket.appspot.com/build/8681877422992178065
[23:05:06.304] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:2:0) after 2m36s
[23:05:07.250] Received PubSub notification, asking Buildbucket for the build status
[23:05:07.266] Build status: SCHEDULED
[23:05:21.288] Received PubSub notification, asking Buildbucket for the build status
[23:05:21.327] Build status: STARTED
[23:07:42.339] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:2:0)
[23:07:42.366] Build status: STARTED
[23:07:42.366] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:5:0) after 1m52s
[23:09:34.392] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:5:0)
[23:09:34.413] Build status: STARTED
[23:09:34.414] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:6:0) after 1m46s
[23:11:20.522] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:6:0)
[23:11:20.605] Build status: STARTED
[23:11:20.605] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:7:0) after 2m54s
[23:14:14.627] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:7:0)
[23:14:14.649] Build status: STARTED
[23:14:14.649] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:8:0) after 4m6s
[23:18:20.679] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:8:0)
[23:18:20.704] Build status: STARTED
[23:18:20.704] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:9:0) after 9m51s
[23:28:11.778] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:9:0)
[23:28:11.801] Build status: STARTED
[23:28:11.801] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:10:0) after 9m58s
[23:38:09.930] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:10:0)
[23:38:09.949] Build status: STARTED
[23:38:09.949] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:11:0) after 7m23s
[23:45:33.021] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:11:0)
[23:45:34.031] Build status: STARTED
[23:45:34.031] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:12:0) after 8m22s
[23:53:56.058] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:12:0)
[23:53:56.086] Build status: STARTED
[23:53:56.086] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:13:0) after 7m21s
[00:01:17.107] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:13:0)
[00:01:17.360] Build status: STARTED
[00:01:17.360] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:14:0) after 3m56s
[00:05:13.430] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:14:0)
[00:05:13.497] Build status: STARTED
[00:05:13.497] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:15:0) after 6m52s
[00:12:05.580] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:15:0)
[00:12:05.603] Build status: STARTED
[00:12:05.603] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:16:0) after 4m13s
[00:16:18.641] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:16:0)
[00:16:18.688] Build status: STARTED
[00:16:18.688] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:17:0) after 9m43s
[00:26:01.768] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:17:0)
[00:26:01.788] Build status: STARTED
[00:26:01.788] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:18:0) after 8m1s
[00:34:02.883] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:18:0)
[00:34:02.907] Build status: STARTED
[00:34:02.907] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:19:0) after 6m55s
[00:40:57.943] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:19:0)
[00:40:58.005] Build status: STARTED
[00:40:58.005] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:20:0) after 3m0s
[00:43:58.056] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:20:0)
[00:43:58.085] Build status: STARTED
[00:43:58.085] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:21:0) after 2m57s
[00:46:55.119] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:21:0)
[00:46:55.138] Build status: STARTED
[00:46:55.138] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:22:0) after 7m52s
[00:54:47.160] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:22:0)
[00:54:47.180] Build status: STARTED
[00:54:47.180] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:23:0) after 3m9s
[00:57:56.205] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:23:0)
[00:57:56.222] Build status: STARTED
[00:57:56.222] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:24:0) after 2m10s
[01:00:06.242] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:24:0)
[01:00:06.265] Build status: STARTED
[01:00:06.265] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:25:0) after 9m40s
[01:09:46.335] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:25:0)
[01:09:46.582] Build status: STARTED
[01:09:46.582] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:26:0) after 7m17s
[01:17:03.603] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:26:0)
[01:17:03.630] Build status: STARTED
[01:17:03.630] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:27:0) after 8m14s
[01:25:17.650] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:27:0)
[01:25:17.667] Build status: STARTED
[01:25:17.667] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:28:0) after 8m21s
[01:33:38.767] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:28:0)
[01:33:38.895] Build status: STARTED
[01:33:38.895] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:29:0) after 3m5s
[01:36:43.940] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:29:0)
[01:36:43.963] Build status: STARTED
[01:36:43.963] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:30:0) after 6m55s
[01:43:38.946] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:30:0)
[01:43:38.967] Build status: STARTED
[01:43:38.967] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:31:0) after 2m9s
[01:45:47.997] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:31:0)
[01:45:48.017] Build status: STARTED
[01:45:48.017] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:32:0) after 7m39s
[01:53:27.037] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:32:0)
[01:53:27.078] Build status: STARTED
[01:53:27.078] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:33:0) after 7m21s
[02:00:48.103] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:33:0)
[02:00:48.123] Build status: STARTED
[02:00:48.123] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:34:0) after 9m32s
[02:10:20.194] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:34:0)
[02:10:20.222] Build status: STARTED
[02:10:20.222] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:35:0) after 6m58s
[02:17:18.290] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:35:0)
[02:17:18.313] Build status: STARTED
[02:17:18.313] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:36:0) after 3m37s
[02:20:55.330] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:36:0)
[02:20:55.350] Build status: STARTED
[02:20:55.350] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:37:0) after 7m26s
[02:28:21.494] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:37:0)
[02:28:21.511] Build status: STARTED
[02:28:21.511] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:38:0) after 2m29s
[02:30:50.686] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:38:0)
[02:30:50.716] Build status: STARTED
[02:30:50.716] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:39:0) after 9m23s
[02:40:13.746] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:39:0)
[02:40:13.763] Build status: STARTED
[02:40:13.763] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:40:0) after 4m41s
[02:44:54.762] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:40:0)
[02:44:54.788] Build status: STARTED
[02:44:54.788] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:41:0) after 4m56s
[02:49:50.803] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:41:0)
[02:49:50.829] Build status: STARTED
[02:49:50.829] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:42:0) after 8m53s
[02:58:44.110] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:42:0)
[02:58:44.190] Build status: STARTED
[02:58:44.190] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:43:0) after 5m19s
[03:04:03.220] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:43:0)
[03:04:03.237] Build status: STARTED
[03:04:03.237] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:44:0) after 4m48s
[03:08:51.433] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:44:0)
[03:08:51.448] Build status: STARTED
[03:08:51.448] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:45:0) after 3m19s
[03:12:10.482] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:45:0)
[03:12:10.505] Build status: STARTED
[03:12:10.505] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:46:0) after 3m44s
[03:15:54.528] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:46:0)
[03:15:54.588] Build status: STARTED
[03:15:54.588] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:47:0) after 7m31s
[03:23:25.610] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:47:0)
[03:23:25.728] Build status: STARTED
[03:23:25.728] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:48:0) after 2m0s
[03:25:25.722] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:48:0)
[03:25:25.740] Build status: STARTED
[03:25:25.740] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:49:0) after 7m1s
[03:32:26.763] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:49:0)
[03:32:26.795] Build status: STARTED
[03:32:26.795] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:50:0) after 6m28s
[03:38:54.814] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:50:0)
[03:38:54.868] Build status: STARTED
[03:38:54.868] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:51:0) after 6m31s
[03:45:25.895] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:51:0)
[03:45:25.920] Build status: STARTED
[03:45:25.920] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:52:0) after 2m6s
[03:47:31.945] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:52:0)
[03:47:31.960] Build status: STARTED
[03:47:31.960] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:53:0) after 3m24s
[03:50:55.983] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:53:0)
[03:50:56.000] Build status: STARTED
[03:50:56.000] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:54:0) after 4m29s
[03:55:25.021] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:54:0)
[03:55:25.048] Build status: STARTED
[03:55:25.048] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:55:0) after 4m52s
[04:00:17.169] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:55:0)
[04:00:17.191] Build status: STARTED
[04:00:17.191] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:56:0) after 2m37s
[04:02:54.217] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:56:0)
[04:02:54.257] Build status: STARTED
[04:02:54.258] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:57:0) after 4m23s
[04:07:17.277] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:57:0)
[04:07:17.302] Build status: STARTED
[04:07:17.302] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:58:0) after 1m16s
[04:08:33.322] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:58:0)
[04:08:33.343] Build status: STARTED
[04:08:33.343] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:59:0) after 1m37s
[04:10:10.369] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:59:0)
[04:10:10.384] Build status: STARTED
[04:10:10.384] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:60:0) after 9m57s
[04:20:07.432] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:60:0)
[04:20:07.467] Build status: STARTED
[04:20:07.468] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:61:0) after 5m17s
[04:25:24.503] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:61:0)
[04:25:24.520] Build status: STARTED
[04:25:24.520] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:62:0) after 5m32s
[04:30:56.544] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:62:0)
[04:30:56.564] Build status: STARTED
[04:30:56.564] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:63:0) after 7m42s
[04:38:38.686] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:63:0)
[04:38:38.702] Build status: STARTED
[04:38:38.702] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:64:0) after 3m34s
[04:42:12.728] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:64:0)
[04:42:12.749] Build status: STARTED
[04:42:12.749] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:65:0) after 3m1s
[04:45:13.812] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:65:0)
[04:45:13.829] Build status: STARTED
[04:45:13.829] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:66:0) after 7m55s
[04:53:08.903] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:66:0)
[04:53:08.927] Build status: STARTED
[04:53:08.927] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8847307485043112304:67:0) after 4m48s
[04:55:50.545] Received PubSub notification, asking Buildbucket for the build status
[04:55:50.565] Build:
{
"id": "8681877422992178065",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxPGO"
},
"number": 20588,
"createdBy": "project:chromium",
"createTime": "2026-05-13T23:05:05.713968344Z",
"startTime": "2026-05-13T23:05:21.096963236Z",
"endTime": "2026-05-14T04:55:50.088630785Z",
"updateTime": "2026-05-14T04:55:50.088630785Z",
"status": "SUCCESS",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b2948153fadd05f9082f75967a7def2ac32a7167",
"ref": "refs/heads/main"
}
}
}
[04:55:50.565] Invocation finished in 5h50m46.192618663s with status SUCCEEDED