[13:21:24.241] New invocation is queued and will start shortly
[13:21:25.336] Starting the invocation (attempt 1)
[13:21:25.363] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/ba41be7f1e6e6ff2e270bb088ca2ca5b6d403de2"
[13:21:25.363] Popped gitiles commit info from properties and tags
[13:21:25.363] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[13:21:25.363] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[13:21:25.363] Buildbucket request:
{
"requestId": "8854320172734626432",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxPGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ba41be7f1e6e6ff2e270bb088ca2ca5b6d403de2",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8854320172734626432"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxPGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[13:21:25.775] Scheduled build:
{
"id": "8688890110841476593",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxPGO"
},
"number": 19631,
"createdBy": "project:chromium",
"createTime": "2026-02-25T13:21:25.422482442Z",
"updateTime": "2026-02-25T13:21:25.422482442Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ba41be7f1e6e6ff2e270bb088ca2ca5b6d403de2",
"ref": "refs/heads/main"
}
}
}
[13:21:25.775] Task URL: https://cr-buildbucket.appspot.com/build/8688890110841476593
[13:21:25.775] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:2:0) after 3m12s
[13:21:26.773] Received PubSub notification, asking Buildbucket for the build status
[13:21:26.939] Build status: SCHEDULED
[13:21:33.658] Received PubSub notification, asking Buildbucket for the build status
[13:21:33.673] Build status: STARTED
[13:24:37.795] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:2:0)
[13:24:37.833] Build status: STARTED
[13:24:37.833] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:5:0) after 2m20s
[13:26:57.849] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:5:0)
[13:26:57.868] Build status: STARTED
[13:26:57.868] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:6:0) after 9m35s
[13:36:32.886] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:6:0)
[13:36:32.902] Build status: STARTED
[13:36:32.902] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:7:0) after 9m23s
[13:45:55.929] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:7:0)
[13:45:55.944] Build status: STARTED
[13:45:55.944] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:8:0) after 6m56s
[13:52:51.961] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:8:0)
[13:52:51.979] Build status: STARTED
[13:52:51.979] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:9:0) after 8m2s
[14:00:54.046] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:9:0)
[14:00:54.065] Build status: STARTED
[14:00:54.065] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:10:0) after 5m33s
[14:06:27.087] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:10:0)
[14:06:27.108] Build status: STARTED
[14:06:27.108] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:11:0) after 1m47s
[14:08:14.232] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:11:0)
[14:08:14.320] Build status: STARTED
[14:08:14.321] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:12:0) after 3m53s
[14:12:07.335] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:12:0)
[14:12:07.383] Build status: STARTED
[14:12:07.383] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:13:0) after 4m20s
[14:16:27.381] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:13:0)
[14:16:27.405] Build status: STARTED
[14:16:27.405] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:14:0) after 2m53s
[14:19:20.482] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:14:0)
[14:19:20.499] Build status: STARTED
[14:19:20.499] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:15:0) after 8m32s
[14:27:52.577] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:15:0)
[14:27:52.594] Build status: STARTED
[14:27:52.594] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:16:0) after 1m30s
[14:29:22.638] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:16:0)
[14:29:22.659] Build status: STARTED
[14:29:22.659] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:17:0) after 6m32s
[14:35:54.677] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:17:0)
[14:35:54.725] Build status: STARTED
[14:35:54.725] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:18:0) after 1m11s
[14:37:05.775] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:18:0)
[14:37:05.860] Build status: STARTED
[14:37:05.860] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:19:0) after 3m40s
[14:40:45.931] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:19:0)
[14:40:45.946] Build status: STARTED
[14:40:45.946] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:20:0) after 4m30s
[14:45:15.934] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:20:0)
[14:45:15.955] Build status: STARTED
[14:45:15.955] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:21:0) after 9m35s
[14:54:51.117] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:21:0)
[14:54:51.130] Build status: STARTED
[14:54:51.130] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:22:0) after 4m54s
[14:59:45.178] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:22:0)
[14:59:45.199] Build status: STARTED
[14:59:45.199] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:23:0) after 4m44s
[15:04:29.247] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:23:0)
[15:04:29.306] Build status: STARTED
[15:04:29.306] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:24:0) after 6m19s
[15:10:48.484] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:24:0)
[15:10:48.508] Build status: STARTED
[15:10:48.508] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:25:0) after 3m0s
[15:13:48.528] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:25:0)
[15:13:48.545] Build status: STARTED
[15:13:48.545] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:26:0) after 3m17s
[15:17:05.613] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:26:0)
[15:17:05.628] Build status: STARTED
[15:17:05.628] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:27:0) after 2m57s
[15:20:02.748] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:27:0)
[15:20:02.768] Build status: STARTED
[15:20:02.768] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:28:0) after 9m45s
[15:29:47.795] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:28:0)
[15:29:47.811] Build status: STARTED
[15:29:47.811] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:29:0) after 4m51s
[15:34:38.896] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:29:0)
[15:34:38.914] Build status: STARTED
[15:34:38.914] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:30:0) after 6m24s
[15:41:02.936] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:30:0)
[15:41:02.955] Build status: STARTED
[15:41:02.955] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:31:0) after 4m42s
[15:45:45.051] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:31:0)
[15:45:45.069] Build status: STARTED
[15:45:45.069] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:32:0) after 3m54s
[15:49:39.141] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:32:0)
[15:49:39.181] Build status: STARTED
[15:49:39.181] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:33:0) after 7m0s
[15:56:39.271] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:33:0)
[15:56:39.288] Build status: STARTED
[15:56:39.289] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:34:0) after 5m44s
[16:02:23.313] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:34:0)
[16:02:23.339] Build status: STARTED
[16:02:23.340] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:35:0) after 3m56s
[16:06:19.353] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:35:0)
[16:06:19.407] Build status: STARTED
[16:06:19.407] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:36:0) after 5m18s
[16:11:37.426] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:36:0)
[16:11:37.454] Build status: STARTED
[16:11:37.454] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:37:0) after 3m29s
[16:15:06.450] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:37:0)
[16:15:06.468] Build status: STARTED
[16:15:06.468] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:38:0) after 2m4s
[16:17:10.512] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:38:0)
[16:17:10.529] Build status: STARTED
[16:17:10.529] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:39:0) after 2m29s
[16:19:39.593] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:39:0)
[16:19:39.610] Build status: STARTED
[16:19:39.610] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:40:0) after 8m34s
[16:28:13.630] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:40:0)
[16:28:13.652] Build status: STARTED
[16:28:13.652] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:41:0) after 4m22s
[16:32:35.669] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:41:0)
[16:32:35.708] Build status: STARTED
[16:32:35.708] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:42:0) after 8m25s
[16:41:00.728] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:42:0)
[16:41:00.747] Build status: STARTED
[16:41:00.747] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:43:0) after 7m22s
[16:48:22.863] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:43:0)
[16:48:22.880] Build status: STARTED
[16:48:22.880] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:44:0) after 3m35s
[16:51:57.937] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:44:0)
[16:51:58.099] Build status: STARTED
[16:51:58.099] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:45:0) after 1m44s
[16:53:42.233] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:45:0)
[16:53:42.254] Build status: STARTED
[16:53:42.254] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:46:0) after 4m56s
[16:58:38.271] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:46:0)
[16:58:38.288] Build status: STARTED
[16:58:38.288] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:47:0) after 4m36s
[17:03:14.303] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:47:0)
[17:03:14.330] Build status: STARTED
[17:03:14.330] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:48:0) after 7m0s
[17:10:14.443] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:48:0)
[17:10:14.596] Build status: STARTED
[17:10:14.596] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:49:0) after 1m12s
[17:11:26.611] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:49:0)
[17:11:26.623] Build status: STARTED
[17:11:26.624] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:50:0) after 6m56s
[17:18:22.642] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:50:0)
[17:18:22.656] Build status: STARTED
[17:18:22.656] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:51:0) after 1m51s
[17:20:13.678] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:51:0)
[17:20:13.697] Build status: STARTED
[17:20:13.697] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:52:0) after 8m3s
[17:28:16.825] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:52:0)
[17:28:16.841] Build status: STARTED
[17:28:16.842] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:53:0) after 8m50s
[17:37:06.863] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:53:0)
[17:37:06.878] Build status: STARTED
[17:37:06.878] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:54:0) after 2m2s
[17:39:08.940] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:54:0)
[17:39:08.962] Build status: STARTED
[17:39:08.962] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:55:0) after 2m1s
[17:41:10.002] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:55:0)
[17:41:10.023] Build status: STARTED
[17:41:10.023] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:56:0) after 6m15s
[17:47:25.055] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:56:0)
[17:47:25.074] Build status: STARTED
[17:47:25.074] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:57:0) after 4m3s
[17:51:28.092] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:57:0)
[17:51:28.106] Build status: STARTED
[17:51:28.106] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:58:0) after 3m5s
[17:54:33.165] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:58:0)
[17:54:33.180] Build status: STARTED
[17:54:33.180] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:59:0) after 6m33s
[18:01:06.276] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:59:0)
[18:01:06.290] Build status: STARTED
[18:01:06.290] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:60:0) after 2m46s
[18:03:52.307] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:60:0)
[18:03:52.388] Build status: STARTED
[18:03:52.388] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:61:0) after 6m10s
[18:10:02.429] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:61:0)
[18:10:02.469] Build status: STARTED
[18:10:02.469] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:62:0) after 2m43s
[18:12:45.452] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:62:0)
[18:12:45.472] Build status: STARTED
[18:12:45.472] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:63:0) after 2m47s
[18:15:32.594] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:63:0)
[18:15:32.611] Build status: STARTED
[18:15:32.612] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:64:0) after 7m2s
[18:22:34.640] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:64:0)
[18:22:34.661] Build status: STARTED
[18:22:34.661] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:65:0) after 1m49s
[18:24:23.703] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:65:0)
[18:24:23.721] Build status: STARTED
[18:24:23.721] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8854320172734626432:66:0) after 6m5s
[18:25:09.848] Received PubSub notification, asking Buildbucket for the build status
[18:25:09.917] Build:
{
"id": "8688890110841476593",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxPGO"
},
"number": 19631,
"createdBy": "project:chromium",
"createTime": "2026-02-25T13:21:25.422482442Z",
"startTime": "2026-02-25T13:21:30.542413343Z",
"endTime": "2026-02-25T18:25:09.593336021Z",
"updateTime": "2026-02-25T18:25:09.593336021Z",
"status": "SUCCESS",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ba41be7f1e6e6ff2e270bb088ca2ca5b6d403de2",
"ref": "refs/heads/main"
}
}
}
[18:25:09.917] Invocation finished in 5h3m45.684104045s with status SUCCEEDED