[16:22:32.698] New invocation is queued and will start shortly
[16:22:33.814] Starting the invocation (attempt 1)
[16:22:33.848] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/f128737b3da6c43b9df8fe7e80cc2af8a74e85d0"
[16:22:33.848] Popped gitiles commit info from properties and tags
[16:22:33.848] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[16:22:33.848] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[16:22:33.848] Buildbucket request:
{
"requestId": "8840175649571814976",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxPGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f128737b3da6c43b9df8fe7e80cc2af8a74e85d0",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8840175649571814976"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxPGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[16:22:34.450] Scheduled build:
{
"id": "8674745587634295073",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxPGO"
},
"number": 22118,
"createdBy": "project:chromium",
"createTime": "2026-07-31T16:22:33.922643701Z",
"updateTime": "2026-07-31T16:22:33.922643701Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f128737b3da6c43b9df8fe7e80cc2af8a74e85d0",
"ref": "refs/heads/main"
}
}
}
[16:22:34.450] Task URL: https://cr-buildbucket.appspot.com/build/8674745587634295073
[16:22:34.450] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8840175649571814976:2:0) after 4m51s
[16:22:35.446] Received PubSub notification, asking Buildbucket for the build status
[16:22:35.470] Build status: SCHEDULED
[16:23:39.398] Received PubSub notification, asking Buildbucket for the build status
[16:23:39.428] Build status: STARTED
[16:27:25.546] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8840175649571814976:2:0)
[16:27:25.563] Build status: STARTED
[16:27:25.563] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8840175649571814976:5:0) after 4m19s
[16:31:44.608] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8840175649571814976:5:0)
[16:31:44.630] Build status: STARTED
[16:31:44.630] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8840175649571814976:6:0) after 8m29s
[16:40:13.683] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8840175649571814976:6:0)
[16:40:13.702] Build status: STARTED
[16:40:13.702] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8840175649571814976:7:0) after 8m57s
[16:49:10.818] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8840175649571814976:7:0)
[16:49:10.837] Build status: STARTED
[16:49:10.837] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8840175649571814976:8:0) after 9m32s
[16:58:43.121] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8840175649571814976:8:0)
[16:58:43.173] Build status: STARTED
[16:58:43.173] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8840175649571814976:9:0) after 2m20s
[17:01:03.218] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8840175649571814976:9:0)
[17:01:03.255] Build status: STARTED
[17:01:03.255] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8840175649571814976:10:0) after 2m23s
[17:03:26.277] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8840175649571814976:10:0)
[17:03:26.361] Build status: STARTED
[17:03:26.361] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8840175649571814976:11:0) after 2m32s
[17:05:58.378] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8840175649571814976:11:0)
[17:05:58.395] Build status: STARTED
[17:05:58.395] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8840175649571814976:12:0) after 1m2s
[17:07:00.414] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8840175649571814976:12:0)
[17:07:00.441] Build status: STARTED
[17:07:00.441] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8840175649571814976:13:0) after 9m19s
[17:16:19.458] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8840175649571814976:13:0)
[17:16:19.536] Build status: STARTED
[17:16:19.536] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8840175649571814976:14:0) after 4m24s
[17:20:43.553] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8840175649571814976:14:0)
[17:20:43.576] Build status: STARTED
[17:20:43.576] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8840175649571814976:15:0) after 5m4s
[17:25:47.655] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8840175649571814976:15:0)
[17:25:47.693] Build status: STARTED
[17:25:47.693] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8840175649571814976:16:0) after 7m6s
[17:32:53.777] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8840175649571814976:16:0)
[17:32:53.802] Build status: STARTED
[17:32:53.803] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8840175649571814976:17:0) after 8m41s
[17:41:34.878] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8840175649571814976:17:0)
[17:41:34.908] Build status: STARTED
[17:41:34.908] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8840175649571814976:18:0) after 1m37s
[17:43:11.993] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8840175649571814976:18:0)
[17:43:12.018] Build status: STARTED
[17:43:12.018] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8840175649571814976:19:0) after 6m58s
[17:50:10.097] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8840175649571814976:19:0)
[17:50:10.117] Build status: STARTED
[17:50:10.117] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8840175649571814976:20:0) after 6m58s
[17:57:08.178] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8840175649571814976:20:0)
[17:57:08.202] Build status: STARTED
[17:57:08.202] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8840175649571814976:21:0) after 2m21s
[17:59:29.221] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8840175649571814976:21:0)
[17:59:29.243] Build status: STARTED
[17:59:29.243] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8840175649571814976:22:0) after 3m31s
[18:03:00.293] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8840175649571814976:22:0)
[18:03:00.394] Build status: STARTED
[18:03:00.394] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8840175649571814976:23:0) after 2m36s
[18:05:36.417] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8840175649571814976:23:0)
[18:05:36.510] Build status: STARTED
[18:05:36.510] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8840175649571814976:24:0) after 1m33s
[18:07:09.518] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8840175649571814976:24:0)
[18:07:09.550] Build status: STARTED
[18:07:09.550] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8840175649571814976:25:0) after 4m16s
[18:11:25.613] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8840175649571814976:25:0)
[18:11:25.646] Build status: STARTED
[18:11:25.646] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8840175649571814976:26:0) after 7m51s
[18:19:16.706] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8840175649571814976:26:0)
[18:19:16.729] Build status: STARTED
[18:19:16.729] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8840175649571814976:27:0) after 2m3s
[18:21:19.780] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8840175649571814976:27:0)
[18:21:20.282] Build status: STARTED
[18:21:20.282] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8840175649571814976:28:0) after 3m26s
[18:24:46.305] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8840175649571814976:28:0)
[18:24:46.324] Build status: STARTED
[18:24:46.324] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8840175649571814976:29:0) after 9m43s
[18:34:29.333] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8840175649571814976:29:0)
[18:34:29.348] Build status: STARTED
[18:34:29.348] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8840175649571814976:30:0) after 4m8s
[18:38:37.377] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8840175649571814976:30:0)
[18:38:37.396] Build status: STARTED
[18:38:37.396] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8840175649571814976:31:0) after 4m39s
[18:43:16.417] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8840175649571814976:31:0)
[18:43:16.489] Build status: STARTED
[18:43:16.489] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8840175649571814976:32:0) after 2m59s
[18:46:15.536] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8840175649571814976:32:0)
[18:46:15.558] Build status: STARTED
[18:46:15.558] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8840175649571814976:33:0) after 6m47s
[18:53:02.599] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8840175649571814976:33:0)
[18:53:02.626] Build status: STARTED
[18:53:02.626] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8840175649571814976:34:0) after 2m29s
[18:55:31.643] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8840175649571814976:34:0)
[18:55:31.660] Build status: STARTED
[18:55:31.660] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8840175649571814976:35:0) after 1m0s
[18:56:31.676] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8840175649571814976:35:0)
[18:56:31.720] Build status: STARTED
[18:56:31.720] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8840175649571814976:36:0) after 5m11s
[19:01:42.736] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8840175649571814976:36:0)
[19:01:42.768] Build status: STARTED
[19:01:42.768] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8840175649571814976:37:0) after 2m29s
[19:03:40.049] Received PubSub notification, asking Buildbucket for the build status
[19:03:40.075] Build:
{
"id": "8674745587634295073",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxPGO"
},
"number": 22118,
"createdBy": "project:chromium",
"createTime": "2026-07-31T16:22:33.922643701Z",
"startTime": "2026-07-31T16:23:39.184307977Z",
"endTime": "2026-07-31T19:03:39.777884622Z",
"updateTime": "2026-07-31T19:03:39.777884622Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f128737b3da6c43b9df8fe7e80cc2af8a74e85d0",
"ref": "refs/heads/main"
}
}
}
[19:03:40.075] Invocation finished in 2h41m7.383882022s with status FAILED