[15:01:04.210] New invocation is queued and will start shortly
[15:01:05.620] Starting the invocation (attempt 1)
[15:01:05.652] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/66fa72aa53b3202aef46e6c3f3893d2504bc8a24"
[15:01:05.652] Popped gitiles commit info from properties and tags
[15:01:05.652] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[15:01:05.652] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[15:01:05.652] Buildbucket request:
{
"requestId": "8842717490579131024",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxPGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "66fa72aa53b3202aef46e6c3f3893d2504bc8a24",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8842717490579131024"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxPGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[15:01:06.170] Scheduled build:
{
"id": "8677287428329841217",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxPGO"
},
"number": 21490,
"createdBy": "project:chromium",
"createTime": "2026-07-03T15:01:05.734256264Z",
"updateTime": "2026-07-03T15:01:05.734256264Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "66fa72aa53b3202aef46e6c3f3893d2504bc8a24",
"ref": "refs/heads/main"
}
}
}
[15:01:06.170] Task URL: https://cr-buildbucket.appspot.com/build/8677287428329841217
[15:01:06.170] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842717490579131024:2:0) after 4m22s
[15:01:07.164] Received PubSub notification, asking Buildbucket for the build status
[15:01:07.302] Build status: SCHEDULED
[15:01:53.607] Received PubSub notification, asking Buildbucket for the build status
[15:01:53.629] Build status: STARTED
[15:05:28.236] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842717490579131024:2:0)
[15:05:28.253] Build status: STARTED
[15:05:28.253] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842717490579131024:5:0) after 8m5s
[15:13:33.272] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842717490579131024:5:0)
[15:13:33.292] Build status: STARTED
[15:13:33.292] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842717490579131024:6:0) after 7m54s
[15:21:27.358] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842717490579131024:6:0)
[15:21:27.395] Build status: STARTED
[15:21:27.395] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842717490579131024:7:0) after 4m13s
[15:25:40.362] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842717490579131024:7:0)
[15:25:40.379] Build status: STARTED
[15:25:40.379] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842717490579131024:8:0) after 9m43s
[15:35:23.438] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842717490579131024:8:0)
[15:35:23.458] Build status: STARTED
[15:35:23.458] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842717490579131024:9:0) after 3m39s
[15:39:02.477] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842717490579131024:9:0)
[15:39:02.525] Build status: STARTED
[15:39:02.525] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842717490579131024:10:0) after 1m45s
[15:40:47.559] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842717490579131024:10:0)
[15:40:47.590] Build status: STARTED
[15:40:47.590] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842717490579131024:11:0) after 1m37s
[15:42:24.613] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842717490579131024:11:0)
[15:42:24.647] Build status: STARTED
[15:42:24.647] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842717490579131024:12:0) after 6m22s
[15:48:46.693] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842717490579131024:12:0)
[15:48:46.714] Build status: STARTED
[15:48:46.714] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842717490579131024:13:0) after 1m42s
[15:50:28.696] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842717490579131024:13:0)
[15:50:28.718] Build status: STARTED
[15:50:28.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842717490579131024:14:0) after 2m47s
[15:53:15.745] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842717490579131024:14:0)
[15:53:15.770] Build status: STARTED
[15:53:15.770] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842717490579131024:15:0) after 3m13s
[15:56:28.801] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842717490579131024:15:0)
[15:56:28.819] Build status: STARTED
[15:56:28.819] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842717490579131024:16:0) after 9m8s
[16:05:36.840] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842717490579131024:16:0)
[16:05:36.860] Build status: STARTED
[16:05:36.860] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842717490579131024:17:0) after 1m24s
[16:07:00.869] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842717490579131024:17:0)
[16:07:00.932] Build status: STARTED
[16:07:00.932] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842717490579131024:18:0) after 9m45s
[16:16:45.986] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842717490579131024:18:0)
[16:16:46.006] Build status: STARTED
[16:16:46.006] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842717490579131024:19:0) after 6m32s
[16:23:18.024] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842717490579131024:19:0)
[16:23:18.067] Build status: STARTED
[16:23:18.067] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842717490579131024:20:0) after 8m39s
[16:31:57.080] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842717490579131024:20:0)
[16:31:57.106] Build status: STARTED
[16:31:57.106] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842717490579131024:21:0) after 5m40s
[16:37:37.123] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842717490579131024:21:0)
[16:37:37.138] Build status: STARTED
[16:37:37.138] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842717490579131024:22:0) after 8m54s
[16:46:31.156] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842717490579131024:22:0)
[16:46:31.199] Build status: STARTED
[16:46:31.199] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842717490579131024:23:0) after 6m36s
[16:53:07.216] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842717490579131024:23:0)
[16:53:07.258] Build status: STARTED
[16:53:07.258] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842717490579131024:24:0) after 3m50s
[16:56:57.325] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842717490579131024:24:0)
[16:56:57.447] Build status: STARTED
[16:56:57.447] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842717490579131024:25:0) after 3m28s
[17:00:25.461] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842717490579131024:25:0)
[17:00:25.506] Build status: STARTED
[17:00:25.506] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842717490579131024:26:0) after 9m25s
[17:09:50.519] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842717490579131024:26:0)
[17:09:50.654] Build status: STARTED
[17:09:50.654] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842717490579131024:27:0) after 1m41s
[17:11:31.722] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842717490579131024:27:0)
[17:11:31.745] Build status: STARTED
[17:11:31.745] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842717490579131024:28:0) after 3m38s
[17:15:09.747] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842717490579131024:28:0)
[17:15:09.767] Build status: STARTED
[17:15:09.768] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842717490579131024:29:0) after 7m35s
[17:22:44.958] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842717490579131024:29:0)
[17:22:44.976] Build status: STARTED
[17:22:44.976] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842717490579131024:30:0) after 1m52s
[17:24:37.072] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842717490579131024:30:0)
[17:24:37.091] Build status: STARTED
[17:24:37.091] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842717490579131024:31:0) after 9m40s
[17:34:17.164] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842717490579131024:31:0)
[17:34:17.180] Build status: STARTED
[17:34:17.180] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842717490579131024:32:0) after 8m4s
[17:42:21.193] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842717490579131024:32:0)
[17:42:21.224] Build status: STARTED
[17:42:21.225] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842717490579131024:33:0) after 1m57s
[17:44:18.242] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842717490579131024:33:0)
[17:44:18.263] Build status: STARTED
[17:44:18.263] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842717490579131024:34:0) after 3m53s
[17:48:11.277] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842717490579131024:34:0)
[17:48:11.291] Build status: STARTED
[17:48:11.291] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842717490579131024:35:0) after 4m13s
[17:52:24.278] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842717490579131024:35:0)
[17:52:24.294] Build status: STARTED
[17:52:24.294] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842717490579131024:36:0) after 9m30s
[18:01:54.337] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842717490579131024:36:0)
[18:01:54.373] Build status: STARTED
[18:01:54.373] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842717490579131024:37:0) after 3m38s
[18:05:32.773] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842717490579131024:37:0)
[18:05:32.791] Build status: STARTED
[18:05:32.791] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842717490579131024:38:0) after 3m43s
[18:09:15.808] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842717490579131024:38:0)
[18:09:15.830] Build status: STARTED
[18:09:15.830] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842717490579131024:39:0) after 1m51s
[18:11:06.848] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842717490579131024:39:0)
[18:11:06.876] Build status: STARTED
[18:11:06.877] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842717490579131024:40:0) after 9m51s
[18:20:57.925] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842717490579131024:40:0)
[18:20:57.955] Build status: STARTED
[18:20:57.955] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842717490579131024:41:0) after 9m4s
[18:30:01.972] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842717490579131024:41:0)
[18:30:01.990] Build status: STARTED
[18:30:01.990] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842717490579131024:42:0) after 3m11s
[18:31:34.409] Received PubSub notification, asking Buildbucket for the build status
[18:31:34.441] Build:
{
"id": "8677287428329841217",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxPGO"
},
"number": 21490,
"createdBy": "project:chromium",
"createTime": "2026-07-03T15:01:05.734256264Z",
"startTime": "2026-07-03T15:01:53.415245256Z",
"endTime": "2026-07-03T18:31:33.683319196Z",
"updateTime": "2026-07-03T18:31:33.683319196Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "66fa72aa53b3202aef46e6c3f3893d2504bc8a24",
"ref": "refs/heads/main"
}
}
}
[18:31:34.441] Invocation finished in 3h30m30.23492275s with status FAILED