[17:35:22.549] New invocation is queued and will start shortly
[17:35:23.639] Starting the invocation (attempt 1)
[17:35:23.659] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/4e93515817dc9cd620ea409f46439da02a90ed94"
[17:35:23.659] Popped gitiles commit info from properties and tags
[17:35:23.659] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[17:35:23.660] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[17:35:23.660] Buildbucket request:
{
"requestId": "8850770912526686288",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxPGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4e93515817dc9cd620ea409f46439da02a90ed94",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8850770912526686288"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxPGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[17:35:24.183] Scheduled build:
{
"id": "8685340850646177281",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxPGO"
},
"number": 20219,
"createdBy": "project:chromium",
"createTime": "2026-04-05T17:35:23.712007101Z",
"updateTime": "2026-04-05T17:35:23.712007101Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4e93515817dc9cd620ea409f46439da02a90ed94",
"ref": "refs/heads/main"
}
}
}
[17:35:24.183] Task URL: https://cr-buildbucket.appspot.com/build/8685340850646177281
[17:35:24.183] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:2:0) after 5m16s
[17:35:25.150] Received PubSub notification, asking Buildbucket for the build status
[17:35:25.172] Build status: SCHEDULED
[17:39:29.430] Received PubSub notification, asking Buildbucket for the build status
[17:39:29.449] Build status: STARTED
[17:40:40.282] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:2:0)
[17:40:40.299] Build status: STARTED
[17:40:40.299] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:5:0) after 5m39s
[17:46:19.436] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:5:0)
[17:46:19.521] Build status: STARTED
[17:46:19.521] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:6:0) after 4m11s
[17:50:30.547] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:6:0)
[17:50:30.571] Build status: STARTED
[17:50:30.571] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:7:0) after 2m7s
[17:52:37.693] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:7:0)
[17:52:37.718] Build status: STARTED
[17:52:37.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:8:0) after 7m35s
[18:00:12.737] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:8:0)
[18:00:13.314] Build status: STARTED
[18:00:13.314] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:9:0) after 1m26s
[18:01:39.330] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:9:0)
[18:01:39.353] Build status: STARTED
[18:01:39.353] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:10:0) after 7m18s
[18:08:57.398] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:10:0)
[18:08:57.424] Build status: STARTED
[18:08:57.424] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:11:0) after 7m15s
[18:16:12.437] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:11:0)
[18:16:12.505] Build status: STARTED
[18:16:12.505] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:12:0) after 2m7s
[18:18:19.519] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:12:0)
[18:18:19.535] Build status: STARTED
[18:18:19.535] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:13:0) after 8m10s
[18:26:29.554] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:13:0)
[18:26:29.583] Build status: STARTED
[18:26:29.583] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:14:0) after 1m59s
[18:28:28.697] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:14:0)
[18:28:28.714] Build status: STARTED
[18:28:28.714] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:15:0) after 4m8s
[18:32:36.731] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:15:0)
[18:32:36.796] Build status: STARTED
[18:32:36.796] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:16:0) after 6m27s
[18:39:03.808] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:16:0)
[18:39:03.823] Build status: STARTED
[18:39:03.823] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:17:0) after 5m7s
[18:44:10.871] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:17:0)
[18:44:10.899] Build status: STARTED
[18:44:10.899] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:18:0) after 5m2s
[18:49:12.980] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:18:0)
[18:49:13.003] Build status: STARTED
[18:49:13.003] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:19:0) after 7m49s
[18:57:02.017] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:19:0)
[18:57:02.088] Build status: STARTED
[18:57:02.089] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:20:0) after 8m3s
[19:05:05.196] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:20:0)
[19:05:05.229] Build status: STARTED
[19:05:05.229] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:21:0) after 6m24s
[19:11:29.345] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:21:0)
[19:11:29.361] Build status: STARTED
[19:11:29.361] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:22:0) after 4m8s
[19:15:37.441] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:22:0)
[19:15:37.503] Build status: STARTED
[19:15:37.503] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:23:0) after 3m2s
[19:18:39.495] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:23:0)
[19:18:39.529] Build status: STARTED
[19:18:39.529] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:24:0) after 8m49s
[19:27:28.676] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:24:0)
[19:27:28.698] Build status: STARTED
[19:27:28.698] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:25:0) after 4m16s
[19:31:44.829] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:25:0)
[19:31:44.856] Build status: STARTED
[19:31:44.856] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:26:0) after 2m16s
[19:34:00.872] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:26:0)
[19:34:00.989] Build status: STARTED
[19:34:00.989] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:27:0) after 6m11s
[19:40:12.043] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:27:0)
[19:40:12.076] Build status: STARTED
[19:40:12.076] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:28:0) after 9m0s
[19:49:12.096] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:28:0)
[19:49:12.116] Build status: STARTED
[19:49:12.116] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:29:0) after 8m52s
[19:58:04.229] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:29:0)
[19:58:04.305] Build status: STARTED
[19:58:04.305] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:30:0) after 9m2s
[20:07:06.322] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:30:0)
[20:07:06.338] Build status: STARTED
[20:07:06.338] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:31:0) after 3m24s
[20:10:30.308] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:31:0)
[20:10:30.401] Build status: STARTED
[20:10:30.402] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:32:0) after 2m48s
[20:13:18.414] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:32:0)
[20:13:18.429] Build status: STARTED
[20:13:18.429] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:33:0) after 6m42s
[20:20:00.478] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:33:0)
[20:20:00.496] Build status: STARTED
[20:20:00.496] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:34:0) after 4m2s
[20:24:02.511] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:34:0)
[20:24:02.565] Build status: STARTED
[20:24:02.565] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:35:0) after 4m41s
[20:28:43.579] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:35:0)
[20:28:43.595] Build status: STARTED
[20:28:43.595] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:36:0) after 8m56s
[20:37:39.614] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:36:0)
[20:37:39.641] Build status: STARTED
[20:37:39.641] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:37:0) after 2m46s
[20:40:25.653] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:37:0)
[20:40:25.669] Build status: STARTED
[20:40:25.669] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:38:0) after 1m2s
[20:41:27.684] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:38:0)
[20:41:27.719] Build status: STARTED
[20:41:27.719] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:39:0) after 2m45s
[20:44:12.831] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:39:0)
[20:44:12.856] Build status: STARTED
[20:44:12.856] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:40:0) after 9m45s
[20:53:57.874] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:40:0)
[20:53:57.891] Build status: STARTED
[20:53:57.891] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:41:0) after 8m6s
[21:02:03.976] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:41:0)
[21:02:03.998] Build status: STARTED
[21:02:03.998] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:42:0) after 5m20s
[21:07:24.013] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:42:0)
[21:07:24.027] Build status: STARTED
[21:07:24.027] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:43:0) after 1m44s
[21:09:08.480] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:43:0)
[21:09:08.499] Build status: STARTED
[21:09:08.499] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:44:0) after 4m44s
[21:13:52.500] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:44:0)
[21:13:52.520] Build status: STARTED
[21:13:52.520] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:45:0) after 2m9s
[21:16:01.637] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:45:0)
[21:16:01.658] Build status: STARTED
[21:16:01.658] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:46:0) after 4m15s
[21:20:16.858] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:46:0)
[21:20:16.885] Build status: STARTED
[21:20:16.885] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:47:0) after 6m7s
[21:26:24.150] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:47:0)
[21:26:24.166] Build status: STARTED
[21:26:24.166] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:48:0) after 3m51s
[21:30:15.181] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:48:0)
[21:30:15.214] Build status: STARTED
[21:30:15.214] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:49:0) after 1m31s
[21:31:46.365] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:49:0)
[21:31:46.386] Build status: STARTED
[21:31:46.386] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:50:0) after 9m2s
[21:40:48.636] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:50:0)
[21:40:48.652] Build status: STARTED
[21:40:48.652] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:51:0) after 8m19s
[21:49:07.841] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:51:0)
[21:49:07.859] Build status: STARTED
[21:49:07.859] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:52:0) after 1m49s
[21:50:56.996] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:52:0)
[21:50:57.040] Build status: STARTED
[21:50:57.040] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:53:0) after 7m51s
[21:58:48.055] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:53:0)
[21:58:48.072] Build status: STARTED
[21:58:48.072] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:54:0) after 6m56s
[22:05:44.089] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:54:0)
[22:05:44.108] Build status: STARTED
[22:05:44.108] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:55:0) after 5m43s
[22:11:27.331] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:55:0)
[22:11:27.429] Build status: STARTED
[22:11:27.429] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:56:0) after 3m47s
[22:15:14.446] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:56:0)
[22:15:14.475] Build status: STARTED
[22:15:14.475] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:57:0) after 6m2s
[22:21:16.498] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:57:0)
[22:21:16.514] Build status: STARTED
[22:21:16.514] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:58:0) after 4m54s
[22:26:10.554] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:58:0)
[22:26:10.572] Build status: STARTED
[22:26:10.572] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850770912526686288:59:0) after 7m28s
[22:29:34.567] Received PubSub notification, asking Buildbucket for the build status
[22:29:34.583] Build:
{
"id": "8685340850646177281",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxPGO"
},
"number": 20219,
"createdBy": "project:chromium",
"createTime": "2026-04-05T17:35:23.712007101Z",
"startTime": "2026-04-05T17:39:29.211582568Z",
"endTime": "2026-04-05T22:29:34.207359117Z",
"updateTime": "2026-04-05T22:29:34.207359117Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4e93515817dc9cd620ea409f46439da02a90ed94",
"ref": "refs/heads/main"
}
}
}
[22:29:34.583] Invocation finished in 4h54m12.047598435s with status FAILED