[04:38:30.847] New invocation is queued and will start shortly
[04:38:32.772] Starting the invocation (attempt 1)
[04:38:32.798] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/abe5c579b1bb172370954c446b23f15566d5870b"
[04:38:32.798] Popped gitiles commit info from properties and tags
[04:38:32.798] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[04:38:32.799] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[04:38:32.799] Buildbucket request:
{
"requestId": "8847377103704832032",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWin64PGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "abe5c579b1bb172370954c446b23f15566d5870b",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8847377103704832032"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTWin64PGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[04:38:33.495] Scheduled build:
{
"id": "8681947040944996881",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWin64PGO"
},
"number": 14263,
"createdBy": "project:chromium",
"createTime": "2026-05-13T04:38:32.859769391Z",
"updateTime": "2026-05-13T04:38:32.859769391Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "abe5c579b1bb172370954c446b23f15566d5870b",
"ref": "refs/heads/main"
}
}
}
[04:38:33.495] Task URL: https://cr-buildbucket.appspot.com/build/8681947040944996881
[04:38:33.495] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:2:0) after 9m39s
[04:38:34.290] Received PubSub notification, asking Buildbucket for the build status
[04:38:34.308] Build status: SCHEDULED
[04:40:17.486] Received PubSub notification, asking Buildbucket for the build status
[04:40:17.515] Build status: STARTED
[04:48:12.578] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:2:0)
[04:48:12.600] Build status: STARTED
[04:48:12.600] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:5:0) after 3m24s
[04:51:36.621] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:5:0)
[04:51:36.639] Build status: STARTED
[04:51:36.639] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:6:0) after 2m55s
[04:54:31.628] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:6:0)
[04:54:31.645] Build status: STARTED
[04:54:31.645] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:7:0) after 4m52s
[04:59:23.796] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:7:0)
[04:59:23.812] Build status: STARTED
[04:59:23.812] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:8:0) after 3m49s
[05:03:12.846] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:8:0)
[05:03:12.868] Build status: STARTED
[05:03:12.868] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:9:0) after 2m30s
[05:05:42.938] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:9:0)
[05:05:42.954] Build status: STARTED
[05:05:42.954] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:10:0) after 5m8s
[05:10:50.978] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:10:0)
[05:10:51.044] Build status: STARTED
[05:10:51.044] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:11:0) after 6m58s
[05:17:49.107] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:11:0)
[05:17:49.132] Build status: STARTED
[05:17:49.132] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:12:0) after 3m34s
[05:21:23.125] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:12:0)
[05:21:23.142] Build status: STARTED
[05:21:23.142] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:13:0) after 1m5s
[05:22:28.161] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:13:0)
[05:22:28.177] Build status: STARTED
[05:22:28.177] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:14:0) after 5m47s
[05:28:15.236] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:14:0)
[05:28:15.267] Build status: STARTED
[05:28:15.267] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:15:0) after 9m57s
[05:38:12.350] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:15:0)
[05:38:12.365] Build status: STARTED
[05:38:12.365] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:16:0) after 2m22s
[05:40:34.400] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:16:0)
[05:40:34.424] Build status: STARTED
[05:40:34.424] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:17:0) after 1m45s
[05:42:19.459] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:17:0)
[05:42:19.475] Build status: STARTED
[05:42:19.475] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:18:0) after 3m54s
[05:46:13.496] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:18:0)
[05:46:13.611] Build status: STARTED
[05:46:13.611] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:19:0) after 6m53s
[05:53:06.724] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:19:0)
[05:53:06.743] Build status: STARTED
[05:53:06.743] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:20:0) after 4m17s
[05:57:23.809] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:20:0)
[05:57:23.828] Build status: STARTED
[05:57:23.828] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:21:0) after 8m37s
[06:06:00.886] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:21:0)
[06:06:00.909] Build status: STARTED
[06:06:00.909] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:22:0) after 8m43s
[06:14:43.933] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:22:0)
[06:14:43.959] Build status: STARTED
[06:14:43.959] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:23:0) after 4m48s
[06:19:32.032] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:23:0)
[06:19:32.051] Build status: STARTED
[06:19:32.051] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:24:0) after 4m26s
[06:23:58.096] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:24:0)
[06:23:58.114] Build status: STARTED
[06:23:58.115] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:25:0) after 3m40s
[06:27:38.146] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:25:0)
[06:27:38.187] Build status: STARTED
[06:27:38.187] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:26:0) after 9m39s
[06:37:17.260] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:26:0)
[06:37:17.280] Build status: STARTED
[06:37:17.280] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:27:0) after 8m44s
[06:46:01.347] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:27:0)
[06:46:01.367] Build status: STARTED
[06:46:01.368] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:28:0) after 5m25s
[06:51:26.387] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:28:0)
[06:51:26.403] Build status: STARTED
[06:51:26.403] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:29:0) after 1m29s
[06:52:55.425] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:29:0)
[06:52:55.446] Build status: STARTED
[06:52:55.446] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:30:0) after 2m53s
[06:55:48.467] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:30:0)
[06:55:48.486] Build status: STARTED
[06:55:48.486] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:31:0) after 6m34s
[07:02:22.523] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:31:0)
[07:02:22.575] Build status: STARTED
[07:02:22.575] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:32:0) after 9m24s
[07:11:46.598] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:32:0)
[07:11:46.675] Build status: STARTED
[07:11:46.675] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:33:0) after 6m30s
[07:18:16.695] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:33:0)
[07:18:16.712] Build status: STARTED
[07:18:16.712] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:34:0) after 8m27s
[07:26:43.753] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:34:0)
[07:26:43.781] Build status: STARTED
[07:26:43.781] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:35:0) after 4m33s
[07:31:16.803] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:35:0)
[07:31:16.827] Build status: STARTED
[07:31:16.827] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:36:0) after 2m36s
[07:33:52.850] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:36:0)
[07:33:52.870] Build status: STARTED
[07:33:52.870] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:37:0) after 2m30s
[07:36:22.988] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:37:0)
[07:36:23.004] Build status: STARTED
[07:36:23.004] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:38:0) after 8m36s
[07:44:59.201] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:38:0)
[07:44:59.224] Build status: STARTED
[07:44:59.224] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:39:0) after 8m58s
[07:53:57.243] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:39:0)
[07:53:57.258] Build status: STARTED
[07:53:57.258] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:40:0) after 3m14s
[07:57:11.288] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:40:0)
[07:57:11.309] Build status: STARTED
[07:57:11.309] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:41:0) after 6m14s
[08:03:25.337] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:41:0)
[08:03:25.354] Build status: STARTED
[08:03:25.354] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:42:0) after 5m29s
[08:08:54.375] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:42:0)
[08:08:54.399] Build status: STARTED
[08:08:54.399] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:43:0) after 2m41s
[08:11:35.467] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:43:0)
[08:11:35.486] Build status: STARTED
[08:11:35.486] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:44:0) after 7m43s
[08:19:18.503] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:44:0)
[08:19:18.563] Build status: STARTED
[08:19:18.563] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:45:0) after 9m10s
[08:28:28.566] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:45:0)
[08:28:28.585] Build status: STARTED
[08:28:28.586] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:46:0) after 3m18s
[08:31:46.606] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:46:0)
[08:31:46.635] Build status: STARTED
[08:31:46.635] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:47:0) after 2m56s
[08:34:42.655] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:47:0)
[08:34:42.682] Build status: STARTED
[08:34:42.682] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:48:0) after 3m25s
[08:38:07.707] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:48:0)
[08:38:07.728] Build status: STARTED
[08:38:07.728] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:49:0) after 5m35s
[08:43:42.853] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:49:0)
[08:43:42.896] Build status: STARTED
[08:43:42.896] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:50:0) after 5m45s
[08:49:28.059] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:50:0)
[08:49:28.075] Build status: STARTED
[08:49:28.075] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:51:0) after 8m27s
[08:57:55.176] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:51:0)
[08:57:55.197] Build status: STARTED
[08:57:55.197] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:52:0) after 3m36s
[09:01:31.257] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:52:0)
[09:01:31.283] Build status: STARTED
[09:01:31.283] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:53:0) after 2m8s
[09:03:39.304] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:53:0)
[09:03:39.326] Build status: STARTED
[09:03:39.326] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:54:0) after 1m36s
[09:05:15.358] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:54:0)
[09:05:15.444] Build status: STARTED
[09:05:15.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:55:0) after 8m15s
[09:13:30.481] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:55:0)
[09:13:30.504] Build status: STARTED
[09:13:30.504] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8847377103704832032:56:0) after 6m29s
[09:13:39.045] Received PubSub notification, asking Buildbucket for the build status
[09:13:39.065] Build:
{
"id": "8681947040944996881",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWin64PGO"
},
"number": 14263,
"createdBy": "project:chromium",
"createTime": "2026-05-13T04:38:32.859769391Z",
"startTime": "2026-05-13T04:40:16.484254717Z",
"endTime": "2026-05-13T09:13:38.775355889Z",
"updateTime": "2026-05-13T09:13:38.775355889Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "abe5c579b1bb172370954c446b23f15566d5870b",
"ref": "refs/heads/main"
}
}
}
[09:13:39.065] Invocation finished in 4h35m8.222752659s with status FAILED