[01:34:52.509] New invocation is queued and will start shortly
[01:34:53.584] Starting the invocation (attempt 1)
[01:34:53.625] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/8c75e9f4324f0c87edf4c4ea617732f89b6558d7"
[01:34:53.625] Popped gitiles commit info from properties and tags
[01:34:53.625] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[01:34:53.626] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[01:34:53.626] Buildbucket request:
{
"requestId": "8916604739601754544",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWin64PGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8c75e9f4324f0c87edf4c4ea617732f89b6558d7",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8916604739601754544"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTWin64PGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[01:34:54.168] Scheduled build:
{
"id": "8751174677709827409",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWin64PGO"
},
"number": 8541,
"createdBy": "project:chromium",
"createTime": "2024-04-09T01:34:53.691859409Z",
"updateTime": "2024-04-09T01:34:53.691859409Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8c75e9f4324f0c87edf4c4ea617732f89b6558d7",
"ref": "refs/heads/main"
}
}
}
[01:34:54.168] Task URL: https://cr-buildbucket.appspot.com/build/8751174677709827409
[01:34:54.168] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:2:0) after 4m59s
[01:34:55.104] Received PubSub notification, asking Buildbucket for the build status
[01:34:55.126] Build status: SCHEDULED
[01:36:30.952] Received PubSub notification, asking Buildbucket for the build status
[01:36:30.978] Build status: STARTED
[01:39:53.194] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:2:0)
[01:39:53.223] Build status: STARTED
[01:39:53.223] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:5:0) after 7m15s
[01:47:08.346] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:5:0)
[01:47:08.369] Build status: STARTED
[01:47:08.369] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:6:0) after 9m13s
[01:56:21.519] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:6:0)
[01:56:21.536] Build status: STARTED
[01:56:21.536] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:7:0) after 8m3s
[02:04:24.776] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:7:0)
[02:04:24.820] Build status: STARTED
[02:04:24.820] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:8:0) after 1m14s
[02:05:38.808] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:8:0)
[02:05:38.832] Build status: STARTED
[02:05:38.832] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:9:0) after 6m26s
[02:12:04.870] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:9:0)
[02:12:04.885] Build status: STARTED
[02:12:04.885] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:10:0) after 1m26s
[02:13:30.958] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:10:0)
[02:13:30.982] Build status: STARTED
[02:13:30.982] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:11:0) after 9m26s
[02:22:57.018] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:11:0)
[02:22:57.039] Build status: STARTED
[02:22:57.040] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:12:0) after 1m29s
[02:24:26.066] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:12:0)
[02:24:26.087] Build status: STARTED
[02:24:26.087] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:13:0) after 6m23s
[02:30:49.635] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:13:0)
[02:30:49.770] Build status: STARTED
[02:30:49.770] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:14:0) after 4m53s
[02:35:42.834] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:14:0)
[02:35:42.895] Build status: STARTED
[02:35:42.895] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:15:0) after 5m27s
[02:41:09.924] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:15:0)
[02:41:09.946] Build status: STARTED
[02:41:09.946] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:16:0) after 8m57s
[02:50:07.073] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:16:0)
[02:50:07.093] Build status: STARTED
[02:50:07.093] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:17:0) after 7m31s
[02:57:38.126] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:17:0)
[02:57:38.157] Build status: STARTED
[02:57:38.157] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:18:0) after 6m19s
[03:03:57.189] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:18:0)
[03:03:57.211] Build status: STARTED
[03:03:57.211] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:19:0) after 7m45s
[03:11:42.370] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:19:0)
[03:11:42.395] Build status: STARTED
[03:11:42.395] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:20:0) after 6m15s
[03:17:57.442] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:20:0)
[03:17:57.469] Build status: STARTED
[03:17:57.469] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:21:0) after 4m26s
[03:22:23.604] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:21:0)
[03:22:23.626] Build status: STARTED
[03:22:23.626] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:22:0) after 5m28s
[03:27:51.615] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:22:0)
[03:27:51.636] Build status: STARTED
[03:27:51.636] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:23:0) after 2m0s
[03:29:51.711] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:23:0)
[03:29:51.732] Build status: STARTED
[03:29:51.732] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:24:0) after 4m42s
[03:34:33.857] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:24:0)
[03:34:33.875] Build status: STARTED
[03:34:33.875] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:25:0) after 7m8s
[03:41:41.903] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:25:0)
[03:41:41.921] Build status: STARTED
[03:41:41.921] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:26:0) after 7m37s
[03:49:19.105] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:26:0)
[03:49:19.123] Build status: STARTED
[03:49:19.123] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:27:0) after 9m38s
[03:58:57.251] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:27:0)
[03:58:57.330] Build status: STARTED
[03:58:57.330] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:28:0) after 3m58s
[04:02:55.356] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:28:0)
[04:02:55.414] Build status: STARTED
[04:02:55.414] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:29:0) after 8m26s
[04:11:21.725] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:29:0)
[04:11:21.838] Build status: STARTED
[04:11:21.838] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:30:0) after 6m24s
[04:17:46.094] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:30:0)
[04:17:46.119] Build status: STARTED
[04:17:46.119] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:31:0) after 4m7s
[04:21:53.238] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:31:0)
[04:21:53.255] Build status: STARTED
[04:21:53.255] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:32:0) after 6m13s
[04:28:06.257] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:32:0)
[04:28:06.537] Build status: STARTED
[04:28:06.537] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:33:0) after 8m31s
[04:36:37.567] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:33:0)
[04:36:37.595] Build status: STARTED
[04:36:37.595] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:34:0) after 4m53s
[04:41:30.697] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:34:0)
[04:41:30.718] Build status: STARTED
[04:41:30.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:35:0) after 9m19s
[04:50:49.801] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:35:0)
[04:50:49.847] Build status: STARTED
[04:50:49.847] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:36:0) after 5m36s
[04:56:25.874] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:36:0)
[04:56:25.895] Build status: STARTED
[04:56:25.895] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:37:0) after 4m20s
[05:00:45.935] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:37:0)
[05:00:45.955] Build status: STARTED
[05:00:45.956] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:38:0) after 8m48s
[05:09:34.150] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:38:0)
[05:09:34.255] Build status: STARTED
[05:09:34.255] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:39:0) after 1m58s
[05:11:32.291] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:39:0)
[05:11:32.314] Build status: STARTED
[05:11:32.314] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:40:0) after 6m21s
[05:17:53.444] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:40:0)
[05:17:53.517] Build status: STARTED
[05:17:53.517] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:41:0) after 5m23s
[05:23:16.560] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:41:0)
[05:23:16.582] Build status: STARTED
[05:23:16.582] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:42:0) after 7m17s
[05:30:33.612] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:42:0)
[05:30:33.633] Build status: STARTED
[05:30:33.633] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:43:0) after 3m17s
[05:33:50.788] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:43:0)
[05:33:50.890] Build status: STARTED
[05:33:50.890] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:44:0) after 3m25s
[05:37:15.916] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:44:0)
[05:37:15.936] Build status: STARTED
[05:37:15.936] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:45:0) after 8m24s
[05:45:40.349] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:45:0)
[05:45:40.369] Build status: STARTED
[05:45:40.369] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:46:0) after 3m46s
[05:49:26.376] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:46:0)
[05:49:26.407] Build status: STARTED
[05:49:26.407] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:47:0) after 5m41s
[05:55:07.922] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:47:0)
[05:55:07.948] Build status: STARTED
[05:55:07.948] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:48:0) after 1m2s
[05:56:10.127] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:48:0)
[05:56:10.157] Build status: STARTED
[05:56:10.157] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:49:0) after 2m38s
[05:58:48.180] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:49:0)
[05:58:48.202] Build status: STARTED
[05:58:48.202] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:50:0) after 4m30s
[06:03:18.340] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:50:0)
[06:03:18.470] Build status: STARTED
[06:03:18.470] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:51:0) after 9m10s
[06:12:28.596] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:51:0)
[06:12:28.621] Build status: STARTED
[06:12:28.621] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:52:0) after 8m9s
[06:20:37.922] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:52:0)
[06:20:37.943] Build status: STARTED
[06:20:37.943] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:53:0) after 8m55s
[06:29:32.986] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:53:0)
[06:29:33.053] Build status: STARTED
[06:29:33.053] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:54:0) after 6m1s
[06:35:34.101] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:54:0)
[06:35:34.172] Build status: STARTED
[06:35:34.172] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:55:0) after 3m13s
[06:38:47.360] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:55:0)
[06:38:47.376] Build status: STARTED
[06:38:47.376] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8916604739601754544:56:0) after 2m54s
[06:38:57.751] Received PubSub notification, asking Buildbucket for the build status
[06:38:57.770] Build:
{
"id": "8751174677709827409",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWin64PGO"
},
"number": 8541,
"createdBy": "project:chromium",
"createTime": "2024-04-09T01:34:53.691859409Z",
"startTime": "2024-04-09T01:36:25.948567899Z",
"endTime": "2024-04-09T06:38:50.141275670Z",
"updateTime": "2024-04-09T06:38:50.141275670Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8c75e9f4324f0c87edf4c4ea617732f89b6558d7",
"ref": "refs/heads/main"
}
}
}
[06:38:57.770] Invocation finished in 5h4m5.267279321s with status FAILED