[04:35:26.572] New invocation is queued and will start shortly
[04:35:27.639] Starting the invocation (attempt 1)
[04:35:27.666] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/65802435e6f0b410c9406b164e6460bbed6d53d1"
[04:35:27.666] Popped gitiles commit info from properties and tags
[04:35:27.666] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[04:35:27.667] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[04:35:27.667] Buildbucket request:
{
"requestId": "8833244170172880800",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWinArm64PGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "65802435e6f0b410c9406b164e6460bbed6d53d1",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8833244170172880800"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTWinArm64PGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[04:35:28.225] Scheduled build:
{
"id": "8667814108290863873",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWinArm64PGO"
},
"number": 10044,
"createdBy": "project:chromium",
"createTime": "2026-10-16T04:35:27.747982917Z",
"updateTime": "2026-10-16T04:35:27.747982917Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "65802435e6f0b410c9406b164e6460bbed6d53d1",
"ref": "refs/heads/main"
}
}
}
[04:35:28.225] Task URL: https://cr-buildbucket.appspot.com/build/8667814108290863873
[04:35:28.225] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:2:0) after 4m53s
[04:35:28.776] Received PubSub notification, asking Buildbucket for the build status
[04:35:28.800] Build status: SCHEDULED
[04:35:37.380] Received PubSub notification, asking Buildbucket for the build status
[04:35:37.410] Build status: STARTED
[04:40:21.324] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:2:0)
[04:40:21.345] Build status: STARTED
[04:40:21.345] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:5:0) after 2m24s
[04:42:45.383] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:5:0)
[04:42:45.409] Build status: STARTED
[04:42:45.409] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:6:0) after 5m59s
[04:48:44.629] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:6:0)
[04:48:44.704] Build status: STARTED
[04:48:44.704] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:7:0) after 3m34s
[04:52:18.719] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:7:0)
[04:52:18.741] Build status: STARTED
[04:52:18.741] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:8:0) after 2m49s
[04:55:07.806] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:8:0)
[04:55:07.831] Build status: STARTED
[04:55:07.831] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:9:0) after 4m14s
[04:59:21.853] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:9:0)
[04:59:21.874] Build status: STARTED
[04:59:21.874] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:10:0) after 4m17s
[05:03:38.922] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:10:0)
[05:03:38.939] Build status: STARTED
[05:03:38.939] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:11:0) after 3m32s
[05:07:10.967] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:11:0)
[05:07:10.990] Build status: STARTED
[05:07:10.990] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:12:0) after 4m29s
[05:11:40.132] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:12:0)
[05:11:40.164] Build status: STARTED
[05:11:40.164] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:13:0) after 8m1s
[05:19:41.185] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:13:0)
[05:19:41.251] Build status: STARTED
[05:19:41.251] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:14:0) after 4m48s
[05:24:29.349] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:14:0)
[05:24:29.366] Build status: STARTED
[05:24:29.366] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:15:0) after 7m46s
[05:32:15.444] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:15:0)
[05:32:15.473] Build status: STARTED
[05:32:15.473] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:16:0) after 9m39s
[05:41:54.546] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:16:0)
[05:41:54.572] Build status: STARTED
[05:41:54.572] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:17:0) after 4m24s
[05:46:18.590] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:17:0)
[05:46:18.608] Build status: STARTED
[05:46:18.608] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:18:0) after 1m29s
[05:47:47.630] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:18:0)
[05:47:47.650] Build status: STARTED
[05:47:47.650] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:19:0) after 7m44s
[05:55:31.728] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:19:0)
[05:55:31.747] Build status: STARTED
[05:55:31.748] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:20:0) after 3m0s
[05:58:31.984] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:20:0)
[05:58:32.001] Build status: STARTED
[05:58:32.001] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:21:0) after 4m28s
[06:03:00.090] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:21:0)
[06:03:00.109] Build status: STARTED
[06:03:00.109] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:22:0) after 4m24s
[06:07:24.104] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:22:0)
[06:07:24.122] Build status: STARTED
[06:07:24.122] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:23:0) after 7m50s
[06:15:14.150] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:23:0)
[06:15:14.175] Build status: STARTED
[06:15:14.175] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:24:0) after 8m7s
[06:23:21.155] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:24:0)
[06:23:21.186] Build status: STARTED
[06:23:21.186] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:25:0) after 7m59s
[06:31:20.177] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:25:0)
[06:31:20.205] Build status: STARTED
[06:31:20.206] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:26:0) after 7m21s
[06:38:41.327] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:26:0)
[06:38:41.350] Build status: STARTED
[06:38:41.351] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:27:0) after 4m25s
[06:43:06.411] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:27:0)
[06:43:06.432] Build status: STARTED
[06:43:06.432] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:28:0) after 9m39s
[06:52:45.460] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:28:0)
[06:52:45.477] Build status: STARTED
[06:52:45.477] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:29:0) after 1m36s
[06:54:21.561] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:29:0)
[06:54:21.577] Build status: STARTED
[06:54:21.577] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:30:0) after 8m56s
[07:03:17.626] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:30:0)
[07:03:17.661] Build status: STARTED
[07:03:17.661] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:31:0) after 2m14s
[07:05:31.685] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:31:0)
[07:05:31.707] Build status: STARTED
[07:05:31.707] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:32:0) after 6m39s
[07:12:10.743] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:32:0)
[07:12:10.764] Build status: STARTED
[07:12:10.764] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:33:0) after 2m24s
[07:14:34.786] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:33:0)
[07:14:35.052] Build status: STARTED
[07:14:35.052] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:34:0) after 3m6s
[07:17:41.071] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:34:0)
[07:17:41.087] Build status: STARTED
[07:17:41.087] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:35:0) after 8m32s
[07:26:13.177] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:35:0)
[07:26:13.227] Build status: STARTED
[07:26:13.227] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:36:0) after 8m38s
[07:34:51.370] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:36:0)
[07:34:51.420] Build status: STARTED
[07:34:51.420] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:37:0) after 9m23s
[07:44:14.441] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:37:0)
[07:44:14.466] Build status: STARTED
[07:44:14.466] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:38:0) after 2m36s
[07:46:50.664] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:38:0)
[07:46:50.686] Build status: STARTED
[07:46:50.686] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:39:0) after 2m32s
[07:49:22.704] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:39:0)
[07:49:22.724] Build status: STARTED
[07:49:22.724] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:40:0) after 4m9s
[07:53:31.759] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:40:0)
[07:53:31.793] Build status: STARTED
[07:53:31.793] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:41:0) after 7m23s
[08:00:54.860] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:41:0)
[08:00:54.881] Build status: STARTED
[08:00:54.881] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:42:0) after 6m14s
[08:07:08.863] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:42:0)
[08:07:08.888] Build status: STARTED
[08:07:08.888] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:43:0) after 9m36s
[08:16:44.908] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:43:0)
[08:16:44.928] Build status: STARTED
[08:16:44.928] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:44:0) after 3m42s
[08:20:26.957] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:44:0)
[08:20:26.975] Build status: STARTED
[08:20:26.975] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833244170172880800:45:0) after 3m18s
[08:20:56.452] Received PubSub notification, asking Buildbucket for the build status
[08:20:56.469] Build:
{
"id": "8667814108290863873",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWinArm64PGO"
},
"number": 10044,
"createdBy": "project:chromium",
"createTime": "2026-10-16T04:35:27.747982917Z",
"startTime": "2026-10-16T04:35:36.423482157Z",
"endTime": "2026-10-16T08:20:55.911627585Z",
"updateTime": "2026-10-16T08:20:55.911627585Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "65802435e6f0b410c9406b164e6460bbed6d53d1",
"ref": "refs/heads/main"
}
}
}
[08:20:56.469] Invocation finished in 3h45m29.900438145s with status FAILED