[03:16:24.366] New invocation is queued and will start shortly
[03:16:25.437] Starting the invocation (attempt 1)
[03:16:25.464] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/8cb0875453bf5d53d4ba26c4a48dc907a860198c"
[03:16:25.464] Popped gitiles commit info from properties and tags
[03:16:25.464] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[03:16:25.465] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[03:16:25.465] Buildbucket request:
{
"requestId": "8833158545770923488",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWinArm64PGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8cb0875453bf5d53d4ba26c4a48dc907a860198c",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8833158545770923488"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTWinArm64PGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[03:16:26.119] Scheduled build:
{
"id": "8667728483881999233",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWinArm64PGO"
},
"number": 10050,
"createdBy": "project:chromium",
"createTime": "2026-10-17T03:16:25.546524397Z",
"updateTime": "2026-10-17T03:16:25.546524397Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8cb0875453bf5d53d4ba26c4a48dc907a860198c",
"ref": "refs/heads/main"
}
}
}
[03:16:26.119] Task URL: https://cr-buildbucket.appspot.com/build/8667728483881999233
[03:16:26.119] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:2:0) after 3m58s
[03:16:27.057] Received PubSub notification, asking Buildbucket for the build status
[03:16:27.077] Build status: SCHEDULED
[03:16:33.664] Received PubSub notification, asking Buildbucket for the build status
[03:16:33.687] Build status: STARTED
[03:20:24.174] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:2:0)
[03:20:24.192] Build status: STARTED
[03:20:24.192] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:5:0) after 2m22s
[03:22:46.200] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:5:0)
[03:22:46.219] Build status: STARTED
[03:22:46.219] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:6:0) after 4m38s
[03:27:24.362] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:6:0)
[03:27:24.389] Build status: STARTED
[03:27:24.389] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:7:0) after 8m20s
[03:35:44.412] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:7:0)
[03:35:44.484] Build status: STARTED
[03:35:44.485] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:8:0) after 6m42s
[03:43:09.211] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:8:0)
[03:43:09.225] Build status: STARTED
[03:43:09.225] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:9:0) after 5m33s
[03:48:42.282] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:9:0)
[03:48:42.304] Build status: STARTED
[03:48:42.304] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:10:0) after 7m31s
[03:56:13.326] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:10:0)
[03:56:13.353] Build status: STARTED
[03:56:13.353] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:11:0) after 3m32s
[03:59:45.365] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:11:0)
[03:59:45.385] Build status: STARTED
[03:59:45.385] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:12:0) after 1m35s
[04:01:20.388] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:12:0)
[04:01:20.418] Build status: STARTED
[04:01:20.418] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:13:0) after 2m37s
[04:03:57.436] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:13:0)
[04:03:57.459] Build status: STARTED
[04:03:57.459] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:14:0) after 9m12s
[04:13:09.480] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:14:0)
[04:13:09.507] Build status: STARTED
[04:13:09.507] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:15:0) after 9m6s
[04:22:15.547] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:15:0)
[04:22:15.566] Build status: STARTED
[04:22:15.566] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:16:0) after 6m35s
[04:28:50.582] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:16:0)
[04:28:50.645] Build status: STARTED
[04:28:50.645] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:17:0) after 2m58s
[04:31:48.667] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:17:0)
[04:31:48.690] Build status: STARTED
[04:31:48.690] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:18:0) after 2m24s
[04:34:12.809] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:18:0)
[04:34:12.846] Build status: STARTED
[04:34:12.846] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:19:0) after 3m23s
[04:37:35.852] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:19:0)
[04:37:35.868] Build status: STARTED
[04:37:35.868] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:20:0) after 2m40s
[04:40:15.884] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:20:0)
[04:40:15.904] Build status: STARTED
[04:40:15.904] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:21:0) after 1m10s
[04:41:25.923] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:21:0)
[04:41:25.965] Build status: STARTED
[04:41:25.965] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:22:0) after 8m39s
[04:50:05.007] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:22:0)
[04:50:05.150] Build status: STARTED
[04:50:05.150] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:23:0) after 4m31s
[04:54:36.172] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:23:0)
[04:54:36.215] Build status: STARTED
[04:54:36.215] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:24:0) after 7m28s
[05:02:04.246] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:24:0)
[05:02:04.265] Build status: STARTED
[05:02:04.265] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:25:0) after 6m13s
[05:08:17.279] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:25:0)
[05:08:17.306] Build status: STARTED
[05:08:17.306] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:26:0) after 1m12s
[05:09:29.338] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:26:0)
[05:09:29.385] Build status: STARTED
[05:09:29.385] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:27:0) after 3m7s
[05:12:36.452] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:27:0)
[05:12:36.473] Build status: STARTED
[05:12:36.473] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:28:0) after 6m36s
[05:19:12.480] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:28:0)
[05:19:12.506] Build status: STARTED
[05:19:12.506] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:29:0) after 1m33s
[05:20:45.537] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:29:0)
[05:20:45.563] Build status: STARTED
[05:20:45.563] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:30:0) after 6m28s
[05:27:13.585] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:30:0)
[05:27:13.613] Build status: STARTED
[05:27:13.613] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:31:0) after 7m23s
[05:34:36.631] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:31:0)
[05:34:36.794] Build status: STARTED
[05:34:36.794] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:32:0) after 3m29s
[05:38:05.809] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:32:0)
[05:38:05.826] Build status: STARTED
[05:38:05.826] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:33:0) after 6m26s
[05:44:31.852] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:33:0)
[05:44:31.867] Build status: STARTED
[05:44:31.867] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:34:0) after 6m13s
[05:50:45.000] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:34:0)
[05:50:45.100] Build status: STARTED
[05:50:45.100] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:35:0) after 1m29s
[05:52:14.129] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:35:0)
[05:52:14.160] Build status: STARTED
[05:52:14.160] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:36:0) after 2m14s
[05:54:28.179] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:36:0)
[05:54:28.197] Build status: STARTED
[05:54:28.197] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:37:0) after 5m14s
[05:59:42.309] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:37:0)
[05:59:42.345] Build status: STARTED
[05:59:42.345] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:38:0) after 6m25s
[06:06:07.379] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:38:0)
[06:06:07.399] Build status: STARTED
[06:06:07.399] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:39:0) after 3m28s
[06:09:35.413] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:39:0)
[06:09:35.455] Build status: STARTED
[06:09:35.455] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:40:0) after 2m17s
[06:11:52.526] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:40:0)
[06:11:52.566] Build status: STARTED
[06:11:52.566] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:41:0) after 4m53s
[06:16:45.640] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:41:0)
[06:16:45.662] Build status: STARTED
[06:16:45.662] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:42:0) after 8m14s
[06:24:59.674] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:42:0)
[06:24:59.689] Build status: STARTED
[06:24:59.689] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:43:0) after 2m57s
[06:27:56.714] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:43:0)
[06:27:56.735] Build status: STARTED
[06:27:56.735] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:44:0) after 5m42s
[06:33:38.769] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:44:0)
[06:33:38.785] Build status: STARTED
[06:33:38.785] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:45:0) after 4m22s
[06:38:00.868] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:45:0)
[06:38:00.897] Build status: STARTED
[06:38:00.897] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:46:0) after 2m1s
[06:40:01.915] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:46:0)
[06:40:01.932] Build status: STARTED
[06:40:01.933] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:47:0) after 4m40s
[06:44:41.953] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:47:0)
[06:44:42.020] Build status: STARTED
[06:44:42.020] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:48:0) after 2m27s
[06:47:09.035] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:48:0)
[06:47:09.057] Build status: STARTED
[06:47:09.057] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:49:0) after 7m40s
[06:54:49.289] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:49:0)
[06:54:49.317] Build status: STARTED
[06:54:49.317] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:50:0) after 1m51s
[06:56:40.602] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:50:0)
[06:56:40.620] Build status: STARTED
[06:56:40.621] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:51:0) after 3m6s
[06:59:46.670] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:51:0)
[06:59:46.695] Build status: STARTED
[06:59:46.695] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833158545770923488:52:0) after 6m8s
[07:03:37.137] Received PubSub notification, asking Buildbucket for the build status
[07:03:37.158] Build:
{
"id": "8667728483881999233",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWinArm64PGO"
},
"number": 10050,
"createdBy": "project:chromium",
"createTime": "2026-10-17T03:16:25.546524397Z",
"startTime": "2026-10-17T03:16:33.457322372Z",
"endTime": "2026-10-17T07:03:36.786511028Z",
"updateTime": "2026-10-17T07:03:36.786511028Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8cb0875453bf5d53d4ba26c4a48dc907a860198c",
"ref": "refs/heads/main"
}
}
}
[07:03:37.158] Invocation finished in 3h47m12.796732839s with status FAILED