[17:38:56.746] New invocation is queued and will start shortly
[17:38:57.825] Starting the invocation (attempt 1)
[17:38:57.851] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/2897471542516c3b13d5fe3d70814a5d353d6feb"
[17:38:57.851] Popped gitiles commit info from properties and tags
[17:38:57.851] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[17:38:57.853] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[17:38:57.853] Buildbucket request:
{
"requestId": "8833285473399878192",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWinArm64PGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2897471542516c3b13d5fe3d70814a5d353d6feb",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8833285473399878192"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTWinArm64PGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[17:38:58.481] Scheduled build:
{
"id": "8667855411454884385",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWinArm64PGO"
},
"number": 10041,
"createdBy": "project:chromium",
"createTime": "2026-10-15T17:38:57.980674761Z",
"updateTime": "2026-10-15T17:38:57.980674761Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2897471542516c3b13d5fe3d70814a5d353d6feb",
"ref": "refs/heads/main"
}
}
}
[17:38:58.481] Task URL: https://cr-buildbucket.appspot.com/build/8667855411454884385
[17:38:58.481] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833285473399878192:2:0) after 2m17s
[17:38:59.425] Received PubSub notification, asking Buildbucket for the build status
[17:38:59.448] Build status: SCHEDULED
[17:39:05.198] Received PubSub notification, asking Buildbucket for the build status
[17:39:05.245] Build status: STARTED
[17:41:15.598] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833285473399878192:2:0)
[17:41:15.622] Build status: STARTED
[17:41:15.622] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833285473399878192:5:0) after 1m54s
[17:43:09.896] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833285473399878192:5:0)
[17:43:09.915] Build status: STARTED
[17:43:09.915] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833285473399878192:6:0) after 6m53s
[17:50:02.932] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833285473399878192:6:0)
[17:50:02.959] Build status: STARTED
[17:50:02.960] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833285473399878192:7:0) after 6m52s
[17:56:54.980] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833285473399878192:7:0)
[17:56:54.997] Build status: STARTED
[17:56:54.997] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833285473399878192:8:0) after 8m17s
[18:05:12.174] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833285473399878192:8:0)
[18:05:12.195] Build status: STARTED
[18:05:12.195] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833285473399878192:9:0) after 7m38s
[18:12:50.445] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833285473399878192:9:0)
[18:12:50.466] Build status: STARTED
[18:12:50.466] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833285473399878192:10:0) after 3m49s
[18:16:39.537] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833285473399878192:10:0)
[18:16:39.558] Build status: STARTED
[18:16:39.558] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833285473399878192:11:0) after 7m27s
[18:24:06.658] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833285473399878192:11:0)
[18:24:06.713] Build status: STARTED
[18:24:06.713] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833285473399878192:12:0) after 6m12s
[18:30:18.822] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833285473399878192:12:0)
[18:30:18.853] Build status: STARTED
[18:30:18.853] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833285473399878192:13:0) after 9m57s
[18:40:15.946] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833285473399878192:13:0)
[18:40:15.966] Build status: STARTED
[18:40:15.967] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833285473399878192:14:0) after 7m46s
[18:48:02.028] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833285473399878192:14:0)
[18:48:02.048] Build status: STARTED
[18:48:02.048] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833285473399878192:15:0) after 9m18s
[18:57:20.256] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833285473399878192:15:0)
[18:57:20.279] Build status: STARTED
[18:57:20.279] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833285473399878192:16:0) after 6m24s
[19:03:44.320] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833285473399878192:16:0)
[19:03:44.402] Build status: STARTED
[19:03:44.403] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833285473399878192:17:0) after 9m14s
[19:12:58.582] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833285473399878192:17:0)
[19:12:58.641] Build status: STARTED
[19:12:58.641] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833285473399878192:18:0) after 2m38s
[19:15:36.668] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833285473399878192:18:0)
[19:15:36.697] Build status: STARTED
[19:15:36.697] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833285473399878192:19:0) after 6m41s
[19:22:17.902] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833285473399878192:19:0)
[19:22:17.926] Build status: STARTED
[19:22:17.926] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833285473399878192:20:0) after 2m53s
[19:25:11.074] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833285473399878192:20:0)
[19:25:11.189] Build status: STARTED
[19:25:11.189] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833285473399878192:21:0) after 9m51s
[19:35:02.238] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833285473399878192:21:0)
[19:35:02.273] Build status: STARTED
[19:35:02.273] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833285473399878192:22:0) after 4m27s
[19:39:29.551] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833285473399878192:22:0)
[19:39:29.575] Build status: STARTED
[19:39:29.575] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833285473399878192:23:0) after 6m24s
[19:45:53.654] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833285473399878192:23:0)
[19:45:53.675] Build status: STARTED
[19:45:53.675] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833285473399878192:24:0) after 8m3s
[19:53:56.699] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833285473399878192:24:0)
[19:53:56.720] Build status: STARTED
[19:53:56.720] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833285473399878192:25:0) after 5m48s
[19:59:44.851] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833285473399878192:25:0)
[19:59:44.879] Build status: STARTED
[19:59:44.880] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833285473399878192:26:0) after 5m47s
[20:05:31.952] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833285473399878192:26:0)
[20:05:31.970] Build status: STARTED
[20:05:31.970] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833285473399878192:27:0) after 4m31s
[20:10:02.976] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833285473399878192:27:0)
[20:10:02.998] Build status: STARTED
[20:10:02.998] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833285473399878192:28:0) after 5m51s
[20:15:54.023] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833285473399878192:28:0)
[20:15:54.057] Build status: STARTED
[20:15:54.057] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833285473399878192:29:0) after 7m50s
[20:23:44.107] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833285473399878192:29:0)
[20:23:44.151] Build status: STARTED
[20:23:44.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833285473399878192:30:0) after 9m54s
[20:33:38.176] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833285473399878192:30:0)
[20:33:38.193] Build status: STARTED
[20:33:38.193] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833285473399878192:31:0) after 2m28s
[20:36:06.216] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833285473399878192:31:0)
[20:36:06.233] Build status: STARTED
[20:36:06.233] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833285473399878192:32:0) after 4m32s
[20:40:38.542] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833285473399878192:32:0)
[20:40:38.568] Build status: STARTED
[20:40:38.568] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833285473399878192:33:0) after 4m2s
[20:44:40.681] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833285473399878192:33:0)
[20:44:40.709] Build status: STARTED
[20:44:40.709] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833285473399878192:34:0) after 2m29s
[20:47:09.724] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833285473399878192:34:0)
[20:47:09.776] Build status: STARTED
[20:47:09.776] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833285473399878192:35:0) after 7m37s
[20:54:46.858] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833285473399878192:35:0)
[20:54:46.877] Build status: STARTED
[20:54:46.877] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833285473399878192:36:0) after 1m49s
[20:56:36.012] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833285473399878192:36:0)
[20:56:36.042] Build status: STARTED
[20:56:36.042] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833285473399878192:37:0) after 1m20s
[20:57:56.151] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833285473399878192:37:0)
[20:57:56.229] Build status: STARTED
[20:57:56.229] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833285473399878192:38:0) after 9m54s
[21:07:50.270] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833285473399878192:38:0)
[21:07:50.294] Build status: STARTED
[21:07:50.294] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833285473399878192:39:0) after 8m4s
[21:14:59.014] Received PubSub notification, asking Buildbucket for the build status
[21:14:59.034] Build:
{
"id": "8667855411454884385",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWinArm64PGO"
},
"number": 10041,
"createdBy": "project:chromium",
"createTime": "2026-10-15T17:38:57.980674761Z",
"startTime": "2026-10-15T17:39:05.023248354Z",
"endTime": "2026-10-15T21:14:58.436794602Z",
"updateTime": "2026-10-15T21:14:58.436794602Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2897471542516c3b13d5fe3d70814a5d353d6feb",
"ref": "refs/heads/main"
}
}
}
[21:14:59.034] Invocation finished in 3h36m2.292761614s with status FAILED