[09:19:43.126] New invocation is queued and will start shortly
[09:19:46.003] Starting the invocation (attempt 1)
[09:19:46.029] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/8c5a4bd3e426561e75b35de539f402f29de07268"
[09:19:46.029] Popped gitiles commit info from properties and tags
[09:19:46.029] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[09:19:46.031] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[09:19:46.031] Buildbucket request:
{
"requestId": "8877890589524531296",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWinArm64PGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8c5a4bd3e426561e75b35de539f402f29de07268",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8877890589524531296"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTWinArm64PGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[09:19:46.546] Scheduled build:
{
"id": "8712460525757788641",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWinArm64PGO"
},
"number": 5829,
"createdBy": "project:chromium",
"createTime": "2025-06-10T09:19:46.089077714Z",
"updateTime": "2025-06-10T09:19:46.089077714Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8c5a4bd3e426561e75b35de539f402f29de07268",
"ref": "refs/heads/main"
}
}
}
[09:19:46.546] Task URL: https://cr-buildbucket.appspot.com/build/8712460525757788641
[09:19:46.546] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:2:0) after 3m50s
[09:19:46.636] Received PubSub notification, asking Buildbucket for the build status
[09:19:46.663] Build status: SCHEDULED
[09:23:36.646] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:2:0)
[09:23:36.678] Build status: SCHEDULED
[09:23:36.678] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:4:0) after 4m45s
[09:28:21.699] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:4:0)
[09:28:21.755] Build status: SCHEDULED
[09:28:21.755] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:5:0) after 8m21s
[09:36:42.789] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:5:0)
[09:36:42.810] Build status: SCHEDULED
[09:36:42.810] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:6:0) after 8m33s
[09:45:15.837] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:6:0)
[09:45:15.859] Build status: SCHEDULED
[09:45:15.859] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:7:0) after 5m54s
[09:51:09.965] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:7:0)
[09:51:09.991] Build status: SCHEDULED
[09:51:09.991] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:8:0) after 3m49s
[09:54:59.015] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:8:0)
[09:54:59.037] Build status: SCHEDULED
[09:54:59.037] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:9:0) after 4m23s
[09:59:22.114] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:9:0)
[09:59:22.147] Build status: SCHEDULED
[09:59:22.147] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:10:0) after 4m49s
[10:03:30.008] Received PubSub notification, asking Buildbucket for the build status
[10:03:30.029] Build status: STARTED
[10:04:11.146] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:10:0)
[10:04:11.177] Build status: STARTED
[10:04:11.177] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:12:0) after 3m39s
[10:07:50.202] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:12:0)
[10:07:50.263] Build status: STARTED
[10:07:50.263] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:13:0) after 7m23s
[10:15:13.361] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:13:0)
[10:15:13.389] Build status: STARTED
[10:15:13.389] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:14:0) after 1m9s
[10:16:22.417] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:14:0)
[10:16:22.441] Build status: STARTED
[10:16:22.441] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:15:0) after 8m23s
[10:24:45.470] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:15:0)
[10:24:45.490] Build status: STARTED
[10:24:45.490] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:16:0) after 6m3s
[10:30:48.533] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:16:0)
[10:30:48.552] Build status: STARTED
[10:30:48.552] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:17:0) after 1m39s
[10:32:27.614] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:17:0)
[10:32:27.675] Build status: STARTED
[10:32:27.675] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:18:0) after 5m4s
[10:37:31.696] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:18:0)
[10:37:31.720] Build status: STARTED
[10:37:31.720] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:19:0) after 6m7s
[10:43:38.748] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:19:0)
[10:43:38.771] Build status: STARTED
[10:43:38.771] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:20:0) after 5m8s
[10:48:46.760] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:20:0)
[10:48:46.788] Build status: STARTED
[10:48:46.788] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:21:0) after 9m43s
[10:58:29.821] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:21:0)
[10:58:29.836] Build status: STARTED
[10:58:29.836] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:22:0) after 7m46s
[11:06:15.858] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:22:0)
[11:06:15.877] Build status: STARTED
[11:06:15.877] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:23:0) after 7m19s
[11:13:34.897] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:23:0)
[11:13:34.921] Build status: STARTED
[11:13:34.921] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:24:0) after 4m8s
[11:17:43.027] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:24:0)
[11:17:43.049] Build status: STARTED
[11:17:43.049] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:25:0) after 6m24s
[11:24:07.035] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:25:0)
[11:24:07.053] Build status: STARTED
[11:24:07.053] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:26:0) after 1m11s
[11:25:18.083] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:26:0)
[11:25:18.105] Build status: STARTED
[11:25:18.105] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:27:0) after 8m54s
[11:34:13.481] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:27:0)
[11:34:13.677] Build status: STARTED
[11:34:13.677] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:28:0) after 3m7s
[11:37:20.709] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:28:0)
[11:37:20.745] Build status: STARTED
[11:37:20.745] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:29:0) after 9m1s
[11:46:21.873] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:29:0)
[11:46:21.889] Build status: STARTED
[11:46:21.889] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:30:0) after 8m58s
[11:55:19.897] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:30:0)
[11:55:19.928] Build status: STARTED
[11:55:19.928] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:31:0) after 3m45s
[11:59:04.951] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:31:0)
[11:59:04.974] Build status: STARTED
[11:59:04.974] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:32:0) after 3m28s
[12:02:33.050] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:32:0)
[12:02:33.066] Build status: STARTED
[12:02:33.066] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:33:0) after 4m59s
[12:07:32.141] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:33:0)
[12:07:32.158] Build status: STARTED
[12:07:32.158] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:34:0) after 4m21s
[12:11:53.245] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:34:0)
[12:11:53.263] Build status: STARTED
[12:11:53.263] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:35:0) after 9m23s
[12:21:16.338] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:35:0)
[12:21:16.359] Build status: STARTED
[12:21:16.359] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:36:0) after 4m10s
[12:25:26.385] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:36:0)
[12:25:26.403] Build status: STARTED
[12:25:26.403] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:37:0) after 6m2s
[12:31:28.612] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:37:0)
[12:31:28.630] Build status: STARTED
[12:31:28.630] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:38:0) after 5m46s
[12:37:14.661] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:38:0)
[12:37:14.740] Build status: STARTED
[12:37:14.740] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:39:0) after 9m12s
[12:46:26.773] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:39:0)
[12:46:26.841] Build status: STARTED
[12:46:26.841] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:40:0) after 7m25s
[12:53:51.911] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:40:0)
[12:53:51.932] Build status: STARTED
[12:53:51.932] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:41:0) after 1m25s
[12:55:16.984] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:41:0)
[12:55:17.000] Build status: STARTED
[12:55:17.000] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:42:0) after 1m55s
[12:57:12.081] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:42:0)
[12:57:12.100] Build status: STARTED
[12:57:12.100] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:43:0) after 1m57s
[12:59:09.130] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:43:0)
[12:59:09.149] Build status: STARTED
[12:59:09.149] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:44:0) after 1m8s
[13:00:17.170] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:44:0)
[13:00:17.190] Build status: STARTED
[13:00:17.190] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:45:0) after 1m11s
[13:01:28.219] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:45:0)
[13:01:28.292] Build status: STARTED
[13:01:28.292] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:46:0) after 1m18s
[13:02:46.387] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:46:0)
[13:02:46.414] Build status: STARTED
[13:02:46.414] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:47:0) after 1m47s
[13:04:33.433] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:47:0)
[13:04:33.462] Build status: STARTED
[13:04:33.462] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:48:0) after 3m8s
[13:07:41.491] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:48:0)
[13:07:41.507] Build status: STARTED
[13:07:41.507] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:49:0) after 4m54s
[13:12:35.595] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:49:0)
[13:12:35.612] Build status: STARTED
[13:12:35.612] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:50:0) after 6m53s
[13:19:28.631] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:50:0)
[13:19:28.653] Build status: STARTED
[13:19:28.653] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:51:0) after 2m14s
[13:21:42.638] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:51:0)
[13:21:42.664] Build status: STARTED
[13:21:42.664] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:52:0) after 4m57s
[13:26:39.742] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:52:0)
[13:26:39.761] Build status: STARTED
[13:26:39.761] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:53:0) after 6m57s
[13:33:36.785] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:53:0)
[13:33:36.799] Build status: STARTED
[13:33:36.799] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:54:0) after 3m51s
[13:37:27.872] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:54:0)
[13:37:27.891] Build status: STARTED
[13:37:27.892] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:55:0) after 6m13s
[13:43:40.873] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:55:0)
[13:43:40.893] Build status: STARTED
[13:43:40.893] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:56:0) after 2m36s
[13:46:16.917] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:56:0)
[13:46:16.935] Build status: STARTED
[13:46:16.935] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:57:0) after 3m59s
[13:50:15.965] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:57:0)
[13:50:15.984] Build status: STARTED
[13:50:15.984] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:58:0) after 1m56s
[13:52:11.955] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:58:0)
[13:52:11.972] Build status: STARTED
[13:52:11.972] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:59:0) after 7m54s
[14:00:05.974] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:59:0)
[14:00:06.087] Build status: STARTED
[14:00:06.087] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:60:0) after 4m11s
[14:04:17.115] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:60:0)
[14:04:17.136] Build status: STARTED
[14:04:17.136] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:61:0) after 4m35s
[14:08:52.167] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:61:0)
[14:08:52.191] Build status: STARTED
[14:08:52.191] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:62:0) after 6m2s
[14:14:54.264] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:62:0)
[14:14:54.288] Build status: STARTED
[14:14:54.288] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:63:0) after 1m13s
[14:16:07.308] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:63:0)
[14:16:07.338] Build status: STARTED
[14:16:07.338] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:64:0) after 8m21s
[14:24:28.369] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:64:0)
[14:24:28.414] Build status: STARTED
[14:24:28.414] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:65:0) after 3m21s
[14:27:49.407] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:65:0)
[14:27:49.424] Build status: STARTED
[14:27:49.424] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8877890589524531296:66:0) after 5m41s
[14:28:36.960] Received PubSub notification, asking Buildbucket for the build status
[14:28:36.978] Build:
{
"id": "8712460525757788641",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWinArm64PGO"
},
"number": 5829,
"createdBy": "project:chromium",
"createTime": "2025-06-10T09:19:46.089077714Z",
"startTime": "2025-06-10T10:03:29.823684641Z",
"endTime": "2025-06-10T14:28:36.708833118Z",
"updateTime": "2025-06-10T14:28:36.708833118Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8c5a4bd3e426561e75b35de539f402f29de07268",
"ref": "refs/heads/main"
}
}
}
[14:28:36.978] Invocation finished in 5h8m53.864185361s with status FAILED