[08:37:22.203] New invocation is queued and will start shortly
[08:37:23.347] Starting the invocation (attempt 1)
[08:37:23.383] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/fb5989ef1f68c15d199981af4c779761f07dd680"
[08:37:23.383] Popped gitiles commit info from properties and tags
[08:37:23.383] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[08:37:23.384] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[08:37:23.384] Buildbucket request:
{
"requestId": "8867474602744843136",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWinArm64PGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fb5989ef1f68c15d199981af4c779761f07dd680",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8867474602744843136"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTWinArm64PGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[08:37:23.922] Scheduled build:
{
"id": "8702044540772538257",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWinArm64PGO"
},
"number": 6265,
"createdBy": "project:chromium",
"createTime": "2025-10-03T08:37:23.450989445Z",
"updateTime": "2025-10-03T08:37:23.450989445Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fb5989ef1f68c15d199981af4c779761f07dd680",
"ref": "refs/heads/main"
}
}
}
[08:37:23.922] Task URL: https://cr-buildbucket.appspot.com/build/8702044540772538257
[08:37:23.922] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:2:0) after 6m4s
[08:37:24.846] Received PubSub notification, asking Buildbucket for the build status
[08:37:24.858] Build status: SCHEDULED
[08:43:28.049] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:2:0)
[08:43:28.064] Build status: SCHEDULED
[08:43:28.064] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:4:0) after 2m42s
[08:46:10.169] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:4:0)
[08:46:10.187] Build status: SCHEDULED
[08:46:10.187] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:5:0) after 4m3s
[08:50:13.228] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:5:0)
[08:50:13.244] Build status: SCHEDULED
[08:50:13.244] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:6:0) after 7m43s
[08:57:56.269] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:6:0)
[08:57:56.424] Build status: SCHEDULED
[08:57:56.424] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:7:0) after 3m50s
[09:01:46.454] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:7:0)
[09:01:46.479] Build status: SCHEDULED
[09:01:46.479] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:8:0) after 4m49s
[09:06:35.513] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:8:0)
[09:06:35.563] Build status: SCHEDULED
[09:06:35.564] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:9:0) after 2m17s
[09:08:52.637] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:9:0)
[09:08:52.746] Build status: SCHEDULED
[09:08:52.746] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:10:0) after 8m50s
[09:17:42.779] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:10:0)
[09:17:42.794] Build status: SCHEDULED
[09:17:42.794] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:11:0) after 1m1s
[09:18:43.778] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:11:0)
[09:18:43.806] Build status: SCHEDULED
[09:18:43.806] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:12:0) after 6m23s
[09:25:06.829] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:12:0)
[09:25:06.850] Build status: SCHEDULED
[09:25:06.850] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:13:0) after 6m35s
[09:27:12.716] Received PubSub notification, asking Buildbucket for the build status
[09:27:12.731] Build status: STARTED
[09:31:41.899] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:13:0)
[09:31:41.922] Build status: STARTED
[09:31:41.922] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:15:0) after 9m27s
[09:41:09.038] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:15:0)
[09:41:09.086] Build status: STARTED
[09:41:09.086] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:16:0) after 2m24s
[09:43:33.125] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:16:0)
[09:43:33.142] Build status: STARTED
[09:43:33.142] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:17:0) after 2m58s
[09:46:31.362] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:17:0)
[09:46:31.379] Build status: STARTED
[09:46:31.379] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:18:0) after 3m50s
[09:50:21.505] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:18:0)
[09:50:21.536] Build status: STARTED
[09:50:21.536] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:19:0) after 8m23s
[09:58:44.966] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:19:0)
[09:58:44.981] Build status: STARTED
[09:58:44.981] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:20:0) after 3m33s
[10:02:18.023] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:20:0)
[10:02:18.054] Build status: STARTED
[10:02:18.054] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:21:0) after 3m36s
[10:05:54.174] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:21:0)
[10:05:54.234] Build status: STARTED
[10:05:54.234] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:22:0) after 5m1s
[10:10:55.281] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:22:0)
[10:10:55.303] Build status: STARTED
[10:10:55.303] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:23:0) after 3m7s
[10:14:02.422] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:23:0)
[10:14:02.490] Build status: STARTED
[10:14:02.490] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:24:0) after 1m54s
[10:15:56.517] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:24:0)
[10:15:56.569] Build status: STARTED
[10:15:56.569] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:25:0) after 1m57s
[10:17:53.643] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:25:0)
[10:17:53.666] Build status: STARTED
[10:17:53.666] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:26:0) after 1m34s
[10:19:27.696] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:26:0)
[10:19:27.711] Build status: STARTED
[10:19:27.711] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:27:0) after 6m43s
[10:26:10.740] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:27:0)
[10:26:10.802] Build status: STARTED
[10:26:10.802] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:28:0) after 1m33s
[10:27:43.825] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:28:0)
[10:27:43.840] Build status: STARTED
[10:27:43.840] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:29:0) after 3m38s
[10:31:21.910] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:29:0)
[10:31:22.032] Build status: STARTED
[10:31:22.032] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:30:0) after 9m24s
[10:40:46.096] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:30:0)
[10:40:46.126] Build status: STARTED
[10:40:46.126] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:31:0) after 5m47s
[10:46:33.178] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:31:0)
[10:46:33.198] Build status: STARTED
[10:46:33.198] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:32:0) after 6m35s
[10:53:08.343] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:32:0)
[10:53:08.371] Build status: STARTED
[10:53:08.371] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:33:0) after 1m56s
[10:55:04.490] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:33:0)
[10:55:04.505] Build status: STARTED
[10:55:04.505] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:34:0) after 2m21s
[10:57:25.529] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:34:0)
[10:57:25.546] Build status: STARTED
[10:57:25.546] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:35:0) after 4m26s
[11:01:51.664] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:35:0)
[11:01:51.680] Build status: STARTED
[11:01:51.680] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:36:0) after 7m34s
[11:09:25.762] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:36:0)
[11:09:25.810] Build status: STARTED
[11:09:25.810] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:37:0) after 8m37s
[11:18:02.867] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:37:0)
[11:18:02.887] Build status: STARTED
[11:18:02.887] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:38:0) after 4m55s
[11:22:57.968] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:38:0)
[11:22:57.985] Build status: STARTED
[11:22:57.985] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:39:0) after 1m17s
[11:24:15.083] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:39:0)
[11:24:15.177] Build status: STARTED
[11:24:15.177] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:40:0) after 1m10s
[11:25:25.240] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:40:0)
[11:25:25.332] Build status: STARTED
[11:25:25.332] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:41:0) after 2m5s
[11:27:30.360] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:41:0)
[11:27:30.384] Build status: STARTED
[11:27:30.384] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:42:0) after 5m29s
[11:32:59.412] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:42:0)
[11:32:59.427] Build status: STARTED
[11:32:59.427] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:43:0) after 1m7s
[11:34:06.454] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:43:0)
[11:34:06.473] Build status: STARTED
[11:34:06.473] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:44:0) after 5m33s
[11:39:39.552] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:44:0)
[11:39:39.566] Build status: STARTED
[11:39:39.566] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:45:0) after 4m31s
[11:44:10.593] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:45:0)
[11:44:10.616] Build status: STARTED
[11:44:10.616] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:46:0) after 4m11s
[11:48:21.642] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:46:0)
[11:48:21.659] Build status: STARTED
[11:48:21.659] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:47:0) after 3m30s
[11:51:51.742] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:47:0)
[11:51:51.761] Build status: STARTED
[11:51:51.761] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:48:0) after 8m5s
[11:59:56.758] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:48:0)
[11:59:56.790] Build status: STARTED
[11:59:56.790] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:49:0) after 8m26s
[12:08:22.952] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:49:0)
[12:08:22.977] Build status: STARTED
[12:08:22.977] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:50:0) after 4m22s
[12:12:45.061] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:50:0)
[12:12:45.077] Build status: STARTED
[12:12:45.077] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:51:0) after 2m15s
[12:15:00.105] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:51:0)
[12:15:00.127] Build status: STARTED
[12:15:00.127] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:52:0) after 2m32s
[12:17:32.155] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:52:0)
[12:17:32.168] Build status: STARTED
[12:17:32.168] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:53:0) after 4m43s
[12:22:15.331] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:53:0)
[12:22:15.351] Build status: STARTED
[12:22:15.351] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:54:0) after 9m28s
[12:31:43.397] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:54:0)
[12:31:43.417] Build status: STARTED
[12:31:43.417] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:55:0) after 9m42s
[12:41:26.403] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:55:0)
[12:41:26.490] Build status: STARTED
[12:41:26.490] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:56:0) after 9m2s
[12:50:28.514] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:56:0)
[12:50:28.531] Build status: STARTED
[12:50:28.531] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:57:0) after 3m0s
[12:53:28.606] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:57:0)
[12:53:28.643] Build status: STARTED
[12:53:28.643] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:58:0) after 6m31s
[12:59:59.730] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:58:0)
[12:59:59.748] Build status: STARTED
[12:59:59.748] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:59:0) after 9m47s
[13:09:46.805] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:59:0)
[13:09:46.826] Build status: STARTED
[13:09:46.826] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:60:0) after 9m20s
[13:19:06.924] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:60:0)
[13:19:06.938] Build status: STARTED
[13:19:06.938] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:61:0) after 5m17s
[13:24:24.024] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:61:0)
[13:24:24.044] Build status: STARTED
[13:24:24.044] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:62:0) after 7m11s
[13:31:35.100] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:62:0)
[13:31:35.120] Build status: STARTED
[13:31:35.120] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:63:0) after 2m44s
[13:34:19.149] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:63:0)
[13:34:19.165] Build status: STARTED
[13:34:19.165] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8867474602744843136:64:0) after 5m10s
[13:35:35.317] Received PubSub notification, asking Buildbucket for the build status
[13:35:35.343] Build:
{
"id": "8702044540772538257",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWinArm64PGO"
},
"number": 6265,
"createdBy": "project:chromium",
"createTime": "2025-10-03T08:37:23.450989445Z",
"startTime": "2025-10-03T09:27:12.099136178Z",
"endTime": "2025-10-03T13:35:34.985225155Z",
"updateTime": "2025-10-03T13:35:34.985225155Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fb5989ef1f68c15d199981af4c779761f07dd680",
"ref": "refs/heads/main"
}
}
}
[13:35:35.343] Invocation finished in 4h58m13.157288108s with status FAILED