[06:26:07.226] New invocation is queued and will start shortly
[06:26:08.394] Starting the invocation (attempt 1)
[06:26:08.420] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/df20d301acf32bc9263590db35726cd0865324ef"
[06:26:08.421] Popped gitiles commit info from properties and tags
[06:26:08.421] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[06:26:08.421] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[06:26:08.421] Buildbucket request:
{
"requestId": "8864946145188474640",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWinArm64PGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "df20d301acf32bc9263590db35726cd0865324ef",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8864946145188474640"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTWinArm64PGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[06:26:08.875] Scheduled build:
{
"id": "8699516083221105569",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWinArm64PGO"
},
"number": 6360,
"createdBy": "project:chromium",
"createTime": "2025-10-31T06:26:08.476170777Z",
"updateTime": "2025-10-31T06:26:08.476170777Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "df20d301acf32bc9263590db35726cd0865324ef",
"ref": "refs/heads/main"
}
}
}
[06:26:08.875] Task URL: https://cr-buildbucket.appspot.com/build/8699516083221105569
[06:26:08.875] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:2:0) after 6m33s
[06:26:10.430] Received PubSub notification, asking Buildbucket for the build status
[06:26:10.460] Build status: SCHEDULED
[06:27:33.338] Received PubSub notification, asking Buildbucket for the build status
[06:27:33.368] Build status: STARTED
[06:32:41.933] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:2:0)
[06:32:41.950] Build status: STARTED
[06:32:41.950] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:5:0) after 9m58s
[06:42:39.964] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:5:0)
[06:42:39.987] Build status: STARTED
[06:42:39.987] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:6:0) after 6m24s
[06:49:04.004] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:6:0)
[06:49:04.020] Build status: STARTED
[06:49:04.020] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:7:0) after 1m1s
[06:50:04.986] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:7:0)
[06:50:05.003] Build status: STARTED
[06:50:05.003] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:8:0) after 6m1s
[06:56:06.039] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:8:0)
[06:56:06.058] Build status: STARTED
[06:56:06.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:9:0) after 4m57s
[07:01:03.117] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:9:0)
[07:01:03.168] Build status: STARTED
[07:01:03.168] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:10:0) after 1m3s
[07:02:06.229] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:10:0)
[07:02:06.243] Build status: STARTED
[07:02:06.243] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:11:0) after 9m34s
[07:11:40.349] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:11:0)
[07:11:40.384] Build status: STARTED
[07:11:40.384] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:12:0) after 6m23s
[07:18:03.475] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:12:0)
[07:18:03.490] Build status: STARTED
[07:18:03.490] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:13:0) after 2m58s
[07:21:01.528] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:13:0)
[07:21:01.549] Build status: STARTED
[07:21:01.549] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:14:0) after 7m46s
[07:28:47.590] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:14:0)
[07:28:47.672] Build status: STARTED
[07:28:47.672] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:15:0) after 6m30s
[07:35:17.738] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:15:0)
[07:35:17.865] Build status: STARTED
[07:35:17.865] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:16:0) after 9m33s
[07:44:50.943] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:16:0)
[07:44:50.974] Build status: STARTED
[07:44:50.974] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:17:0) after 8m3s
[07:52:53.987] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:17:0)
[07:52:54.027] Build status: STARTED
[07:52:54.027] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:18:0) after 5m34s
[07:58:28.009] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:18:0)
[07:58:28.037] Build status: STARTED
[07:58:28.037] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:19:0) after 4m15s
[08:02:43.069] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:19:0)
[08:02:43.086] Build status: STARTED
[08:02:43.086] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:20:0) after 3m15s
[08:05:58.152] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:20:0)
[08:05:58.205] Build status: STARTED
[08:05:58.205] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:21:0) after 4m8s
[08:10:06.229] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:21:0)
[08:10:06.244] Build status: STARTED
[08:10:06.244] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:22:0) after 4m33s
[08:14:39.263] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:22:0)
[08:14:39.279] Build status: STARTED
[08:14:39.279] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:23:0) after 3m44s
[08:18:24.230] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:23:0)
[08:18:24.247] Build status: STARTED
[08:18:24.247] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:24:0) after 5m29s
[08:23:53.270] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:24:0)
[08:23:53.295] Build status: STARTED
[08:23:53.295] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:25:0) after 3m19s
[08:27:12.329] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:25:0)
[08:27:12.352] Build status: STARTED
[08:27:12.352] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:26:0) after 6m2s
[08:33:14.459] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:26:0)
[08:33:14.476] Build status: STARTED
[08:33:14.476] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:27:0) after 7m34s
[08:40:48.493] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:27:0)
[08:40:48.506] Build status: STARTED
[08:40:48.506] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:28:0) after 3m58s
[08:44:46.622] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:28:0)
[08:44:46.640] Build status: STARTED
[08:44:46.640] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:29:0) after 5m7s
[08:49:53.855] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:29:0)
[08:49:53.869] Build status: STARTED
[08:49:53.869] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:30:0) after 1m30s
[08:51:23.894] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:30:0)
[08:51:23.911] Build status: STARTED
[08:51:23.911] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:31:0) after 2m25s
[08:53:49.032] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:31:0)
[08:53:49.064] Build status: STARTED
[08:53:49.064] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:32:0) after 8m15s
[09:02:04.078] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:32:0)
[09:02:04.098] Build status: STARTED
[09:02:04.099] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:33:0) after 3m34s
[09:05:38.339] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:33:0)
[09:05:38.355] Build status: STARTED
[09:05:38.355] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:34:0) after 5m57s
[09:11:35.763] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:34:0)
[09:11:35.783] Build status: STARTED
[09:11:35.783] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:35:0) after 7m3s
[09:18:38.836] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:35:0)
[09:18:38.860] Build status: STARTED
[09:18:38.860] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:36:0) after 1m42s
[09:20:20.877] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:36:0)
[09:20:20.893] Build status: STARTED
[09:20:20.893] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:37:0) after 3m10s
[09:23:30.957] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:37:0)
[09:23:30.979] Build status: STARTED
[09:23:30.979] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:38:0) after 9m22s
[09:32:52.996] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:38:0)
[09:32:53.029] Build status: STARTED
[09:32:53.029] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:39:0) after 6m21s
[09:39:14.044] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:39:0)
[09:39:14.062] Build status: STARTED
[09:39:14.062] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:40:0) after 1m21s
[09:40:35.116] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:40:0)
[09:40:35.161] Build status: STARTED
[09:40:35.161] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:41:0) after 3m53s
[09:44:28.177] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:41:0)
[09:44:28.196] Build status: STARTED
[09:44:28.196] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:42:0) after 2m14s
[09:46:42.209] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:42:0)
[09:46:42.227] Build status: STARTED
[09:46:42.227] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:43:0) after 6m1s
[09:52:43.340] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:43:0)
[09:52:43.413] Build status: STARTED
[09:52:43.413] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:44:0) after 2m26s
[09:55:09.461] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:44:0)
[09:55:09.476] Build status: STARTED
[09:55:09.476] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:45:0) after 7m2s
[10:02:11.501] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:45:0)
[10:02:11.526] Build status: STARTED
[10:02:11.526] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:46:0) after 8m15s
[10:10:26.542] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:46:0)
[10:10:26.555] Build status: STARTED
[10:10:26.556] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:47:0) after 4m23s
[10:14:49.589] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:47:0)
[10:14:49.611] Build status: STARTED
[10:14:49.611] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:48:0) after 3m17s
[10:18:06.627] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:48:0)
[10:18:06.645] Build status: STARTED
[10:18:06.645] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:49:0) after 3m21s
[10:21:27.630] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:49:0)
[10:21:27.710] Build status: STARTED
[10:21:27.710] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:50:0) after 2m21s
[10:23:48.726] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:50:0)
[10:23:48.742] Build status: STARTED
[10:23:48.742] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:51:0) after 5m9s
[10:28:57.759] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:51:0)
[10:28:57.773] Build status: STARTED
[10:28:57.773] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:52:0) after 6m38s
[10:35:35.823] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:52:0)
[10:35:35.838] Build status: STARTED
[10:35:35.838] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:53:0) after 2m21s
[10:37:56.869] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:53:0)
[10:37:56.886] Build status: STARTED
[10:37:56.886] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:54:0) after 8m34s
[10:46:30.901] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:54:0)
[10:46:30.919] Build status: STARTED
[10:46:30.920] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:55:0) after 3m52s
[10:50:23.017] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:55:0)
[10:50:23.034] Build status: STARTED
[10:50:23.034] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:56:0) after 7m38s
[10:58:01.052] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:56:0)
[10:58:01.085] Build status: STARTED
[10:58:01.085] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:57:0) after 5m24s
[11:03:25.217] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:57:0)
[11:03:25.235] Build status: STARTED
[11:03:25.235] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:58:0) after 1m25s
[11:04:50.252] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:58:0)
[11:04:50.272] Build status: STARTED
[11:04:50.272] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8864946145188474640:59:0) after 3m52s
[11:05:39.536] Received PubSub notification, asking Buildbucket for the build status
[11:05:39.549] Build:
{
"id": "8699516083221105569",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWinArm64PGO"
},
"number": 6360,
"createdBy": "project:chromium",
"createTime": "2025-10-31T06:26:08.476170777Z",
"startTime": "2025-10-31T06:27:33.144552197Z",
"endTime": "2025-10-31T11:05:39.301276923Z",
"updateTime": "2025-10-31T11:05:39.301276923Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "df20d301acf32bc9263590db35726cd0865324ef",
"ref": "refs/heads/main"
}
}
}
[11:05:39.549] Invocation finished in 4h39m32.331839693s with status FAILED