[23:35:30.562] New invocation is queued and will start shortly
[23:35:31.826] Starting the invocation (attempt 1)
[23:35:31.852] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/98e9ef02375a497747708205da1563793bcca31b"
[23:35:31.852] Popped gitiles commit info from properties and tags
[23:35:31.852] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[23:35:31.852] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[23:35:31.852] Buildbucket request:
{
"requestId": "8833172443393628048",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWinArm64PGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "98e9ef02375a497747708205da1563793bcca31b",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8833172443393628048"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTWinArm64PGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[23:35:32.722] Scheduled build:
{
"id": "8667742381315031681",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWinArm64PGO"
},
"number": 10049,
"createdBy": "project:chromium",
"createTime": "2026-10-16T23:35:31.921581318Z",
"updateTime": "2026-10-16T23:35:31.921581318Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "98e9ef02375a497747708205da1563793bcca31b",
"ref": "refs/heads/main"
}
}
}
[23:35:32.722] Task URL: https://cr-buildbucket.appspot.com/build/8667742381315031681
[23:35:32.723] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:2:0) after 1m46s
[23:35:33.143] Received PubSub notification, asking Buildbucket for the build status
[23:35:33.161] Build status: SCHEDULED
[23:35:39.754] Received PubSub notification, asking Buildbucket for the build status
[23:35:39.878] Build status: STARTED
[23:37:18.816] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:2:0)
[23:37:18.834] Build status: STARTED
[23:37:18.834] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:5:0) after 9m22s
[23:46:40.903] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:5:0)
[23:46:40.978] Build status: STARTED
[23:46:40.978] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:6:0) after 4m12s
[23:50:53.030] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:6:0)
[23:50:53.112] Build status: STARTED
[23:50:53.112] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:7:0) after 5m37s
[23:56:30.117] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:7:0)
[23:56:30.136] Build status: STARTED
[23:56:30.136] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:8:0) after 9m25s
[00:05:55.287] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:8:0)
[00:05:55.307] Build status: STARTED
[00:05:55.307] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:9:0) after 3m42s
[00:09:37.334] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:9:0)
[00:09:37.355] Build status: STARTED
[00:09:37.355] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:10:0) after 7m55s
[00:17:32.509] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:10:0)
[00:17:32.526] Build status: STARTED
[00:17:32.526] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:11:0) after 4m3s
[00:21:35.621] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:11:0)
[00:21:35.642] Build status: STARTED
[00:21:35.642] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:12:0) after 6m11s
[00:27:46.709] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:12:0)
[00:27:46.738] Build status: STARTED
[00:27:46.738] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:13:0) after 4m20s
[00:32:06.764] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:13:0)
[00:32:06.785] Build status: STARTED
[00:32:06.785] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:14:0) after 1m12s
[00:33:18.844] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:14:0)
[00:33:18.859] Build status: STARTED
[00:33:18.859] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:15:0) after 7m31s
[00:40:50.029] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:15:0)
[00:40:50.051] Build status: STARTED
[00:40:50.052] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:16:0) after 1m48s
[00:42:38.117] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:16:0)
[00:42:38.135] Build status: STARTED
[00:42:38.135] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:17:0) after 3m47s
[00:46:25.211] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:17:0)
[00:46:25.230] Build status: STARTED
[00:46:25.230] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:18:0) after 8m35s
[00:55:00.332] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:18:0)
[00:55:00.402] Build status: STARTED
[00:55:00.402] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:19:0) after 1m4s
[00:56:04.669] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:19:0)
[00:56:04.742] Build status: STARTED
[00:56:04.742] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:20:0) after 6m23s
[01:02:27.861] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:20:0)
[01:02:27.879] Build status: STARTED
[01:02:27.879] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:21:0) after 3m53s
[01:06:20.975] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:21:0)
[01:06:20.995] Build status: STARTED
[01:06:20.995] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:22:0) after 2m15s
[01:08:36.016] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:22:0)
[01:08:36.035] Build status: STARTED
[01:08:36.035] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:23:0) after 4m42s
[01:13:18.111] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:23:0)
[01:13:18.136] Build status: STARTED
[01:13:18.136] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:24:0) after 4m40s
[01:17:58.109] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:24:0)
[01:17:58.130] Build status: STARTED
[01:17:58.130] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:25:0) after 7m46s
[01:25:44.275] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:25:0)
[01:25:44.296] Build status: STARTED
[01:25:44.296] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:26:0) after 3m15s
[01:28:59.325] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:26:0)
[01:28:59.364] Build status: STARTED
[01:28:59.364] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:27:0) after 1m36s
[01:30:35.387] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:27:0)
[01:30:35.423] Build status: STARTED
[01:30:35.423] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:28:0) after 4m17s
[01:34:52.489] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:28:0)
[01:34:52.506] Build status: STARTED
[01:34:52.506] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:29:0) after 2m51s
[01:37:43.545] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:29:0)
[01:37:43.564] Build status: STARTED
[01:37:43.564] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:30:0) after 3m42s
[01:41:25.547] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:30:0)
[01:41:25.567] Build status: STARTED
[01:41:25.567] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:31:0) after 1m35s
[01:43:00.608] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:31:0)
[01:43:00.641] Build status: STARTED
[01:43:00.641] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:32:0) after 2m19s
[01:45:19.689] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:32:0)
[01:45:19.729] Build status: STARTED
[01:45:19.729] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:33:0) after 5m44s
[01:51:03.824] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:33:0)
[01:51:03.912] Build status: STARTED
[01:51:03.912] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:34:0) after 6m45s
[01:57:48.944] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:34:0)
[01:57:48.984] Build status: STARTED
[01:57:48.984] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:35:0) after 4m47s
[02:02:36.010] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:35:0)
[02:02:36.034] Build status: STARTED
[02:02:36.034] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:36:0) after 1m29s
[02:04:05.054] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:36:0)
[02:04:05.069] Build status: STARTED
[02:04:05.069] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:37:0) after 2m26s
[02:06:31.117] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:37:0)
[02:06:31.162] Build status: STARTED
[02:06:31.162] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:38:0) after 7m39s
[02:14:10.351] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:38:0)
[02:14:10.409] Build status: STARTED
[02:14:10.409] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:39:0) after 5m58s
[02:20:08.432] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:39:0)
[02:20:08.486] Build status: STARTED
[02:20:08.486] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:40:0) after 8m49s
[02:28:57.466] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:40:0)
[02:28:57.518] Build status: STARTED
[02:28:57.518] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:41:0) after 3m17s
[02:32:14.539] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:41:0)
[02:32:14.597] Build status: STARTED
[02:32:14.597] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:42:0) after 2m23s
[02:34:37.743] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:42:0)
[02:34:37.765] Build status: STARTED
[02:34:37.765] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:43:0) after 4m23s
[02:39:00.835] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:43:0)
[02:39:00.874] Build status: STARTED
[02:39:00.874] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:44:0) after 7m32s
[02:46:49.586] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:44:0)
[02:46:49.608] Build status: STARTED
[02:46:49.608] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:45:0) after 2m35s
[02:49:24.631] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:45:0)
[02:49:24.666] Build status: STARTED
[02:49:24.666] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:46:0) after 8m16s
[02:57:40.728] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:46:0)
[02:57:40.990] Build status: STARTED
[02:57:40.990] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:47:0) after 2m39s
[03:00:20.163] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:47:0)
[03:00:20.210] Build status: STARTED
[03:00:20.210] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:48:0) after 3m25s
[03:03:45.301] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:48:0)
[03:03:45.318] Build status: STARTED
[03:03:45.318] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:49:0) after 3m30s
[03:07:15.467] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:49:0)
[03:07:15.488] Build status: STARTED
[03:07:15.488] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:50:0) after 3m5s
[03:10:20.524] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:50:0)
[03:10:20.557] Build status: STARTED
[03:10:20.557] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:51:0) after 4m28s
[03:14:48.614] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:51:0)
[03:14:48.631] Build status: STARTED
[03:14:48.631] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8833172443393628048:52:0) after 3m30s
[03:16:22.744] Received PubSub notification, asking Buildbucket for the build status
[03:16:22.762] Build:
{
"id": "8667742381315031681",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWinArm64PGO"
},
"number": 10049,
"createdBy": "project:chromium",
"createTime": "2026-10-16T23:35:31.921581318Z",
"startTime": "2026-10-16T23:35:39.571296390Z",
"endTime": "2026-10-17T03:16:21.773693048Z",
"updateTime": "2026-10-17T03:16:21.773693048Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "98e9ef02375a497747708205da1563793bcca31b",
"ref": "refs/heads/main"
}
}
}
[03:16:22.762] Invocation finished in 3h40m52.206528578s with status FAILED