[01:33:32.212] New invocation is queued and will start shortly
[01:33:33.268] Starting the invocation (attempt 1)
[01:33:33.292] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/bc7b1a5863e7afdd225f788304a7110c186a8f98"
[01:33:33.292] Popped gitiles commit info from properties and tags
[01:33:33.292] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[01:33:33.292] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[01:33:33.292] Buildbucket request:
{
"requestId": "8881181409937823760",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWinArm64PGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "bc7b1a5863e7afdd225f788304a7110c186a8f98",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8881181409937823760"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTWinArm64PGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[01:33:33.813] Scheduled build:
{
"id": "8715751348047522465",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWinArm64PGO"
},
"number": 5563,
"createdBy": "project:chromium",
"createTime": "2025-05-05T01:33:33.391953976Z",
"updateTime": "2025-05-05T01:33:33.391953976Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "bc7b1a5863e7afdd225f788304a7110c186a8f98",
"ref": "refs/heads/main"
}
}
}
[01:33:33.813] Task URL: https://cr-buildbucket.appspot.com/build/8715751348047522465
[01:33:33.813] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:2:0) after 2m50s
[01:33:34.817] Received PubSub notification, asking Buildbucket for the build status
[01:33:34.849] Build status: SCHEDULED
[01:36:23.854] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:2:0)
[01:36:23.951] Build status: SCHEDULED
[01:36:23.951] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:4:0) after 6m21s
[01:42:45.123] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:4:0)
[01:42:45.151] Build status: SCHEDULED
[01:42:45.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:5:0) after 8m30s
[01:51:15.183] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:5:0)
[01:51:15.206] Build status: SCHEDULED
[01:51:15.206] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:6:0) after 6m39s
[01:52:40.710] Received PubSub notification, asking Buildbucket for the build status
[01:52:40.736] Build status: STARTED
[01:57:54.276] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:6:0)
[01:57:54.298] Build status: STARTED
[01:57:54.298] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:8:0) after 4m55s
[02:02:49.454] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:8:0)
[02:02:49.477] Build status: STARTED
[02:02:49.477] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:9:0) after 9m19s
[02:12:08.500] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:9:0)
[02:12:08.536] Build status: STARTED
[02:12:08.536] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:10:0) after 3m55s
[02:16:03.557] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:10:0)
[02:16:03.583] Build status: STARTED
[02:16:03.583] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:11:0) after 3m19s
[02:19:22.786] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:11:0)
[02:19:22.815] Build status: STARTED
[02:19:22.815] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:12:0) after 6m12s
[02:25:34.937] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:12:0)
[02:25:34.964] Build status: STARTED
[02:25:34.964] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:13:0) after 4m58s
[02:30:33.021] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:13:0)
[02:30:33.045] Build status: STARTED
[02:30:33.045] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:14:0) after 7m27s
[02:38:00.257] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:14:0)
[02:38:00.282] Build status: STARTED
[02:38:00.282] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:15:0) after 6m37s
[02:44:37.400] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:15:0)
[02:44:37.427] Build status: STARTED
[02:44:37.427] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:16:0) after 2m23s
[02:47:00.635] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:16:0)
[02:47:00.655] Build status: STARTED
[02:47:00.655] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:17:0) after 5m31s
[02:52:31.756] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:17:0)
[02:52:31.823] Build status: STARTED
[02:52:31.823] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:18:0) after 6m39s
[02:59:10.848] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:18:0)
[02:59:10.912] Build status: STARTED
[02:59:10.912] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:19:0) after 7m11s
[03:06:22.386] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:19:0)
[03:06:22.415] Build status: STARTED
[03:06:22.415] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:20:0) after 7m2s
[03:13:24.532] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:20:0)
[03:13:24.617] Build status: STARTED
[03:13:24.617] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:21:0) after 8m23s
[03:21:47.625] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:21:0)
[03:21:47.642] Build status: STARTED
[03:21:47.643] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:22:0) after 6m11s
[03:27:58.683] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:22:0)
[03:27:58.716] Build status: STARTED
[03:27:58.716] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:23:0) after 2m10s
[03:30:08.780] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:23:0)
[03:30:08.862] Build status: STARTED
[03:30:08.862] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:24:0) after 7m54s
[03:38:03.277] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:24:0)
[03:38:03.297] Build status: STARTED
[03:38:03.297] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:25:0) after 4m5s
[03:42:08.321] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:25:0)
[03:42:08.417] Build status: STARTED
[03:42:08.417] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:26:0) after 7m19s
[03:49:27.818] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:26:0)
[03:49:27.844] Build status: STARTED
[03:49:27.844] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:27:0) after 3m47s
[03:53:14.963] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:27:0)
[03:53:14.978] Build status: STARTED
[03:53:14.978] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:28:0) after 4m40s
[03:57:55.034] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:28:0)
[03:57:55.050] Build status: STARTED
[03:57:55.050] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:29:0) after 2m13s
[04:00:08.082] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:29:0)
[04:00:08.103] Build status: STARTED
[04:00:08.103] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:30:0) after 1m40s
[04:01:48.120] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:30:0)
[04:01:48.140] Build status: STARTED
[04:01:48.140] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:31:0) after 6m14s
[04:08:02.295] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:31:0)
[04:08:02.315] Build status: STARTED
[04:08:02.315] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:32:0) after 7m17s
[04:15:19.562] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:32:0)
[04:15:19.588] Build status: STARTED
[04:15:19.588] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:33:0) after 1m45s
[04:17:04.728] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:33:0)
[04:17:04.743] Build status: STARTED
[04:17:04.743] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:34:0) after 6m57s
[04:24:02.165] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:34:0)
[04:24:02.183] Build status: STARTED
[04:24:02.183] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:35:0) after 6m20s
[04:30:22.206] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:35:0)
[04:30:22.222] Build status: STARTED
[04:30:22.223] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:36:0) after 8m43s
[04:39:05.244] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:36:0)
[04:39:05.267] Build status: STARTED
[04:39:05.267] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:37:0) after 5m37s
[04:44:42.391] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:37:0)
[04:44:42.422] Build status: STARTED
[04:44:42.422] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:38:0) after 3m53s
[04:48:35.439] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:38:0)
[04:48:35.460] Build status: STARTED
[04:48:35.460] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:39:0) after 1m3s
[04:49:38.697] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:39:0)
[04:49:38.719] Build status: STARTED
[04:49:38.719] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:40:0) after 5m35s
[04:55:13.738] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:40:0)
[04:55:13.751] Build status: STARTED
[04:55:13.751] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:41:0) after 3m11s
[04:58:24.772] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:41:0)
[04:58:24.832] Build status: STARTED
[04:58:24.832] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:42:0) after 4m17s
[05:02:41.928] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:42:0)
[05:02:41.962] Build status: STARTED
[05:02:41.962] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:43:0) after 2m11s
[05:04:53.072] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:43:0)
[05:04:53.095] Build status: STARTED
[05:04:53.095] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:44:0) after 4m1s
[05:08:54.135] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:44:0)
[05:08:54.150] Build status: STARTED
[05:08:54.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:45:0) after 3m10s
[05:12:04.167] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:45:0)
[05:12:04.186] Build status: STARTED
[05:12:04.186] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:46:0) after 3m42s
[05:15:46.216] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:46:0)
[05:15:46.270] Build status: STARTED
[05:15:46.270] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:47:0) after 8m32s
[05:24:18.428] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:47:0)
[05:24:18.479] Build status: STARTED
[05:24:18.479] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:48:0) after 3m32s
[05:27:50.494] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:48:0)
[05:27:50.563] Build status: STARTED
[05:27:50.563] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:49:0) after 2m18s
[05:30:08.585] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:49:0)
[05:30:08.613] Build status: STARTED
[05:30:08.613] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:50:0) after 9m21s
[05:39:35.913] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:50:0)
[05:39:35.936] Build status: STARTED
[05:39:35.936] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:51:0) after 6m16s
[05:45:51.954] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:51:0)
[05:45:51.969] Build status: STARTED
[05:45:51.969] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:52:0) after 5m33s
[05:51:24.989] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:52:0)
[05:51:25.012] Build status: STARTED
[05:51:25.012] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:53:0) after 9m49s
[06:01:14.037] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:53:0)
[06:01:14.083] Build status: STARTED
[06:01:14.083] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:54:0) after 8m33s
[06:09:47.174] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:54:0)
[06:09:47.193] Build status: STARTED
[06:09:47.193] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:55:0) after 2m46s
[06:12:33.215] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:55:0)
[06:12:33.230] Build status: STARTED
[06:12:33.230] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:56:0) after 1m37s
[06:14:10.421] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:56:0)
[06:14:10.453] Build status: STARTED
[06:14:10.453] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:57:0) after 6m49s
[06:20:59.499] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:57:0)
[06:20:59.522] Build status: STARTED
[06:20:59.522] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:58:0) after 5m44s
[06:26:43.645] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:58:0)
[06:26:43.660] Build status: STARTED
[06:26:43.660] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:59:0) after 5m29s
[06:32:12.685] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:59:0)
[06:32:12.706] Build status: STARTED
[06:32:12.706] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:60:0) after 7m25s
[06:39:37.736] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:60:0)
[06:39:37.809] Build status: STARTED
[06:39:37.809] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:61:0) after 5m39s
[06:45:16.817] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:61:0)
[06:45:16.832] Build status: STARTED
[06:45:16.832] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:62:0) after 4m4s
[06:49:20.974] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:62:0)
[06:49:21.007] Build status: STARTED
[06:49:21.007] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:63:0) after 4m0s
[06:53:21.037] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:63:0)
[06:53:21.052] Build status: STARTED
[06:53:21.052] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:64:0) after 9m34s
[07:02:55.223] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:64:0)
[07:02:55.246] Build status: STARTED
[07:02:55.247] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:65:0) after 6m40s
[07:09:35.298] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:65:0)
[07:09:35.369] Build status: STARTED
[07:09:35.369] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8881181409937823760:66:0) after 5m40s
[07:14:56.483] Received PubSub notification, asking Buildbucket for the build status
[07:14:56.498] Build:
{
"id": "8715751348047522465",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWinArm64PGO"
},
"number": 5563,
"createdBy": "project:chromium",
"createTime": "2025-05-05T01:33:33.391953976Z",
"startTime": "2025-05-05T01:52:40.492677327Z",
"endTime": "2025-05-05T07:14:56.212140195Z",
"updateTime": "2025-05-05T07:14:56.212140195Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "bc7b1a5863e7afdd225f788304a7110c186a8f98",
"ref": "refs/heads/main"
}
}
}
[07:14:56.498] Invocation finished in 5h41m24.292282446s with status FAILED