[11:31:47.619] New invocation is queued and will start shortly
[11:31:48.713] Starting the invocation (attempt 1)
[11:31:48.745] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/9a8a209bed0e7861b01dba461cb9d2c70ac741c6"
[11:31:48.745] Popped gitiles commit info from properties and tags
[11:31:48.745] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[11:31:48.745] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[11:31:48.746] Buildbucket request:
{
"requestId": "8833761557447805008",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWin64PGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9a8a209bed0e7861b01dba461cb9d2c70ac741c6",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8833761557447805008"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTWin64PGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[11:31:49.369] Scheduled build:
{
"id": "8668331495519621185",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWin64PGO"
},
"number": 16476,
"createdBy": "project:chromium",
"createTime": "2026-10-10T11:31:48.835427420Z",
"updateTime": "2026-10-10T11:31:48.835427420Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9a8a209bed0e7861b01dba461cb9d2c70ac741c6",
"ref": "refs/heads/main"
}
}
}
[11:31:49.369] Task URL: https://cr-buildbucket.appspot.com/build/8668331495519621185
[11:31:49.369] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:2:0) after 7m28s
[11:31:55.226] Received PubSub notification, asking Buildbucket for the build status
[11:31:55.356] Build status: SCHEDULED
[11:31:57.587] Received PubSub notification, asking Buildbucket for the build status
[11:31:57.645] Build status: STARTED
[11:39:17.415] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:2:0)
[11:39:17.434] Build status: STARTED
[11:39:17.434] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:5:0) after 1m33s
[11:40:50.497] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:5:0)
[11:40:50.513] Build status: STARTED
[11:40:50.513] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:6:0) after 7m21s
[11:48:11.563] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:6:0)
[11:48:11.668] Build status: STARTED
[11:48:11.668] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:7:0) after 3m53s
[11:52:05.365] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:7:0)
[11:52:05.385] Build status: STARTED
[11:52:05.385] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:8:0) after 5m15s
[11:57:20.451] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:8:0)
[11:57:20.470] Build status: STARTED
[11:57:20.470] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:9:0) after 5m31s
[12:02:51.459] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:9:0)
[12:02:51.482] Build status: STARTED
[12:02:51.482] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:10:0) after 3m47s
[12:06:38.647] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:10:0)
[12:06:38.669] Build status: STARTED
[12:06:38.670] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:11:0) after 3m49s
[12:10:27.785] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:11:0)
[12:10:27.807] Build status: STARTED
[12:10:27.807] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:12:0) after 4m17s
[12:14:44.827] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:12:0)
[12:14:44.843] Build status: STARTED
[12:14:44.843] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:13:0) after 2m28s
[12:17:12.859] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:13:0)
[12:17:12.877] Build status: STARTED
[12:17:12.877] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:14:0) after 7m28s
[12:24:40.982] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:14:0)
[12:24:41.002] Build status: STARTED
[12:24:41.002] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:15:0) after 7m46s
[12:32:27.020] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:15:0)
[12:32:27.123] Build status: STARTED
[12:32:27.123] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:16:0) after 6m21s
[12:38:48.189] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:16:0)
[12:38:48.236] Build status: STARTED
[12:38:48.236] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:17:0) after 3m36s
[12:42:24.260] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:17:0)
[12:42:24.294] Build status: STARTED
[12:42:24.294] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:18:0) after 6m7s
[12:48:31.530] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:18:0)
[12:48:31.553] Build status: STARTED
[12:48:31.553] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:19:0) after 7m18s
[12:55:49.598] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:19:0)
[12:55:49.621] Build status: STARTED
[12:55:49.621] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:20:0) after 4m42s
[13:00:31.637] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:20:0)
[13:00:31.656] Build status: STARTED
[13:00:31.656] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:21:0) after 1m14s
[13:01:45.699] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:21:0)
[13:01:45.718] Build status: STARTED
[13:01:45.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:22:0) after 2m43s
[13:04:28.777] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:22:0)
[13:04:28.803] Build status: STARTED
[13:04:28.803] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:23:0) after 8m23s
[13:12:51.818] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:23:0)
[13:12:51.834] Build status: STARTED
[13:12:51.834] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:24:0) after 5m46s
[13:18:37.850] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:24:0)
[13:18:37.867] Build status: STARTED
[13:18:37.867] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:25:0) after 9m31s
[13:28:09.157] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:25:0)
[13:28:09.178] Build status: STARTED
[13:28:09.178] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:26:0) after 4m16s
[13:32:25.309] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:26:0)
[13:32:25.328] Build status: STARTED
[13:32:25.328] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:27:0) after 6m40s
[13:39:05.884] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:27:0)
[13:39:05.907] Build status: STARTED
[13:39:05.907] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:28:0) after 7m24s
[13:46:29.943] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:28:0)
[13:46:29.973] Build status: STARTED
[13:46:29.974] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:29:0) after 9m41s
[13:56:11.020] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:29:0)
[13:56:11.047] Build status: STARTED
[13:56:11.047] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:30:0) after 1m19s
[13:57:30.074] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:30:0)
[13:57:30.113] Build status: STARTED
[13:57:30.113] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:31:0) after 6m21s
[14:03:51.131] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:31:0)
[14:03:51.152] Build status: STARTED
[14:03:51.152] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:32:0) after 7m47s
[14:11:38.173] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:32:0)
[14:11:38.197] Build status: STARTED
[14:11:38.197] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:33:0) after 7m4s
[14:18:42.241] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:33:0)
[14:18:42.299] Build status: STARTED
[14:18:42.299] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:34:0) after 4m31s
[14:23:13.346] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:34:0)
[14:23:13.400] Build status: STARTED
[14:23:13.400] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:35:0) after 8m49s
[14:32:02.657] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:35:0)
[14:32:02.675] Build status: STARTED
[14:32:02.675] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:36:0) after 9m24s
[14:41:26.698] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:36:0)
[14:41:26.755] Build status: STARTED
[14:41:26.755] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:37:0) after 7m28s
[14:48:54.826] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:37:0)
[14:48:54.849] Build status: STARTED
[14:48:54.849] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:38:0) after 4m0s
[14:52:54.894] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:38:0)
[14:52:55.002] Build status: STARTED
[14:52:55.003] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:39:0) after 7m46s
[15:00:41.091] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:39:0)
[15:00:41.116] Build status: STARTED
[15:00:41.116] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:40:0) after 8m44s
[15:09:25.133] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:40:0)
[15:09:25.191] Build status: STARTED
[15:09:25.191] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:41:0) after 3m16s
[15:12:41.190] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:41:0)
[15:12:41.207] Build status: STARTED
[15:12:41.208] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:42:0) after 9m20s
[15:22:01.244] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:42:0)
[15:22:01.259] Build status: STARTED
[15:22:01.259] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:43:0) after 7m14s
[15:29:15.506] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:43:0)
[15:29:15.523] Build status: STARTED
[15:29:15.523] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:44:0) after 3m25s
[15:32:40.545] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:44:0)
[15:32:40.568] Build status: STARTED
[15:32:40.568] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:45:0) after 4m50s
[15:37:30.638] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:45:0)
[15:37:30.720] Build status: STARTED
[15:37:30.720] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:46:0) after 8m12s
[15:45:42.738] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:46:0)
[15:45:42.765] Build status: STARTED
[15:45:42.765] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:47:0) after 7m20s
[15:53:02.781] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:47:0)
[15:53:02.798] Build status: STARTED
[15:53:02.798] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:48:0) after 9m32s
[16:02:34.817] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:48:0)
[16:02:34.860] Build status: STARTED
[16:02:34.860] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:49:0) after 6m47s
[16:09:21.853] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:49:0)
[16:09:21.935] Build status: STARTED
[16:09:21.935] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:50:0) after 8m14s
[16:17:35.981] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:50:0)
[16:17:36.049] Build status: STARTED
[16:17:36.049] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:51:0) after 2m6s
[16:19:42.048] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:51:0)
[16:19:42.065] Build status: STARTED
[16:19:42.066] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:52:0) after 5m52s
[16:25:34.125] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:52:0)
[16:25:34.144] Build status: STARTED
[16:25:34.144] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:53:0) after 6m26s
[16:32:00.164] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:53:0)
[16:32:00.185] Build status: STARTED
[16:32:00.185] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:54:0) after 8m34s
[16:40:34.293] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:54:0)
[16:40:34.423] Build status: STARTED
[16:40:34.423] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:55:0) after 6m40s
[16:47:14.571] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:55:0)
[16:47:14.598] Build status: STARTED
[16:47:14.598] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:56:0) after 2m44s
[16:49:58.887] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:56:0)
[16:49:58.918] Build status: STARTED
[16:49:58.919] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:57:0) after 2m20s
[16:52:19.122] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:57:0)
[16:52:19.142] Build status: STARTED
[16:52:19.142] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:58:0) after 1m39s
[16:53:58.110] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:58:0)
[16:53:58.124] Build status: STARTED
[16:53:58.124] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:59:0) after 2m2s
[16:56:00.483] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:59:0)
[16:56:00.505] Build status: STARTED
[16:56:00.505] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:60:0) after 9m44s
[17:05:44.525] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:60:0)
[17:05:44.544] Build status: STARTED
[17:05:44.544] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:61:0) after 3m9s
[17:08:53.563] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:61:0)
[17:08:53.585] Build status: STARTED
[17:08:53.585] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:62:0) after 6m3s
[17:14:56.600] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:62:0)
[17:14:56.622] Build status: STARTED
[17:14:56.622] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:63:0) after 6m7s
[17:21:03.661] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:63:0)
[17:21:03.682] Build status: STARTED
[17:21:03.683] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:64:0) after 5m20s
[17:26:23.712] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:64:0)
[17:26:23.738] Build status: STARTED
[17:26:23.738] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:65:0) after 2m38s
[17:29:01.777] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:65:0)
[17:29:01.803] Build status: STARTED
[17:29:01.803] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:66:0) after 5m53s
[17:34:54.904] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:66:0)
[17:34:54.954] Build status: STARTED
[17:34:54.954] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8833761557447805008:67:0) after 8m0s
[17:35:47.805] Received PubSub notification, asking Buildbucket for the build status
[17:35:47.828] Build:
{
"id": "8668331495519621185",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWin64PGO"
},
"number": 16476,
"createdBy": "project:chromium",
"createTime": "2026-10-10T11:31:48.835427420Z",
"startTime": "2026-10-10T11:31:55.962835501Z",
"endTime": "2026-10-10T17:35:47.336137414Z",
"updateTime": "2026-10-10T17:35:47.336137414Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9a8a209bed0e7861b01dba461cb9d2c70ac741c6",
"ref": "refs/heads/main"
}
}
}
[17:35:47.828] Invocation finished in 6h4m0.214768385s with status FAILED