LUCI Scheduler :: chromium :: ToTWin64PGO

Status: FAILED

Triggered by: -

Duration: 10 hours

Actions:

Definition (rev e074ce6d087643bcc493cb2122b4c61db039574b)

buildbucket: <
  server: "cr-buildbucket.appspot.com"
  bucket: "luci.chromium.ci"
  builder: "ToTWin64PGO"
>

Incoming triggers

841c5c1dcd0dbd4321918e3af6b3d171a87578f9 (2 years ago)
f05e89515f664dae5c127cce5a05bb765edafa91 (2 years ago)
c1831ce2a1e55740c30adc1233d35e21de6fbc02 (2 years ago)
cee3ec3b9386a393d9198c2b31db785461b37e46 (2 years ago)
f62d0a6e65f97e911d93ef94203e47d8f9865d7f (2 years ago)
b7df73a270c51f9c7ddbc9e7c903846195e93f6c (2 years ago)
9baa9d462a583458eabcae34985037cf359f2177 (2 years ago)
17aff65ec6b12d5faba85f17eb9383b5c50ee15f (2 years ago)
146db78112b57ffae9102ea63a781985ff0f0d90 (2 years ago)
ea27c3b3ce39e3f712675212c72b88110eac648f (2 years ago)
8f9958c18515bfb22afb5ae4eabc4bc0ff95e8f5 (2 years ago)
3ae1347ff973122cd00b18cf0b8e6aa90bf7bdc0 (2 years ago)
655517a5428619b1060c094a8b497816d750f52f (2 years ago)
8e7fdeb8e1e47142b9a6ca42e1f01fb74d493171 (2 years ago)
12613940968ecdba1a8cffff31f722c8fff43df7 (2 years ago)
d2e6004103f8558787da64e197cc4fa2d3ed6213 (2 years ago)
61af40885bce5a36ee53e421cf06a23bb878cb17 (2 years ago)
db0eb4d140bdba4e509c5317e799632a47418d5c (2 years ago)
73b489ca925a805f0782e7b04683c8820b7aa521 (2 years ago)
05cb03d9944d8258128decf5de24020d0b762253 (2 years ago)
c54c30d4b5570ef1562e8d7a885542131b5839f1 (2 years ago)
89d8a9b5fc25e0820ee6fa0f6f2cc9db7359be13 (2 years ago)
baa743c8585be92fe92bbe737b446fd0d2fdef4b (2 years ago)
91aad923570afb827588b885e7eba53eaed7b211 (2 years ago)

Incoming properties

{
  "branch": "refs/heads/main",
  "repository": "https://chromium.googlesource.com/chromium/src",
  "revision": "91aad923570afb827588b885e7eba53eaed7b211"
}

Incoming tags

buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/91aad923570afb827588b885e7eba53eaed7b211
gitiles_ref:refs/heads/main

Debug log (UTC)

[23:40:52.566] New invocation is queued and will start shortly
[23:40:54.048] Starting the invocation (attempt 1)
[23:40:54.084] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/91aad923570afb827588b885e7eba53eaed7b211"
[23:40:54.084] Popped gitiles commit info from properties and tags
[23:40:54.084] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[23:40:54.084] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[23:40:54.084] Buildbucket request:
{
  "requestId": "8994072318084254304",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTWin64PGO"
  },
  "properties": {
    },
  "gitilesCommit": {
    "host": "chromium.googlesource.com",
    "project": "chromium/src",
    "id": "91aad923570afb827588b885e7eba53eaed7b211",
    "ref": "refs/heads/main"
  },
  "tags": [
    {
      "key": "scheduler_invocation_id",
      "value": "8994072318084254304"
    },
    {
      "key": "scheduler_job_id",
      "value": "chromium/ToTWin64PGO"
    },
    {
      "key": "user_agent",
      "value": "luci-scheduler"
    }
  ],
  "notify": {
    "pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
  }
}
[23:40:54.630] Scheduled build:
{
  "id": "8828642255666559777",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTWin64PGO"
  },
  "number": 1837,
  "createdBy": "project:chromium",
  "createTime": "2021-12-05T23:40:54.239758949Z",
  "updateTime": "2021-12-05T23:40:54.239758949Z",
  "status": "SCHEDULED",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "91aad923570afb827588b885e7eba53eaed7b211",
      "ref": "refs/heads/main"
    }
  }
}
[23:40:54.630] Task URL: https://cr-buildbucket.appspot.com/build/8828642255666559777
[23:40:54.630] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:2:0) after 9m31s
[23:50:25.647] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:2:0)
[23:50:25.676] Build status: SCHEDULED
[23:50:25.676] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:3:0) after 5m4s
[23:55:29.692] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:3:0)
[23:55:29.718] Build status: SCHEDULED
[23:55:29.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:4:0) after 8m40s
[00:04:10.061] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:4:0)
[00:04:10.093] Build status: SCHEDULED
[00:04:10.093] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:5:0) after 5m36s
[00:09:46.116] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:5:0)
[00:09:46.149] Build status: SCHEDULED
[00:09:46.149] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:6:0) after 1m45s
[00:11:31.167] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:6:0)
[00:11:45.458] Build status: SCHEDULED
[00:11:45.458] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:7:0) after 2m5s
[00:13:50.475] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:7:0)
[00:13:50.506] Build status: SCHEDULED
[00:13:50.506] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:8:0) after 7m55s
[00:21:45.551] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:8:0)
[00:21:45.579] Build status: SCHEDULED
[00:21:45.579] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:9:0) after 9m51s
[00:31:36.595] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:9:0)
[00:31:36.653] Build status: SCHEDULED
[00:31:36.653] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:10:0) after 4m14s
[00:35:50.714] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:10:0)
[00:35:50.742] Build status: SCHEDULED
[00:35:50.742] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:11:0) after 4m7s
[00:39:57.871] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:11:0)
[00:39:57.896] Build status: SCHEDULED
[00:39:57.896] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:12:0) after 9m21s
[00:49:20.316] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:12:0)
[00:49:20.344] Build status: SCHEDULED
[00:49:20.344] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:13:0) after 6m31s
[00:55:52.044] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:13:0)
[00:55:52.076] Build status: SCHEDULED
[00:55:52.076] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:14:0) after 3m30s
[00:59:22.106] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:14:0)
[00:59:22.128] Build status: SCHEDULED
[00:59:22.128] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:15:0) after 9m40s
[01:09:02.152] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:15:0)
[01:09:02.194] Build status: SCHEDULED
[01:09:02.194] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:16:0) after 3m31s
[01:12:33.214] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:16:0)
[01:12:33.260] Build status: SCHEDULED
[01:12:33.260] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:17:0) after 1m51s
[01:14:24.477] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:17:0)
[01:14:24.514] Build status: SCHEDULED
[01:14:24.514] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:18:0) after 5m32s
[01:19:56.531] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:18:0)
[01:19:56.558] Build status: SCHEDULED
[01:19:56.558] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:19:0) after 2m31s
[01:22:27.655] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:19:0)
[01:22:27.679] Build status: SCHEDULED
[01:22:27.679] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:20:0) after 8m43s
[01:31:10.718] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:20:0)
[01:31:10.746] Build status: SCHEDULED
[01:31:10.746] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:21:0) after 2m10s
[01:33:20.767] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:21:0)
[01:33:20.798] Build status: SCHEDULED
[01:33:20.798] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:22:0) after 8m23s
[01:41:43.817] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:22:0)
[01:41:43.844] Build status: SCHEDULED
[01:41:43.844] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:23:0) after 7m16s
[01:48:59.923] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:23:0)
[01:49:00.014] Build status: SCHEDULED
[01:49:00.014] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:24:0) after 3m30s
[01:52:30.058] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:24:0)
[01:52:30.087] Build status: SCHEDULED
[01:52:30.087] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:25:0) after 2m8s
[01:53:22.365] Received PubSub notification, asking Buildbucket for the build status
[01:53:22.394] Build status: STARTED
[01:54:38.104] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:25:0)
[01:54:38.132] Build status: STARTED
[01:54:38.132] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:27:0) after 4m14s
[01:58:52.157] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:27:0)
[01:58:52.193] Build status: STARTED
[01:58:52.193] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:28:0) after 1m13s
[02:00:05.219] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:28:0)
[02:00:05.262] Build status: STARTED
[02:00:05.262] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:29:0) after 3m6s
[02:03:11.281] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:29:0)
[02:03:11.308] Build status: STARTED
[02:03:11.308] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:30:0) after 4m54s
[02:08:05.450] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:30:0)
[02:08:05.496] Build status: STARTED
[02:08:05.496] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:31:0) after 4m7s
[02:12:13.054] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:31:0)
[02:12:13.081] Build status: STARTED
[02:12:13.081] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:32:0) after 9m14s
[02:21:27.102] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:32:0)
[02:21:27.157] Build status: STARTED
[02:21:27.157] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:33:0) after 5m25s
[02:26:52.176] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:33:0)
[02:26:52.258] Build status: STARTED
[02:26:52.258] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:34:0) after 8m10s
[02:35:02.300] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:34:0)
[02:35:02.328] Build status: STARTED
[02:35:02.329] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:35:0) after 8m17s
[02:43:21.493] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:35:0)
[02:43:21.521] Build status: STARTED
[02:43:21.521] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:36:0) after 4m2s
[02:47:23.541] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:36:0)
[02:47:23.576] Build status: STARTED
[02:47:23.576] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:37:0) after 3m31s
[02:50:54.599] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:37:0)
[02:50:54.650] Build status: STARTED
[02:50:54.650] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:38:0) after 9m57s
[03:00:51.748] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:38:0)
[03:00:51.782] Build status: STARTED
[03:00:51.782] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:39:0) after 2m18s
[03:03:09.802] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:39:0)
[03:03:09.830] Build status: STARTED
[03:03:09.830] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:40:0) after 3m7s
[03:06:17.386] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:40:0)
[03:06:17.416] Build status: STARTED
[03:06:17.416] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:41:0) after 1m52s
[03:08:09.447] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:41:0)
[03:08:09.501] Build status: STARTED
[03:08:09.501] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:42:0) after 4m25s
[03:12:34.615] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:42:0)
[03:12:34.646] Build status: STARTED
[03:12:34.646] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:43:0) after 5m35s
[03:18:09.701] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:43:0)
[03:18:09.732] Build status: STARTED
[03:18:09.732] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:44:0) after 9m12s
[03:27:21.770] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:44:0)
[03:27:21.799] Build status: STARTED
[03:27:21.799] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:45:0) after 5m3s
[03:32:25.393] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:45:0)
[03:32:25.426] Build status: STARTED
[03:32:25.426] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:46:0) after 6m34s
[03:38:59.836] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:46:0)
[03:38:59.867] Build status: STARTED
[03:38:59.867] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:47:0) after 2m10s
[03:41:10.119] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:47:0)
[03:41:10.159] Build status: STARTED
[03:41:10.159] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:48:0) after 9m32s
[03:50:42.181] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:48:0)
[03:50:42.226] Build status: STARTED
[03:50:42.226] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:49:0) after 2m1s
[03:52:43.247] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:49:0)
[03:52:43.276] Build status: STARTED
[03:52:43.276] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:50:0) after 8m1s
[04:00:44.298] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:50:0)
[04:00:44.328] Build status: STARTED
[04:00:44.328] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:51:0) after 5m20s
[04:06:04.352] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:51:0)
[04:06:04.383] Build status: STARTED
[04:06:04.383] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:52:0) after 6m57s
[04:13:01.406] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:52:0)
[04:13:01.448] Build status: STARTED
[04:13:01.448] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:53:0) after 9m34s
[04:22:35.505] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:53:0)
[04:22:35.556] Build status: STARTED
[04:22:35.556] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:54:0) after 8m50s
[04:31:25.584] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:54:0)
[04:31:25.613] Build status: STARTED
[04:31:25.613] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:55:0) after 8m13s
[04:39:38.904] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:55:0)
[04:39:38.930] Build status: STARTED
[04:39:38.930] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:56:0) after 8m49s
[04:48:27.968] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:56:0)
[04:48:27.996] Build status: STARTED
[04:48:27.996] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:57:0) after 1m20s
[04:49:48.013] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:57:0)
[04:49:48.044] Build status: STARTED
[04:49:48.044] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:58:0) after 3m5s
[04:52:53.075] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:58:0)
[04:52:53.108] Build status: STARTED
[04:52:53.108] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:59:0) after 6m9s
[04:59:02.125] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:59:0)
[04:59:02.183] Build status: STARTED
[04:59:02.183] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:60:0) after 8m14s
[05:07:16.282] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:60:0)
[05:07:16.333] Build status: STARTED
[05:07:16.333] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:61:0) after 3m51s
[05:11:07.339] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:61:0)
[05:11:07.372] Build status: STARTED
[05:11:07.372] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:62:0) after 9m3s
[05:20:10.519] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:62:0)
[05:20:10.549] Build status: STARTED
[05:20:10.550] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:63:0) after 6m37s
[05:26:47.591] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:63:0)
[05:26:47.617] Build status: STARTED
[05:26:47.617] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:64:0) after 8m32s
[05:35:19.706] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:64:0)
[05:35:19.744] Build status: STARTED
[05:35:19.744] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:65:0) after 5m21s
[05:40:40.872] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:65:0)
[05:40:40.899] Build status: STARTED
[05:40:40.899] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:66:0) after 4m46s
[05:45:26.963] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:66:0)
[05:45:27.002] Build status: STARTED
[05:45:27.002] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:67:0) after 9m18s
[05:54:45.023] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:67:0)
[05:54:45.052] Build status: STARTED
[05:54:45.052] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:68:0) after 4m46s
[05:59:31.112] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:68:0)
[05:59:31.142] Build status: STARTED
[05:59:31.142] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:69:0) after 3m9s
[06:02:40.225] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:69:0)
[06:02:40.258] Build status: STARTED
[06:02:40.258] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:70:0) after 3m49s
[06:06:29.946] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:70:0)
[06:06:29.973] Build status: STARTED
[06:06:29.973] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:71:0) after 9m44s
[06:16:14.140] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:71:0)
[06:16:14.168] Build status: STARTED
[06:16:14.168] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:72:0) after 5m21s
[06:21:35.200] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:72:0)
[06:21:35.228] Build status: STARTED
[06:21:35.228] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:73:0) after 9m26s
[06:31:01.248] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:73:0)
[06:31:01.281] Build status: STARTED
[06:31:01.281] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:74:0) after 4m0s
[06:35:01.440] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:74:0)
[06:35:01.488] Build status: STARTED
[06:35:01.488] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:75:0) after 9m10s
[06:44:11.655] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:75:0)
[06:44:11.682] Build status: STARTED
[06:44:11.682] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:76:0) after 4m41s
[06:48:52.685] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:76:0)
[06:48:52.774] Build status: STARTED
[06:48:52.774] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:77:0) after 7m7s
[06:55:59.931] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:77:0)
[06:55:59.961] Build status: STARTED
[06:55:59.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:78:0) after 7m22s
[07:03:21.981] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:78:0)
[07:03:22.014] Build status: STARTED
[07:03:22.014] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:79:0) after 5m56s
[07:09:18.296] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:79:0)
[07:09:18.321] Build status: STARTED
[07:09:18.321] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:80:0) after 1m53s
[07:11:11.397] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:80:0)
[07:11:11.447] Build status: STARTED
[07:11:11.447] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:81:0) after 2m31s
[07:13:42.484] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:81:0)
[07:13:42.512] Build status: STARTED
[07:13:42.512] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:82:0) after 8m34s
[07:22:16.534] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:82:0)
[07:22:16.582] Build status: STARTED
[07:22:16.582] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:83:0) after 5m55s
[07:28:11.696] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:83:0)
[07:28:11.727] Build status: STARTED
[07:28:11.727] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:84:0) after 6m35s
[07:34:46.765] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:84:0)
[07:34:46.813] Build status: STARTED
[07:34:46.813] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:85:0) after 3m2s
[07:37:48.832] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:85:0)
[07:37:48.870] Build status: STARTED
[07:37:48.870] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:86:0) after 1m9s
[07:38:57.910] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:86:0)
[07:38:57.936] Build status: STARTED
[07:38:57.936] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:87:0) after 6m45s
[07:45:42.954] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:87:0)
[07:45:42.989] Build status: STARTED
[07:45:42.989] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:88:0) after 6m53s
[07:52:36.034] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:88:0)
[07:52:36.066] Build status: STARTED
[07:52:36.066] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:89:0) after 7m10s
[07:59:46.141] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:89:0)
[07:59:46.186] Build status: STARTED
[07:59:46.186] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:90:0) after 1m11s
[08:00:57.250] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:90:0)
[08:00:57.282] Build status: STARTED
[08:00:57.282] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:91:0) after 5m12s
[08:06:09.304] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:91:0)
[08:06:09.350] Build status: STARTED
[08:06:09.350] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:92:0) after 4m16s
[08:10:25.860] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:92:0)
[08:10:25.894] Build status: STARTED
[08:10:25.894] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:93:0) after 2m17s
[08:12:42.969] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:93:0)
[08:12:43.001] Build status: STARTED
[08:12:43.001] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:94:0) after 1m18s
[08:14:01.091] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:94:0)
[08:14:01.131] Build status: STARTED
[08:14:01.131] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:95:0) after 1m6s
[08:15:07.249] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:95:0)
[08:15:07.288] Build status: STARTED
[08:15:07.288] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:96:0) after 8m32s
[08:23:39.271] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:96:0)
[08:23:39.300] Build status: STARTED
[08:23:39.300] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:97:0) after 9m50s
[08:33:29.739] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:97:0)
[08:33:29.768] Build status: STARTED
[08:33:29.768] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:98:0) after 2m22s
[08:35:51.788] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:98:0)
[08:35:51.824] Build status: STARTED
[08:35:51.824] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:99:0) after 2m57s
[08:38:48.835] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:99:0)
[08:38:48.867] Build status: STARTED
[08:38:48.867] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:100:0) after 3m27s
[08:42:16.060] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:100:0)
[08:42:16.097] Build status: STARTED
[08:42:16.097] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:101:0) after 6m33s
[08:48:49.223] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:101:0)
[08:48:49.256] Build status: STARTED
[08:48:49.256] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:102:0) after 7m4s
[08:55:53.283] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:102:0)
[08:55:53.311] Build status: STARTED
[08:55:53.311] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:103:0) after 4m23s
[09:00:16.330] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:103:0)
[09:00:16.364] Build status: STARTED
[09:00:16.364] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:104:0) after 1m51s
[09:02:07.394] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:104:0)
[09:02:07.425] Build status: STARTED
[09:02:07.425] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:105:0) after 5m38s
[09:07:45.609] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:105:0)
[09:07:45.644] Build status: STARTED
[09:07:45.644] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:106:0) after 1m54s
[09:09:39.663] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:106:0)
[09:09:39.694] Build status: STARTED
[09:09:39.694] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:107:0) after 6m52s
[09:16:31.717] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:107:0)
[09:16:31.747] Build status: STARTED
[09:16:31.747] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:108:0) after 3m1s
[09:19:32.770] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:108:0)
[09:19:32.806] Build status: STARTED
[09:19:32.806] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:109:0) after 5m9s
[09:24:42.831] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:109:0)
[09:24:42.864] Build status: STARTED
[09:24:42.864] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:110:0) after 5m8s
[09:29:51.338] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:110:0)
[09:29:51.431] Build status: STARTED
[09:29:51.431] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:111:0) after 4m37s
[09:34:28.629] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:111:0)
[09:34:28.658] Build status: STARTED
[09:34:28.658] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:112:0) after 2m39s
[09:37:07.869] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:112:0)
[09:37:07.904] Build status: STARTED
[09:37:07.905] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:113:0) after 7m28s
[09:44:35.940] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:113:0)
[09:44:35.970] Build status: STARTED
[09:44:35.970] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:114:0) after 7m51s
[09:52:27.127] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:114:0)
[09:52:27.210] Build status: STARTED
[09:52:27.210] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:115:0) after 1m50s
[09:54:17.254] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:115:0)
[09:54:17.355] Build status: STARTED
[09:54:17.355] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:116:0) after 3m39s
[09:57:56.381] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:116:0)
[09:57:56.424] Build status: STARTED
[09:57:56.424] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:117:0) after 6m35s
[10:04:31.444] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:117:0)
[10:04:31.473] Build status: STARTED
[10:04:31.473] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8994072318084254304:118:0) after 8m15s
[10:09:50.843] Received PubSub notification, asking Buildbucket for the build status
[10:09:50.878] Build:
{
  "id": "8828642255666559777",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTWin64PGO"
  },
  "number": 1837,
  "createdBy": "project:chromium",
  "createTime": "2021-12-05T23:40:54.239758949Z",
  "startTime": "2021-12-06T01:53:14.662527Z",
  "endTime": "2021-12-06T10:09:50.410150748Z",
  "updateTime": "2021-12-06T10:09:50.410150748Z",
  "status": "FAILURE",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "91aad923570afb827588b885e7eba53eaed7b211",
      "ref": "refs/heads/main"
    }
  }
}
[10:09:50.878] Invocation finished in 10h28m58.327519287s with status FAILED