LUCI Scheduler :: chromium :: ToTWin64PGO

Status: FAILED

Triggered by: -

Duration: 9 hours

Actions:

Definition (rev e074ce6d087643bcc493cb2122b4c61db039574b)

buildbucket: <
  server: "cr-buildbucket.appspot.com"
  bucket: "luci.chromium.ci"
  builder: "ToTWin64PGO"
>

Incoming triggers

9bca29e947b9bad41b4a8b1846595bd040540987 (3 years ago)
f9429b6d3e85a1b3f4c0afb7afc9b08358a93e84 (3 years ago)
df0a536bce7ee3432c59676d37363b1eaaeeb5e9 (3 years ago)
96774f3537d2addbf5f27263e2b4cba93a954242 (3 years ago)
0711ffd714d14eb7a60ca771c7d918fb3dd8743f (3 years ago)
dd9bd6dd77dbe4d05c2f6d94f3f0b62b15f8f01b (3 years ago)
d2eb071a5d2ad7d8d8d8a0cdb6146200da03f294 (3 years ago)
2d6485364156d5e8c210770313cb0e25a27ce4f9 (3 years ago)
cacaf17051ba5ef2c58c5415ddfcd999783e511b (3 years ago)
9eac545a369db369307d72fa541cbdf3d521cb9d (3 years ago)
5da5bce746253ff5783e31d3e3308fed1db89721 (3 years ago)
567a93d3d5bd9e502eed589f6488175aee48e65a (3 years ago)
8de7727b1f956970177b432f02d2e078e75992a4 (3 years ago)
df7874fb2460ecd589d68ae25ddcafbd86aab4ed (3 years ago)
33c2f8483ec292477e1397aa7b78d6c5d07143fb (3 years ago)
39060f5716f4198686fae83923bc3957fe46ad1e (3 years ago)
35a6036d2cc2e2dfd24e39b6e1566bdc7f91beb6 (3 years ago)
5491cf70173a6b56b651606aa2ea9cceda243757 (3 years ago)
c36b39112c9b98c2f0f211ff7bbe1e7d2fda0ca7 (3 years ago)
a507b61842f5f0c7cf7dfd37c709f45fb1065c8e (3 years ago)
1df4ddd2d6db18838b328d8b6f7b8c798c33830b (3 years ago)
5914ae1a148c15aead01c65243012bd4059efe46 (3 years ago)
8c5317ebee0be2cfa3cd0c52312fdb8f8507377b (3 years ago)
f72da3a46c33237b8d43acc29cbc06a172600b25 (3 years ago)
f443fa867b9461b0964c55cb12025205f1e47499 (3 years ago)
955bfbea1f5dc58c6b01db7f053fc8756a7a1b82 (3 years ago)
cf53813c5229d5794514c9f408def4ef28827046 (3 years ago)
1fd5fb610a9b9dcff4e07c9fb6d4fc7a1360af4e (3 years ago)

Incoming properties

{
  "branch": "refs/heads/main",
  "repository": "https://chromium.googlesource.com/chromium/src",
  "revision": "1fd5fb610a9b9dcff4e07c9fb6d4fc7a1360af4e"
}

Incoming tags

buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/1fd5fb610a9b9dcff4e07c9fb6d4fc7a1360af4e
gitiles_ref:refs/heads/main

Debug log (UTC)

[04:22:56.324] New invocation is queued and will start shortly
[04:22:57.418] Starting the invocation (attempt 1)
[04:22:57.448] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/1fd5fb610a9b9dcff4e07c9fb6d4fc7a1360af4e"
[04:22:57.448] Popped gitiles commit info from properties and tags
[04:22:57.448] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[04:22:57.448] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[04:22:57.448] Buildbucket request:
{
  "requestId": "9001755314384421456",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTWin64PGO"
  },
  "properties": {
    },
  "gitilesCommit": {
    "host": "chromium.googlesource.com",
    "project": "chromium/src",
    "id": "1fd5fb610a9b9dcff4e07c9fb6d4fc7a1360af4e",
    "ref": "refs/heads/main"
  },
  "tags": [
    {
      "key": "scheduler_invocation_id",
      "value": "9001755314384421456"
    },
    {
      "key": "scheduler_job_id",
      "value": "chromium/ToTWin64PGO"
    },
    {
      "key": "user_agent",
      "value": "luci-scheduler"
    }
  ],
  "notify": {
    "pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
  }
}
[04:22:57.932] Scheduled build:
{
  "id": "8836325252485098065",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTWin64PGO"
  },
  "number": 1400,
  "createdBy": "project:chromium",
  "createTime": "2021-09-12T04:22:57.500508683Z",
  "updateTime": "2021-09-12T04:22:57.736117542Z",
  "status": "SCHEDULED",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "1fd5fb610a9b9dcff4e07c9fb6d4fc7a1360af4e",
      "ref": "refs/heads/main"
    }
  }
}
[04:22:57.932] Task URL: https://cr-buildbucket.appspot.com/build/8836325252485098065
[04:22:57.933] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:2:0) after 5m14s
[04:28:11.954] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:2:0)
[04:28:11.982] Build status: SCHEDULED
[04:28:11.982] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:3:0) after 3m24s
[04:31:36.280] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:3:0)
[04:31:36.322] Build status: SCHEDULED
[04:31:36.322] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:4:0) after 4m46s
[04:36:22.502] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:4:0)
[04:36:22.557] Build status: SCHEDULED
[04:36:22.557] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:5:0) after 6m6s
[04:42:28.578] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:5:0)
[04:42:28.618] Build status: SCHEDULED
[04:42:28.618] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:6:0) after 8m42s
[04:51:10.806] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:6:0)
[04:51:10.838] Build status: SCHEDULED
[04:51:10.838] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:7:0) after 6m14s
[04:57:24.970] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:7:0)
[04:57:25.048] Build status: SCHEDULED
[04:57:25.048] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:8:0) after 5m29s
[05:02:54.071] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:8:0)
[05:02:54.097] Build status: SCHEDULED
[05:02:54.097] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:9:0) after 9m57s
[05:12:51.107] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:9:0)
[05:12:51.137] Build status: SCHEDULED
[05:12:51.137] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:10:0) after 6m36s
[05:19:27.280] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:10:0)
[05:19:27.307] Build status: SCHEDULED
[05:19:27.307] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:11:0) after 3m55s
[05:23:22.424] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:11:0)
[05:23:22.450] Build status: SCHEDULED
[05:23:22.450] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:12:0) after 9m6s
[05:32:28.466] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:12:0)
[05:32:28.491] Build status: SCHEDULED
[05:32:28.492] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:13:0) after 7m25s
[05:39:54.420] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:13:0)
[05:39:54.449] Build status: SCHEDULED
[05:39:54.449] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:14:0) after 3m34s
[05:43:28.468] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:14:0)
[05:43:28.499] Build status: SCHEDULED
[05:43:28.499] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:15:0) after 5m33s
[05:49:02.299] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:15:0)
[05:49:02.340] Build status: SCHEDULED
[05:49:02.340] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:16:0) after 9m31s
[05:58:33.363] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:16:0)
[05:58:33.401] Build status: SCHEDULED
[05:58:33.401] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:17:0) after 4m22s
[06:02:55.427] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:17:0)
[06:02:55.460] Build status: SCHEDULED
[06:02:55.460] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:18:0) after 3m5s
[06:03:08.468] Received PubSub notification, asking Buildbucket for the build status
[06:03:08.490] Build status: STARTED
[06:06:00.496] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:18:0)
[06:06:00.550] Build status: STARTED
[06:06:00.550] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:20:0) after 5m47s
[06:11:47.541] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:20:0)
[06:11:47.571] Build status: STARTED
[06:11:47.572] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:21:0) after 3m31s
[06:15:18.588] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:21:0)
[06:15:18.685] Build status: STARTED
[06:15:18.685] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:22:0) after 8m37s
[06:23:55.705] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:22:0)
[06:23:55.736] Build status: STARTED
[06:23:55.736] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:23:0) after 5m39s
[06:29:34.757] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:23:0)
[06:29:34.871] Build status: STARTED
[06:29:34.871] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:24:0) after 6m16s
[06:35:51.093] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:24:0)
[06:35:51.121] Build status: STARTED
[06:35:51.121] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:25:0) after 6m26s
[06:42:17.187] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:25:0)
[06:42:17.229] Build status: STARTED
[06:42:17.229] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:26:0) after 1m55s
[06:44:12.248] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:26:0)
[06:44:12.380] Build status: STARTED
[06:44:12.380] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:27:0) after 9m42s
[06:53:54.395] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:27:0)
[06:53:54.585] Build status: STARTED
[06:53:54.585] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:28:0) after 4m7s
[06:58:01.642] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:28:0)
[06:58:01.747] Build status: STARTED
[06:58:01.747] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:29:0) after 4m1s
[07:02:02.938] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:29:0)
[07:02:02.968] Build status: STARTED
[07:02:02.968] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:30:0) after 4m31s
[07:06:34.000] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:30:0)
[07:06:34.037] Build status: STARTED
[07:06:34.037] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:31:0) after 1m36s
[07:08:11.088] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:31:0)
[07:08:11.138] Build status: STARTED
[07:08:11.138] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:32:0) after 6m15s
[07:14:26.157] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:32:0)
[07:14:26.192] Build status: STARTED
[07:14:26.192] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:33:0) after 5m45s
[07:20:11.311] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:33:0)
[07:20:11.369] Build status: STARTED
[07:20:11.369] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:34:0) after 8m58s
[07:29:09.411] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:34:0)
[07:29:09.764] Build status: STARTED
[07:29:09.765] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:35:0) after 2m58s
[07:32:07.839] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:35:0)
[07:32:07.873] Build status: STARTED
[07:32:07.873] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:36:0) after 6m56s
[07:39:04.025] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:36:0)
[07:39:04.112] Build status: STARTED
[07:39:04.112] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:37:0) after 1m17s
[07:40:21.133] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:37:0)
[07:40:21.162] Build status: STARTED
[07:40:21.162] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:38:0) after 5m1s
[07:45:22.164] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:38:0)
[07:45:22.195] Build status: STARTED
[07:45:22.195] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:39:0) after 3m52s
[07:49:14.335] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:39:0)
[07:49:14.364] Build status: STARTED
[07:49:14.364] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:40:0) after 1m9s
[07:50:23.340] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:40:0)
[07:50:23.375] Build status: STARTED
[07:50:23.375] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:41:0) after 9m57s
[08:00:20.503] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:41:0)
[08:00:20.586] Build status: STARTED
[08:00:20.586] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:42:0) after 4m19s
[08:04:39.607] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:42:0)
[08:04:39.824] Build status: STARTED
[08:04:39.824] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:43:0) after 3m31s
[08:08:11.001] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:43:0)
[08:08:11.070] Build status: STARTED
[08:08:11.070] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:44:0) after 9m37s
[08:17:48.147] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:44:0)
[08:17:48.177] Build status: STARTED
[08:17:48.177] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:45:0) after 1m31s
[08:19:19.242] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:45:0)
[08:19:19.280] Build status: STARTED
[08:19:19.280] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:46:0) after 2m56s
[08:22:15.334] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:46:0)
[08:22:15.388] Build status: STARTED
[08:22:15.389] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:47:0) after 8m39s
[08:30:54.631] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:47:0)
[08:30:54.661] Build status: STARTED
[08:30:54.661] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:48:0) after 5m56s
[08:36:50.736] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:48:0)
[08:36:50.776] Build status: STARTED
[08:36:50.776] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:49:0) after 5m43s
[08:42:33.899] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:49:0)
[08:42:33.936] Build status: STARTED
[08:42:33.936] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:50:0) after 5m14s
[08:47:47.956] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:50:0)
[08:47:47.988] Build status: STARTED
[08:47:47.988] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:51:0) after 1m3s
[08:48:51.075] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:51:0)
[08:48:51.120] Build status: STARTED
[08:48:51.120] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:52:0) after 4m19s
[08:53:10.146] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:52:0)
[08:53:10.179] Build status: STARTED
[08:53:10.179] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:53:0) after 2m35s
[08:55:45.293] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:53:0)
[08:55:45.334] Build status: STARTED
[08:55:45.334] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:54:0) after 9m52s
[09:05:37.658] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:54:0)
[09:05:37.693] Build status: STARTED
[09:05:37.693] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:55:0) after 4m59s
[09:10:36.852] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:55:0)
[09:10:37.194] Build status: STARTED
[09:10:37.194] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:56:0) after 1m22s
[09:11:59.350] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:56:0)
[09:11:59.384] Build status: STARTED
[09:11:59.384] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:57:0) after 4m30s
[09:16:29.403] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:57:0)
[09:16:29.429] Build status: STARTED
[09:16:29.429] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:58:0) after 6m32s
[09:23:01.462] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:58:0)
[09:23:01.501] Build status: STARTED
[09:23:01.501] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:59:0) after 2m13s
[09:25:14.530] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:59:0)
[09:25:14.558] Build status: STARTED
[09:25:14.558] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:60:0) after 3m7s
[09:28:21.581] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:60:0)
[09:28:21.614] Build status: STARTED
[09:28:21.614] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:61:0) after 6m2s
[09:34:23.632] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:61:0)
[09:34:23.663] Build status: STARTED
[09:34:23.663] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:62:0) after 3m41s
[09:38:04.999] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:62:0)
[09:38:05.039] Build status: STARTED
[09:38:05.039] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:63:0) after 4m9s
[09:42:14.057] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:63:0)
[09:42:14.088] Build status: STARTED
[09:42:14.088] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:64:0) after 2m44s
[09:44:58.782] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:64:0)
[09:44:58.816] Build status: STARTED
[09:44:58.816] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:65:0) after 6m14s
[09:51:12.841] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:65:0)
[09:51:12.876] Build status: STARTED
[09:51:12.876] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:66:0) after 9m15s
[10:00:29.081] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:66:0)
[10:00:29.114] Build status: STARTED
[10:00:29.114] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:67:0) after 4m53s
[10:05:22.160] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:67:0)
[10:05:22.218] Build status: STARTED
[10:05:22.218] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:68:0) after 1m25s
[10:06:47.342] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:68:0)
[10:06:47.373] Build status: STARTED
[10:06:47.373] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:69:0) after 1m55s
[10:08:42.396] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:69:0)
[10:08:42.432] Build status: STARTED
[10:08:42.432] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:70:0) after 8m57s
[10:17:39.691] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:70:0)
[10:17:39.720] Build status: STARTED
[10:17:39.720] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:71:0) after 3m13s
[10:20:52.751] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:71:0)
[10:20:52.788] Build status: STARTED
[10:20:52.788] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:72:0) after 2m16s
[10:23:08.831] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:72:0)
[10:23:08.863] Build status: STARTED
[10:23:08.863] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:73:0) after 5m40s
[10:28:49.149] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:73:0)
[10:28:49.194] Build status: STARTED
[10:28:49.194] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:74:0) after 9m45s
[10:38:34.181] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:74:0)
[10:38:34.264] Build status: STARTED
[10:38:34.264] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:75:0) after 4m3s
[10:42:37.285] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:75:0)
[10:42:37.332] Build status: STARTED
[10:42:37.332] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:76:0) after 7m48s
[10:50:25.799] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:76:0)
[10:50:25.884] Build status: STARTED
[10:50:25.884] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:77:0) after 6m51s
[10:57:17.164] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:77:0)
[10:57:17.196] Build status: STARTED
[10:57:17.196] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:78:0) after 6m41s
[11:03:58.363] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:78:0)
[11:03:58.395] Build status: STARTED
[11:03:58.395] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:79:0) after 3m0s
[11:06:58.684] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:79:0)
[11:06:58.729] Build status: STARTED
[11:06:58.729] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:80:0) after 4m25s
[11:11:24.147] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:80:0)
[11:11:24.191] Build status: STARTED
[11:11:24.191] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:81:0) after 2m8s
[11:13:32.512] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:81:0)
[11:13:32.546] Build status: STARTED
[11:13:32.546] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:82:0) after 4m39s
[11:18:11.785] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:82:0)
[11:18:11.825] Build status: STARTED
[11:18:11.825] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:83:0) after 1m14s
[11:19:25.890] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:83:0)
[11:19:25.921] Build status: STARTED
[11:19:25.921] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:84:0) after 2m18s
[11:21:43.943] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:84:0)
[11:21:43.977] Build status: STARTED
[11:21:43.977] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:85:0) after 1m36s
[11:23:19.998] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:85:0)
[11:23:20.261] Build status: STARTED
[11:23:20.261] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:86:0) after 1m35s
[11:24:55.284] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:86:0)
[11:24:55.455] Build status: STARTED
[11:24:55.455] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:87:0) after 4m16s
[11:29:12.000] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:87:0)
[11:29:12.029] Build status: STARTED
[11:29:12.029] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:88:0) after 2m31s
[11:31:43.068] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:88:0)
[11:31:43.117] Build status: STARTED
[11:31:43.117] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:89:0) after 1m58s
[11:33:41.443] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:89:0)
[11:33:41.472] Build status: STARTED
[11:33:41.472] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:90:0) after 9m35s
[11:43:16.648] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:90:0)
[11:43:16.690] Build status: STARTED
[11:43:16.690] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:91:0) after 1m35s
[11:44:52.050] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:91:0)
[11:44:52.078] Build status: STARTED
[11:44:52.078] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:92:0) after 4m47s
[11:49:39.101] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:92:0)
[11:49:39.131] Build status: STARTED
[11:49:39.132] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:93:0) after 2m5s
[11:51:44.713] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:93:0)
[11:51:44.756] Build status: STARTED
[11:51:44.756] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:94:0) after 5m54s
[11:57:38.815] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:94:0)
[11:57:38.846] Build status: STARTED
[11:57:38.846] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:95:0) after 7m36s
[12:05:14.891] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:95:0)
[12:05:14.968] Build status: STARTED
[12:05:14.968] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:96:0) after 8m26s
[12:13:41.550] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:96:0)
[12:13:41.603] Build status: STARTED
[12:13:41.603] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:97:0) after 4m29s
[12:18:10.624] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:97:0)
[12:18:10.656] Build status: STARTED
[12:18:10.656] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:98:0) after 8m25s
[12:26:35.718] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:98:0)
[12:26:35.747] Build status: STARTED
[12:26:35.747] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:99:0) after 1m18s
[12:27:53.806] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:99:0)
[12:27:53.836] Build status: STARTED
[12:27:53.836] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:100:0) after 2m52s
[12:30:45.990] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:100:0)
[12:30:46.034] Build status: STARTED
[12:30:46.034] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:101:0) after 1m6s
[12:31:52.055] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:101:0)
[12:31:52.106] Build status: STARTED
[12:31:52.106] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:102:0) after 5m50s
[12:37:42.615] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:102:0)
[12:37:42.644] Build status: STARTED
[12:37:42.644] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:103:0) after 3m23s
[12:41:05.864] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:103:0)
[12:41:05.939] Build status: STARTED
[12:41:05.939] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:104:0) after 6m12s
[12:47:17.983] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:104:0)
[12:47:18.016] Build status: STARTED
[12:47:18.016] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:105:0) after 5m37s
[12:52:55.038] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:105:0)
[12:52:55.073] Build status: STARTED
[12:52:55.073] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:106:0) after 6m15s
[12:59:10.482] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:106:0)
[12:59:10.549] Build status: STARTED
[12:59:10.549] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:107:0) after 1m8s
[13:00:18.614] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:107:0)
[13:00:18.646] Build status: STARTED
[13:00:18.646] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:108:0) after 6m15s
[13:06:34.003] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:108:0)
[13:06:34.035] Build status: STARTED
[13:06:34.035] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:109:0) after 3m33s
[13:10:07.056] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:109:0)
[13:10:07.090] Build status: STARTED
[13:10:07.090] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:110:0) after 2m13s
[13:12:20.113] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:110:0)
[13:12:20.197] Build status: STARTED
[13:12:20.197] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:111:0) after 2m34s
[13:14:54.547] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:111:0)
[13:14:54.590] Build status: STARTED
[13:14:54.590] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:112:0) after 6m12s
[13:21:06.771] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:112:0)
[13:21:06.866] Build status: STARTED
[13:21:06.866] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:113:0) after 9m13s
[13:30:19.888] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:113:0)
[13:30:19.926] Build status: STARTED
[13:30:19.926] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:114:0) after 8m25s
[13:38:45.449] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:114:0)
[13:38:45.488] Build status: STARTED
[13:38:45.488] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9001755314384421456:115:0) after 4m44s
[13:41:21.785] Received PubSub notification, asking Buildbucket for the build status
[13:41:21.855] Build:
{
  "id": "8836325252485098065",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTWin64PGO"
  },
  "number": 1400,
  "createdBy": "project:chromium",
  "createTime": "2021-09-12T04:22:57.500508683Z",
  "startTime": "2021-09-12T06:03:07.798295Z",
  "endTime": "2021-09-12T13:41:02.767558295Z",
  "updateTime": "2021-09-12T13:41:02.768212446Z",
  "status": "FAILURE",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "1fd5fb610a9b9dcff4e07c9fb6d4fc7a1360af4e",
      "ref": "refs/heads/main"
    }
  }
}
[13:41:21.855] Invocation finished in 9h18m25.549154233s with status FAILED