LUCI Scheduler :: chromium :: ToTWin64PGO

Status: FAILED

Triggered by: -

Duration: 9 hours

Actions:

Definition (rev e074ce6d087643bcc493cb2122b4c61db039574b)

buildbucket: <
  server: "cr-buildbucket.appspot.com"
  bucket: "luci.chromium.ci"
  builder: "ToTWin64PGO"
>

Incoming triggers

f24b4c78620567aabc7d8677a3d5c7cdb86283da (2 years ago)
c8e2fb7a79faa0cc2f7bbf327eb21a8aa30c5906 (2 years ago)
199ede52dc27699b4075002f6c1c79d0989757e8 (2 years ago)
c6eab0aaa4d907370dae6f70b7a4d89c04509717 (2 years ago)
c12f336ed933f2e840db22d6f73f310426e5d61e (2 years ago)
20333ed93e7516e0f9ec0ea592bbb65be1a710c2 (2 years ago)
da36dc0797d38b3a512a916ba8ce2d4e99d30f4a (2 years ago)
0198fa09db2c7661402cfe7a5ae9839b7b54b353 (2 years ago)
49fea39f8a9e2a352fa68334cfce1ea32f9f6abf (2 years ago)
d2073851b3a6f221f5e5e4f3a9d7fb4bd9c0c673 (2 years ago)
0bdae5c71e6106809a641907c6d182611b953887 (2 years ago)
396231ce9acd5b32a652ca70c7b8e73fca191a1f (2 years ago)
be180a8454f9c00188c97f7999b8a69fc3f31cda (2 years ago)
3490667cfb02fa8408e361053d19a7560de29a65 (2 years ago)
67dc7fc551615effe98e9e2ee00dc0c07c78e525 (2 years ago)
0a140c55b5a721c174c67a3c10e469efad4d7a31 (2 years ago)
9048be4f46f9bbf7e947ba36f3c10100a870459b (2 years ago)
78b27968f070192c291ce8a5100d3fb7a4ea4040 (2 years ago)
a2a522bc929edae7e2ff3172ab9bb43ee9a91d34 (2 years ago)
f2a771a2fac1900e6174472459ece1020a330305 (2 years ago)
a50bd70327a8b0cc1048caeab85cfc7c00da9d7a (2 years ago)
ec5f0d91a6c55fdc6040a2eb5c5600173a74f9be (2 years ago)
45c9f8525fb5fd70b662568d24001a137f133682 (2 years ago)
518dea79dc16d7615e27a14c468f5b05268cbcbe (2 years ago)
e8acef1f71a079b82acdf74e5ff9604f94753fe5 (2 years ago)
389cf5fd78b5c488a8503b6131436d86de282553 (2 years ago)

Incoming properties

{
  "branch": "refs/heads/main",
  "repository": "https://chromium.googlesource.com/chromium/src",
  "revision": "389cf5fd78b5c488a8503b6131436d86de282553"
}

Incoming tags

buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/389cf5fd78b5c488a8503b6131436d86de282553
gitiles_ref:refs/heads/main

Debug log (UTC)

[00:09:03.242] New invocation is queued and will start shortly
[00:09:04.305] Starting the invocation (attempt 1)
[00:09:04.339] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/389cf5fd78b5c488a8503b6131436d86de282553"
[00:09:04.340] Popped gitiles commit info from properties and tags
[00:09:04.340] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[00:09:04.340] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[00:09:04.340] Buildbucket request:
{
  "requestId": "8997241439104584000",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTWin64PGO"
  },
  "properties": {
    },
  "gitilesCommit": {
    "host": "chromium.googlesource.com",
    "project": "chromium/src",
    "id": "389cf5fd78b5c488a8503b6131436d86de282553",
    "ref": "refs/heads/main"
  },
  "tags": [
    {
      "key": "scheduler_invocation_id",
      "value": "8997241439104584000"
    },
    {
      "key": "scheduler_job_id",
      "value": "chromium/ToTWin64PGO"
    },
    {
      "key": "user_agent",
      "value": "luci-scheduler"
    }
  ],
  "notify": {
    "pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
  }
}
[00:09:04.791] Scheduled build:
{
  "id": "8831811377228665921",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTWin64PGO"
  },
  "number": 1686,
  "createdBy": "project:chromium",
  "createTime": "2021-11-01T00:09:04.400695059Z",
  "updateTime": "2021-11-01T00:09:04.400695059Z",
  "status": "SCHEDULED",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "389cf5fd78b5c488a8503b6131436d86de282553",
      "ref": "refs/heads/main"
    }
  }
}
[00:09:04.791] Task URL: https://cr-buildbucket.appspot.com/build/8831811377228665921
[00:09:04.791] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:2:0) after 5m15s
[00:14:19.854] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:2:0)
[00:14:19.904] Build status: SCHEDULED
[00:14:19.904] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:3:0) after 6m54s
[00:21:13.920] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:3:0)
[00:21:13.948] Build status: SCHEDULED
[00:21:13.948] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:4:0) after 5m43s
[00:26:57.015] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:4:0)
[00:26:57.096] Build status: SCHEDULED
[00:26:57.096] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:5:0) after 8m20s
[00:35:17.111] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:5:0)
[00:35:17.137] Build status: SCHEDULED
[00:35:17.137] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:6:0) after 7m34s
[00:42:51.153] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:6:0)
[00:42:51.179] Build status: SCHEDULED
[00:42:51.179] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:7:0) after 3m36s
[00:46:27.284] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:7:0)
[00:46:27.311] Build status: SCHEDULED
[00:46:27.311] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:8:0) after 8m20s
[00:54:47.329] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:8:0)
[00:54:47.355] Build status: SCHEDULED
[00:54:47.355] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:9:0) after 6m1s
[01:00:48.384] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:9:0)
[01:00:48.654] Build status: SCHEDULED
[01:00:48.654] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:10:0) after 5m10s
[01:05:58.948] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:10:0)
[01:05:58.978] Build status: SCHEDULED
[01:05:58.978] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:11:0) after 7m54s
[01:13:54.404] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:11:0)
[01:13:54.439] Build status: SCHEDULED
[01:13:54.439] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:12:0) after 7m8s
[01:21:02.840] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:12:0)
[01:21:02.871] Build status: SCHEDULED
[01:21:02.871] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:13:0) after 5m18s
[01:26:21.963] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:13:0)
[01:26:21.993] Build status: SCHEDULED
[01:26:21.993] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:14:0) after 4m32s
[01:30:54.015] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:14:0)
[01:30:54.047] Build status: SCHEDULED
[01:30:54.047] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:15:0) after 7m3s
[01:37:57.065] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:15:0)
[01:37:57.096] Build status: SCHEDULED
[01:37:57.096] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:16:0) after 4m6s
[01:42:03.203] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:16:0)
[01:42:03.232] Build status: SCHEDULED
[01:42:03.232] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:17:0) after 2m45s
[01:44:48.250] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:17:0)
[01:44:48.283] Build status: SCHEDULED
[01:44:48.283] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:18:0) after 6m14s
[01:51:02.307] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:18:0)
[01:51:02.336] Build status: SCHEDULED
[01:51:02.336] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:19:0) after 3m5s
[01:54:07.495] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:19:0)
[01:54:07.524] Build status: SCHEDULED
[01:54:07.524] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:20:0) after 6m36s
[02:00:43.541] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:20:0)
[02:00:43.567] Build status: SCHEDULED
[02:00:43.567] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:21:0) after 5m33s
[02:06:16.585] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:21:0)
[02:06:16.618] Build status: SCHEDULED
[02:06:16.618] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:22:0) after 1m0s
[02:07:16.639] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:22:0)
[02:07:16.700] Build status: SCHEDULED
[02:07:16.700] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:23:0) after 2m34s
[02:09:50.716] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:23:0)
[02:09:50.745] Build status: SCHEDULED
[02:09:50.745] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:24:0) after 4m9s
[02:13:59.952] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:24:0)
[02:13:59.979] Build status: SCHEDULED
[02:13:59.979] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:25:0) after 2m44s
[02:16:44.003] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:25:0)
[02:16:44.031] Build status: SCHEDULED
[02:16:44.031] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:26:0) after 3m50s
[02:20:34.063] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:26:0)
[02:20:34.094] Build status: SCHEDULED
[02:20:34.094] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:27:0) after 2m32s
[02:23:06.201] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:27:0)
[02:23:06.236] Build status: SCHEDULED
[02:23:06.236] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:28:0) after 1m56s
[02:25:02.344] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:28:0)
[02:25:02.372] Build status: SCHEDULED
[02:25:02.372] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:29:0) after 6m14s
[02:31:16.392] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:29:0)
[02:31:16.415] Build status: SCHEDULED
[02:31:16.415] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:30:0) after 6m58s
[02:34:17.286] Received PubSub notification, asking Buildbucket for the build status
[02:34:17.316] Build status: STARTED
[02:38:14.432] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:30:0)
[02:38:14.463] Build status: STARTED
[02:38:14.463] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:32:0) after 3m6s
[02:41:20.481] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:32:0)
[02:41:20.510] Build status: STARTED
[02:41:20.510] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:33:0) after 3m40s
[02:45:00.602] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:33:0)
[02:45:00.641] Build status: STARTED
[02:45:00.641] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:34:0) after 6m57s
[02:51:57.755] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:34:0)
[02:51:57.780] Build status: STARTED
[02:51:57.780] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:35:0) after 8m22s
[03:00:19.806] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:35:0)
[03:00:19.836] Build status: STARTED
[03:00:19.836] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:36:0) after 1m38s
[03:01:57.968] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:36:0)
[03:01:58.013] Build status: STARTED
[03:01:58.013] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:37:0) after 8m44s
[03:10:42.143] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:37:0)
[03:10:42.182] Build status: STARTED
[03:10:42.182] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:38:0) after 5m15s
[03:15:57.209] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:38:0)
[03:15:57.261] Build status: STARTED
[03:15:57.261] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:39:0) after 1m51s
[03:17:48.361] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:39:0)
[03:17:48.394] Build status: STARTED
[03:17:48.394] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:40:0) after 5m10s
[03:22:58.412] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:40:0)
[03:22:58.440] Build status: STARTED
[03:22:58.440] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:41:0) after 9m56s
[03:32:54.430] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:41:0)
[03:32:54.473] Build status: STARTED
[03:32:54.473] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:42:0) after 4m32s
[03:37:26.607] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:42:0)
[03:37:26.637] Build status: STARTED
[03:37:26.637] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:43:0) after 4m28s
[03:41:54.705] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:43:0)
[03:41:54.735] Build status: STARTED
[03:41:54.735] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:44:0) after 2m50s
[03:44:44.758] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:44:0)
[03:44:44.803] Build status: STARTED
[03:44:44.803] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:45:0) after 3m42s
[03:48:26.825] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:45:0)
[03:48:26.854] Build status: STARTED
[03:48:26.854] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:46:0) after 9m14s
[03:57:40.885] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:46:0)
[03:57:40.911] Build status: STARTED
[03:57:40.911] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:47:0) after 7m6s
[04:04:46.932] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:47:0)
[04:04:46.958] Build status: STARTED
[04:04:46.959] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:48:0) after 8m31s
[04:13:18.026] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:48:0)
[04:13:18.053] Build status: STARTED
[04:13:18.053] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:49:0) after 8m59s
[04:22:17.073] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:49:0)
[04:22:17.107] Build status: STARTED
[04:22:17.107] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:50:0) after 9m4s
[04:31:21.132] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:50:0)
[04:31:21.164] Build status: STARTED
[04:31:21.164] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:51:0) after 2m35s
[04:33:56.214] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:51:0)
[04:33:56.246] Build status: STARTED
[04:33:56.246] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:52:0) after 7m44s
[04:41:40.264] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:52:0)
[04:41:40.321] Build status: STARTED
[04:41:40.321] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:53:0) after 5m56s
[04:47:36.339] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:53:0)
[04:47:36.401] Build status: STARTED
[04:47:36.401] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:54:0) after 1m1s
[04:48:37.421] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:54:0)
[04:48:37.447] Build status: STARTED
[04:48:37.447] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:55:0) after 4m5s
[04:52:42.475] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:55:0)
[04:52:42.508] Build status: STARTED
[04:52:42.508] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:56:0) after 2m36s
[04:55:18.529] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:56:0)
[04:55:18.555] Build status: STARTED
[04:55:18.555] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:57:0) after 1m44s
[04:57:02.581] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:57:0)
[04:57:02.608] Build status: STARTED
[04:57:02.608] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:58:0) after 1m38s
[04:58:40.627] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:58:0)
[04:58:40.670] Build status: STARTED
[04:58:40.670] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:59:0) after 2m30s
[05:01:10.695] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:59:0)
[05:01:10.746] Build status: STARTED
[05:01:10.746] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:60:0) after 5m29s
[05:06:39.765] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:60:0)
[05:06:39.858] Build status: STARTED
[05:06:39.858] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:61:0) after 3m55s
[05:10:34.982] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:61:0)
[05:10:35.087] Build status: STARTED
[05:10:35.087] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:62:0) after 4m29s
[05:15:04.178] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:62:0)
[05:15:04.209] Build status: STARTED
[05:15:04.209] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:63:0) after 9m51s
[05:24:55.273] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:63:0)
[05:24:55.298] Build status: STARTED
[05:24:55.298] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:64:0) after 2m14s
[05:27:09.374] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:64:0)
[05:27:09.400] Build status: STARTED
[05:27:09.400] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:65:0) after 7m17s
[05:34:26.422] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:65:0)
[05:34:26.448] Build status: STARTED
[05:34:26.448] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:66:0) after 9m30s
[05:43:56.467] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:66:0)
[05:43:56.495] Build status: STARTED
[05:43:56.495] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:67:0) after 8m30s
[05:52:26.504] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:67:0)
[05:52:26.537] Build status: STARTED
[05:52:26.537] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:68:0) after 8m40s
[06:01:06.597] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:68:0)
[06:01:06.646] Build status: STARTED
[06:01:06.646] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:69:0) after 1m24s
[06:02:30.833] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:69:0)
[06:02:30.862] Build status: STARTED
[06:02:30.862] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:70:0) after 1m55s
[06:04:25.883] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:70:0)
[06:04:25.915] Build status: STARTED
[06:04:25.915] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:71:0) after 1m53s
[06:06:19.039] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:71:0)
[06:06:19.084] Build status: STARTED
[06:06:19.084] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:72:0) after 3m53s
[06:10:12.147] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:72:0)
[06:10:12.176] Build status: STARTED
[06:10:12.176] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:73:0) after 9m5s
[06:19:17.271] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:73:0)
[06:19:17.299] Build status: STARTED
[06:19:17.299] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:74:0) after 3m21s
[06:22:38.355] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:74:0)
[06:22:38.380] Build status: STARTED
[06:22:38.380] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:75:0) after 7m47s
[06:30:25.401] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:75:0)
[06:30:25.428] Build status: STARTED
[06:30:25.428] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:76:0) after 7m38s
[06:38:03.491] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:76:0)
[06:38:03.517] Build status: STARTED
[06:38:03.517] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:77:0) after 6m10s
[06:44:13.538] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:77:0)
[06:44:13.565] Build status: STARTED
[06:44:13.565] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:78:0) after 4m14s
[06:48:27.687] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:78:0)
[06:48:27.716] Build status: STARTED
[06:48:27.716] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:79:0) after 2m1s
[06:50:28.738] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:79:0)
[06:50:28.765] Build status: STARTED
[06:50:28.765] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:80:0) after 9m58s
[07:00:26.872] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:80:0)
[07:00:26.909] Build status: STARTED
[07:00:26.909] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:81:0) after 8m10s
[07:08:37.293] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:81:0)
[07:08:38.036] Build status: STARTED
[07:08:38.036] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:82:0) after 2m3s
[07:10:41.185] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:82:0)
[07:10:41.256] Build status: STARTED
[07:10:41.256] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:83:0) after 5m44s
[07:16:25.458] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:83:0)
[07:16:25.514] Build status: STARTED
[07:16:25.514] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:84:0) after 5m40s
[07:22:05.538] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:84:0)
[07:22:05.568] Build status: STARTED
[07:22:05.568] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:85:0) after 1m53s
[07:23:58.603] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:85:0)
[07:23:58.633] Build status: STARTED
[07:23:58.633] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:86:0) after 7m45s
[07:31:43.837] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:86:0)
[07:31:43.864] Build status: STARTED
[07:31:43.864] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:87:0) after 4m52s
[07:36:35.887] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:87:0)
[07:36:35.916] Build status: STARTED
[07:36:35.916] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:88:0) after 3m21s
[07:39:57.032] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:88:0)
[07:39:57.057] Build status: STARTED
[07:39:57.057] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:89:0) after 2m9s
[07:42:06.076] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:89:0)
[07:42:06.105] Build status: STARTED
[07:42:06.105] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:90:0) after 6m19s
[07:48:25.224] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:90:0)
[07:48:25.268] Build status: STARTED
[07:48:25.268] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:91:0) after 3m22s
[07:51:47.290] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:91:0)
[07:51:47.376] Build status: STARTED
[07:51:47.376] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:92:0) after 3m39s
[07:55:26.413] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:92:0)
[07:55:26.523] Build status: STARTED
[07:55:26.523] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:93:0) after 1m8s
[07:56:34.549] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:93:0)
[07:56:34.577] Build status: STARTED
[07:56:34.577] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:94:0) after 5m1s
[08:01:35.866] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:94:0)
[08:01:35.897] Build status: STARTED
[08:01:35.897] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:95:0) after 6m39s
[08:08:14.912] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:95:0)
[08:08:14.955] Build status: STARTED
[08:08:14.955] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:96:0) after 8m27s
[08:16:42.023] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:96:0)
[08:16:42.062] Build status: STARTED
[08:16:42.062] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:97:0) after 7m29s
[08:24:11.082] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:97:0)
[08:24:11.123] Build status: STARTED
[08:24:11.123] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:98:0) after 7m53s
[08:32:04.145] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:98:0)
[08:32:04.217] Build status: STARTED
[08:32:04.217] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:99:0) after 6m2s
[08:38:06.324] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:99:0)
[08:38:06.368] Build status: STARTED
[08:38:06.368] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:100:0) after 9m37s
[08:47:43.605] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:100:0)
[08:47:43.665] Build status: STARTED
[08:47:43.665] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:101:0) after 5m40s
[08:53:23.690] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:101:0)
[08:53:23.725] Build status: STARTED
[08:53:23.725] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:102:0) after 9m55s
[09:03:18.761] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:102:0)
[09:03:18.799] Build status: STARTED
[09:03:18.799] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:103:0) after 3m50s
[09:07:08.927] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:103:0)
[09:07:08.973] Build status: STARTED
[09:07:08.973] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:104:0) after 6m3s
[09:13:12.043] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:104:0)
[09:13:12.224] Build status: STARTED
[09:13:12.224] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8997241439104584000:105:0) after 7m17s
[09:14:52.893] Received PubSub notification, asking Buildbucket for the build status
[09:14:52.922] Build:
{
  "id": "8831811377228665921",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTWin64PGO"
  },
  "number": 1686,
  "createdBy": "project:chromium",
  "createTime": "2021-11-01T00:09:04.400695059Z",
  "startTime": "2021-11-01T02:34:16.497948Z",
  "endTime": "2021-11-01T09:14:52.608846775Z",
  "updateTime": "2021-11-01T09:14:52.608846775Z",
  "status": "FAILURE",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "389cf5fd78b5c488a8503b6131436d86de282553",
      "ref": "refs/heads/main"
    }
  }
}
[09:14:52.922] Invocation finished in 9h5m49.695599404s with status FAILED