LUCI Scheduler :: chromium :: ToTWin64PGO

Status: FAILED

Triggered by: -

Duration: 10 hours

Actions:

Definition (rev e074ce6d087643bcc493cb2122b4c61db039574b)

buildbucket: <
  server: "cr-buildbucket.appspot.com"
  bucket: "luci.chromium.ci"
  builder: "ToTWin64PGO"
>

Incoming triggers

4b03fe2f764bea1fe543e1098acde1d8ccef6ca3 (3 years ago)
28deb50f6f3a0f6473437d32382ab1f038ac524f (3 years ago)
48fee0931e6ae7ee5152a7df79d610df0725c9f0 (3 years ago)
daa9262b8b34e53dcd2df959044a2c5af2875075 (3 years ago)
3b710f4e69f670611c9e9e8561b260c585165f9e (3 years ago)
2b8ada3c60839a49ca4f77011b6e0fb3d6df36e8 (3 years ago)
ff10d8b4fd8e9a5d658c98beb2e68e50b85eb5ad (3 years ago)
3344f4b6635536488a3ca10b6cb388f971e96ee0 (3 years ago)
2699c8d7f94d30e0fc920e177f29df3d114e6f0a (3 years ago)
2dfbc5b9d734b359c2f84e345ba322dfa7cc4853 (3 years ago)
4f7d70e98534aa729bf9f082f036c55eb0558fa7 (3 years ago)
0415967231e3ecb03620e714147e4a4fb074694c (3 years ago)
9968579623c0cef05ad2e07b8785d21bad909863 (3 years ago)
c8875725bc08fe384fea24925ae9e30ebb2de965 (3 years ago)
a2e169160f2323c4761626de51ecc79a14ed09a4 (3 years ago)
6a60ef7303e3accf95fc0ce40507208bd190564f (3 years ago)
75d9be06418cbde54a1c63ee42e284889b396b98 (3 years ago)

Incoming properties

{
  "branch": "refs/heads/main",
  "repository": "https://chromium.googlesource.com/chromium/src",
  "revision": "75d9be06418cbde54a1c63ee42e284889b396b98"
}

Incoming tags

buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/75d9be06418cbde54a1c63ee42e284889b396b98
gitiles_ref:refs/heads/main

Debug log (UTC)

[14:00:20.281] New invocation is queued and will start shortly
[14:00:21.386] Starting the invocation (attempt 1)
[14:00:21.452] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/75d9be06418cbde54a1c63ee42e284889b396b98"
[14:00:21.452] Popped gitiles commit info from properties and tags
[14:00:21.452] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[14:00:21.452] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[14:00:21.452] Buildbucket request:
{
  "requestId": "9007517193419458544",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTWin64PGO"
  },
  "properties": {
    },
  "gitilesCommit": {
    "host": "chromium.googlesource.com",
    "project": "chromium/src",
    "id": "75d9be06418cbde54a1c63ee42e284889b396b98",
    "ref": "refs/heads/main"
  },
  "tags": [
    {
      "key": "scheduler_invocation_id",
      "value": "9007517193419458544"
    },
    {
      "key": "scheduler_job_id",
      "value": "chromium/ToTWin64PGO"
    },
    {
      "key": "user_agent",
      "value": "luci-scheduler"
    }
  ],
  "notify": {
    "pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
  }
}
[14:00:22.229] Scheduled build:
{
  "id": "8842087131387601040",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTWin64PGO"
  },
  "number": 1070,
  "createdBy": "project:chromium",
  "createTime": "2021-07-10T14:00:21.577001Z",
  "updateTime": "2021-07-10T14:00:22.102912Z",
  "status": "SCHEDULED",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "75d9be06418cbde54a1c63ee42e284889b396b98",
      "ref": "refs/heads/main"
    }
  },
  "canary": true
}
[14:00:22.229] Task URL: https://cr-buildbucket.appspot.com/build/8842087131387601040
[14:00:22.229] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:2:0) after 2m42s
[14:01:00.705] Received PubSub notification, asking Buildbucket for the build status
[14:01:08.862] Build status: STARTED
[14:03:04.367] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:2:0)
[14:03:04.408] Build status: STARTED
[14:03:04.408] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:4:0) after 1m44s
[14:04:48.424] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:4:0)
[14:04:48.451] Build status: STARTED
[14:04:48.451] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:5:0) after 9m53s
[14:14:41.475] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:5:0)
[14:14:41.508] Build status: STARTED
[14:14:41.508] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:6:0) after 4m0s
[14:18:41.529] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:6:0)
[14:18:41.559] Build status: STARTED
[14:18:41.559] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:7:0) after 2m8s
[14:20:49.583] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:7:0)
[14:20:49.608] Build status: STARTED
[14:20:49.608] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:8:0) after 6m55s
[14:27:44.638] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:8:0)
[14:27:44.668] Build status: STARTED
[14:27:44.668] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:9:0) after 3m53s
[14:31:37.685] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:9:0)
[14:31:37.715] Build status: STARTED
[14:31:37.715] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:10:0) after 3m39s
[14:35:16.736] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:10:0)
[14:35:16.785] Build status: STARTED
[14:35:16.785] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:11:0) after 6m14s
[14:41:30.803] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:11:0)
[14:41:30.883] Build status: STARTED
[14:41:30.883] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:12:0) after 8m10s
[14:49:40.904] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:12:0)
[14:49:40.933] Build status: STARTED
[14:49:40.933] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:13:0) after 4m7s
[14:53:48.022] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:13:0)
[14:53:48.053] Build status: STARTED
[14:53:48.053] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:14:0) after 6m21s
[15:00:09.082] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:14:0)
[15:00:09.117] Build status: STARTED
[15:00:09.117] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:15:0) after 8m21s
[15:08:30.139] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:15:0)
[15:08:30.184] Build status: STARTED
[15:08:30.184] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:16:0) after 3m49s
[15:12:19.206] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:16:0)
[15:12:19.241] Build status: STARTED
[15:12:19.241] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:17:0) after 3m13s
[15:15:32.340] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:17:0)
[15:15:32.369] Build status: STARTED
[15:15:32.369] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:18:0) after 7m54s
[15:23:26.428] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:18:0)
[15:23:26.461] Build status: STARTED
[15:23:26.461] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:19:0) after 4m38s
[15:28:04.501] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:19:0)
[15:28:04.536] Build status: STARTED
[15:28:04.536] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:20:0) after 2m30s
[15:30:34.663] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:20:0)
[15:30:34.695] Build status: STARTED
[15:30:34.695] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:21:0) after 3m50s
[15:34:24.939] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:21:0)
[15:34:24.967] Build status: STARTED
[15:34:24.968] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:22:0) after 1m8s
[15:35:32.985] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:22:0)
[15:35:33.016] Build status: STARTED
[15:35:33.016] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:23:0) after 2m8s
[15:37:41.217] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:23:0)
[15:37:41.247] Build status: STARTED
[15:37:41.247] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:24:0) after 5m13s
[15:42:54.335] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:24:0)
[15:42:54.364] Build status: STARTED
[15:42:54.365] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:25:0) after 4m5s
[15:46:59.382] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:25:0)
[15:46:59.411] Build status: STARTED
[15:46:59.411] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:26:0) after 7m56s
[15:54:55.503] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:26:0)
[15:54:55.531] Build status: STARTED
[15:54:55.531] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:27:0) after 8m15s
[16:03:10.601] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:27:0)
[16:03:10.666] Build status: STARTED
[16:03:10.666] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:28:0) after 1m9s
[16:04:19.751] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:28:0)
[16:04:19.867] Build status: STARTED
[16:04:19.867] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:29:0) after 7m31s
[16:11:50.888] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:29:0)
[16:11:50.916] Build status: STARTED
[16:11:50.917] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:30:0) after 1m47s
[16:13:37.942] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:30:0)
[16:13:38.027] Build status: STARTED
[16:13:38.027] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:31:0) after 8m27s
[16:22:05.171] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:31:0)
[16:22:05.226] Build status: STARTED
[16:22:05.226] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:32:0) after 5m35s
[16:27:40.248] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:32:0)
[16:27:40.319] Build status: STARTED
[16:27:40.319] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:33:0) after 6m10s
[16:33:50.606] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:33:0)
[16:33:50.641] Build status: STARTED
[16:33:50.641] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:34:0) after 7m40s
[16:41:56.146] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:34:0)
[16:41:56.195] Build status: STARTED
[16:41:56.195] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:35:0) after 1m57s
[16:43:53.223] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:35:0)
[16:43:53.259] Build status: STARTED
[16:43:53.259] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:36:0) after 5m44s
[16:49:37.280] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:36:0)
[16:49:37.351] Build status: STARTED
[16:49:37.351] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:37:0) after 8m38s
[16:58:15.374] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:37:0)
[16:58:15.458] Build status: STARTED
[16:58:15.458] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:38:0) after 9m29s
[17:07:44.561] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:38:0)
[17:07:44.629] Build status: STARTED
[17:07:44.629] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:39:0) after 7m0s
[17:14:45.494] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:39:0)
[17:14:45.525] Build status: STARTED
[17:14:45.525] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:40:0) after 8m35s
[17:23:20.549] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:40:0)
[17:23:20.582] Build status: STARTED
[17:23:20.582] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:41:0) after 6m2s
[17:29:22.612] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:41:0)
[17:29:22.644] Build status: STARTED
[17:29:22.644] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:42:0) after 6m22s
[17:35:44.764] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:42:0)
[17:35:44.797] Build status: STARTED
[17:35:44.797] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:43:0) after 5m21s
[17:41:06.152] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:43:0)
[17:41:06.199] Build status: STARTED
[17:41:06.199] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:44:0) after 3m15s
[17:44:21.221] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:44:0)
[17:44:21.254] Build status: STARTED
[17:44:21.254] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:45:0) after 8m45s
[17:53:06.410] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:45:0)
[17:53:06.441] Build status: STARTED
[17:53:06.441] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:46:0) after 7m4s
[18:00:11.005] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:46:0)
[18:00:11.038] Build status: STARTED
[18:00:11.038] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:47:0) after 9m38s
[18:09:49.262] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:47:0)
[18:09:49.292] Build status: STARTED
[18:09:49.292] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:48:0) after 3m7s
[18:12:56.483] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:48:0)
[18:12:56.516] Build status: STARTED
[18:12:56.516] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:49:0) after 8m10s
[18:21:06.547] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:49:0)
[18:21:06.578] Build status: STARTED
[18:21:06.578] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:50:0) after 6m20s
[18:27:26.598] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:50:0)
[18:27:26.646] Build status: STARTED
[18:27:26.646] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:51:0) after 4m49s
[18:32:16.096] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:51:0)
[18:32:16.158] Build status: STARTED
[18:32:16.158] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:52:0) after 9m34s
[18:41:50.185] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:52:0)
[18:41:50.211] Build status: STARTED
[18:41:50.211] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:53:0) after 7m3s
[18:48:53.235] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:53:0)
[18:48:53.272] Build status: STARTED
[18:48:53.272] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:54:0) after 4m44s
[18:53:37.330] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:54:0)
[18:53:37.376] Build status: STARTED
[18:53:37.376] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:55:0) after 3m35s
[18:57:12.399] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:55:0)
[18:57:12.437] Build status: STARTED
[18:57:12.437] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:56:0) after 9m16s
[19:06:28.464] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:56:0)
[19:06:29.906] Build status: STARTED
[19:06:29.906] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:57:0) after 7m21s
[19:13:51.317] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:57:0)
[19:13:51.346] Build status: STARTED
[19:13:51.346] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:58:0) after 9m18s
[19:23:09.571] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:58:0)
[19:23:09.610] Build status: STARTED
[19:23:09.610] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:59:0) after 3m25s
[19:26:34.632] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:59:0)
[19:26:34.663] Build status: STARTED
[19:26:34.663] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:60:0) after 1m18s
[19:27:52.849] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:60:0)
[19:27:52.882] Build status: STARTED
[19:27:52.882] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:61:0) after 3m48s
[19:31:41.035] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:61:0)
[19:31:41.065] Build status: STARTED
[19:31:41.065] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:62:0) after 9m1s
[19:40:42.176] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:62:0)
[19:40:42.296] Build status: STARTED
[19:40:42.296] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:63:0) after 8m16s
[19:48:58.315] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:63:0)
[19:48:58.344] Build status: STARTED
[19:48:58.344] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:64:0) after 1m47s
[19:50:45.366] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:64:0)
[19:50:45.404] Build status: STARTED
[19:50:45.404] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:65:0) after 4m8s
[19:54:53.445] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:65:0)
[19:54:53.485] Build status: STARTED
[19:54:53.485] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:66:0) after 6m6s
[20:01:00.401] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:66:0)
[20:01:00.428] Build status: STARTED
[20:01:00.428] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:67:0) after 8m13s
[20:09:13.460] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:67:0)
[20:09:13.504] Build status: STARTED
[20:09:13.504] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:68:0) after 4m57s
[20:14:10.529] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:68:0)
[20:14:10.573] Build status: STARTED
[20:14:10.573] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:69:0) after 2m36s
[20:16:46.788] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:69:0)
[20:16:46.817] Build status: STARTED
[20:16:46.817] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:70:0) after 3m14s
[20:20:01.210] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:70:0)
[20:20:01.242] Build status: STARTED
[20:20:01.242] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:71:0) after 6m35s
[20:26:36.266] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:71:0)
[20:26:36.294] Build status: STARTED
[20:26:36.294] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:72:0) after 5m39s
[20:32:15.379] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:72:0)
[20:32:15.428] Build status: STARTED
[20:32:15.428] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:73:0) after 5m28s
[20:37:43.598] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:73:0)
[20:37:43.669] Build status: STARTED
[20:37:43.669] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:74:0) after 3m50s
[20:41:33.693] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:74:0)
[20:41:33.728] Build status: STARTED
[20:41:33.728] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:75:0) after 8m8s
[20:49:42.138] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:75:0)
[20:49:42.182] Build status: STARTED
[20:49:42.182] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:76:0) after 9m7s
[20:58:49.260] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:76:0)
[20:58:49.291] Build status: STARTED
[20:58:49.291] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:77:0) after 3m9s
[21:01:58.420] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:77:0)
[21:01:58.459] Build status: STARTED
[21:01:58.459] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:78:0) after 2m9s
[21:04:07.491] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:78:0)
[21:04:07.525] Build status: STARTED
[21:04:07.525] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:79:0) after 3m55s
[21:08:02.545] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:79:0)
[21:08:02.571] Build status: STARTED
[21:08:02.571] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:80:0) after 8m22s
[21:16:24.642] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:80:0)
[21:16:24.677] Build status: STARTED
[21:16:24.677] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:81:0) after 3m31s
[21:19:55.698] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:81:0)
[21:19:55.725] Build status: STARTED
[21:19:55.725] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:82:0) after 6m46s
[21:26:41.747] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:82:0)
[21:26:41.781] Build status: STARTED
[21:26:41.781] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:83:0) after 9m42s
[21:36:23.943] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:83:0)
[21:36:23.980] Build status: STARTED
[21:36:23.980] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:84:0) after 5m57s
[21:42:21.011] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:84:0)
[21:42:21.040] Build status: STARTED
[21:42:21.040] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:85:0) after 8m25s
[21:50:46.517] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:85:0)
[21:50:46.545] Build status: STARTED
[21:50:46.545] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:86:0) after 6m55s
[21:57:41.880] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:86:0)
[21:57:41.919] Build status: STARTED
[21:57:41.919] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:87:0) after 6m21s
[22:04:02.949] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:87:0)
[22:04:02.988] Build status: STARTED
[22:04:02.988] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:88:0) after 5m35s
[22:09:38.081] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:88:0)
[22:09:38.111] Build status: STARTED
[22:09:38.111] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:89:0) after 7m37s
[22:17:15.132] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:89:0)
[22:17:15.167] Build status: STARTED
[22:17:15.167] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:90:0) after 3m11s
[22:20:26.252] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:90:0)
[22:20:26.281] Build status: STARTED
[22:20:26.282] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:91:0) after 9m0s
[22:29:26.559] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:91:0)
[22:29:26.594] Build status: STARTED
[22:29:26.594] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:92:0) after 1m34s
[22:31:00.997] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:92:0)
[22:31:01.368] Build status: STARTED
[22:31:01.368] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:93:0) after 5m19s
[22:36:20.398] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:93:0)
[22:36:20.432] Build status: STARTED
[22:36:20.432] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:94:0) after 2m40s
[22:39:01.177] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:94:0)
[22:39:01.211] Build status: STARTED
[22:39:01.211] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:95:0) after 7m54s
[22:46:55.924] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:95:0)
[22:46:55.951] Build status: STARTED
[22:46:55.951] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:96:0) after 2m42s
[22:49:38.210] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:96:0)
[22:49:38.241] Build status: STARTED
[22:49:38.241] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:97:0) after 2m3s
[22:51:41.269] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:97:0)
[22:51:41.299] Build status: STARTED
[22:51:41.299] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:98:0) after 6m8s
[22:57:49.320] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:98:0)
[22:57:49.348] Build status: STARTED
[22:57:49.348] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:99:0) after 8m34s
[23:06:23.446] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:99:0)
[23:06:23.474] Build status: STARTED
[23:06:23.474] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:100:0) after 6m54s
[23:13:17.494] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:100:0)
[23:13:17.529] Build status: STARTED
[23:13:17.529] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:101:0) after 2m34s
[23:15:51.844] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:101:0)
[23:15:52.146] Build status: STARTED
[23:15:52.146] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:102:0) after 3m14s
[23:19:06.174] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:102:0)
[23:19:06.204] Build status: STARTED
[23:19:06.204] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:103:0) after 9m3s
[23:28:09.229] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:103:0)
[23:28:09.256] Build status: STARTED
[23:28:09.256] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:104:0) after 1m0s
[23:29:09.276] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:104:0)
[23:29:09.353] Build status: STARTED
[23:29:09.353] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:105:0) after 3m10s
[23:32:19.374] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:105:0)
[23:32:19.404] Build status: STARTED
[23:32:19.404] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:106:0) after 6m18s
[23:38:37.422] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:106:0)
[23:38:37.456] Build status: STARTED
[23:38:37.456] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:107:0) after 4m42s
[23:43:19.499] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:107:0)
[23:43:19.527] Build status: STARTED
[23:43:19.527] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:108:0) after 6m38s
[23:49:57.620] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:108:0)
[23:49:57.646] Build status: STARTED
[23:49:57.646] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:109:0) after 5m18s
[23:55:15.704] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:109:0)
[23:55:15.740] Build status: STARTED
[23:55:15.740] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:110:0) after 9m49s
[00:05:04.779] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:110:0)
[00:05:04.838] Build status: STARTED
[00:05:04.838] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:111:0) after 2m16s
[00:07:21.025] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:111:0)
[00:07:21.074] Build status: STARTED
[00:07:21.074] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:9007517193419458544:112:0) after 2m31s
[00:07:41.674] Received PubSub notification, asking Buildbucket for the build status
[00:07:41.721] Build:
{
  "id": "8842087131387601040",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTWin64PGO"
  },
  "number": 1070,
  "createdBy": "project:chromium",
  "createTime": "2021-07-10T14:00:21.577001Z",
  "startTime": "2021-07-10T14:01:00.085749Z",
  "endTime": "2021-07-11T00:07:41.334389634Z",
  "updateTime": "2021-07-11T00:07:41.334893047Z",
  "status": "FAILURE",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "75d9be06418cbde54a1c63ee42e284889b396b98",
      "ref": "refs/heads/main"
    }
  },
  "canary": true
}
[00:07:41.721] Invocation finished in 10h7m21.465027993s with status FAILED