LUCI Scheduler :: chromium :: ToTWin64PGO

Status: FAILED

Triggered by: -

Duration: 9 hours

Actions:

Definition (rev 36bc28844ffd5e030af6e41e2e0e4ddc5c92b699)

buildbucket: <
  server: "cr-buildbucket.appspot.com"
  bucket: "ci"
  builder: "ToTWin64PGO"
>

Incoming triggers

561bb75d71b692cf75292ea7ef22f19bff6133f5 (2 years ago)
5e9f6e86ac6357646cb670a74e253f0024672ed6 (2 years ago)
2b22cf46ac74d4641fd0e59fc0319aa387fe5484 (2 years ago)
28580f2edf19ba9f86458bf86f0369e9adf6a5fe (2 years ago)
3472688b3d302ecff387dc8aa4e9be3eb4a50f8d (2 years ago)
141c049b41b010bc0d54c818dee5b793da5c7e2c (2 years ago)
254e0e452a2de9202eb17e463ded32fe5ceebc62 (2 years ago)
7b9d5e2ef76ba6a54eb3d3ceef826410e2d41838 (2 years ago)
f12dac0bfd72824e84ef47fd3c49379c95727a30 (2 years ago)
3ccf32af2e5df475592e7a76eaa1e599cef4157a (2 years ago)
f62a013d5db180aa37fd34c5ce5435692031490b (2 years ago)
977178734ef9810c3d827b818ee6ce67a5cae422 (2 years ago)
94f0e79435b8dabe6830ae672b04184fe86f954b (2 years ago)
8d8c07aabdebd41d233cbf5e6b90e037e81fa6f9 (2 years ago)
c278244583e0b0baeff2884f1351863581241fe4 (2 years ago)
4365dddb49847a422bce674383b4aa4f38ff9e89 (2 years ago)
8cefebf0166d59b517b9a0628f71ca9fc6b6a7f3 (2 years ago)
fd288fedc52c2176dc8f171166db8fe7d3139fb3 (2 years ago)
578743fc1a2fc15aaaf100a1e8543b91d48a437a (2 years ago)

Incoming properties

{
  "branch": "refs/heads/main",
  "repository": "https://chromium.googlesource.com/chromium/src",
  "revision": "578743fc1a2fc15aaaf100a1e8543b91d48a437a"
}

Incoming tags

buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/578743fc1a2fc15aaaf100a1e8543b91d48a437a
gitiles_ref:refs/heads/main

Debug log (UTC)

[05:41:33.118] New invocation is queued and will start shortly
[05:41:34.372] Starting the invocation (attempt 1)
[05:41:34.418] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/578743fc1a2fc15aaaf100a1e8543b91d48a437a"
[05:41:34.418] Popped gitiles commit info from properties and tags
[05:41:34.418] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[05:41:34.418] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[05:41:34.418] Buildbucket request:
{
  "requestId": "8963699642575606544",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTWin64PGO"
  },
  "properties": {
    },
  "gitilesCommit": {
    "host": "chromium.googlesource.com",
    "project": "chromium/src",
    "id": "578743fc1a2fc15aaaf100a1e8543b91d48a437a",
    "ref": "refs/heads/main"
  },
  "tags": [
    {
      "key": "scheduler_invocation_id",
      "value": "8963699642575606544"
    },
    {
      "key": "scheduler_job_id",
      "value": "chromium/ToTWin64PGO"
    },
    {
      "key": "user_agent",
      "value": "luci-scheduler"
    }
  ],
  "notify": {
    "pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
  }
}
[05:41:34.860] Scheduled build:
{
  "id": "8798269580453663697",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTWin64PGO"
  },
  "number": 4012,
  "createdBy": "project:chromium",
  "createTime": "2022-11-06T05:41:34.510010740Z",
  "updateTime": "2022-11-06T05:41:34.510010740Z",
  "status": "SCHEDULED",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "578743fc1a2fc15aaaf100a1e8543b91d48a437a",
      "ref": "refs/heads/main"
    }
  }
}
[05:41:34.860] Task URL: https://cr-buildbucket.appspot.com/build/8798269580453663697
[05:41:34.860] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:2:0) after 6m45s
[05:44:50.909] Received PubSub notification, asking Buildbucket for the build status
[05:44:50.971] Build status: STARTED
[05:48:19.907] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:2:0)
[05:48:19.945] Build status: STARTED
[05:48:19.945] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:4:0) after 9m12s
[05:57:31.965] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:4:0)
[05:57:32.029] Build status: STARTED
[05:57:32.029] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:5:0) after 7m43s
[06:05:15.066] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:5:0)
[06:05:15.095] Build status: STARTED
[06:05:15.095] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:6:0) after 1m31s
[06:06:46.123] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:6:0)
[06:06:46.151] Build status: STARTED
[06:06:46.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:7:0) after 9m16s
[06:16:02.200] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:7:0)
[06:16:02.235] Build status: STARTED
[06:16:02.235] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:8:0) after 7m1s
[06:23:03.538] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:8:0)
[06:23:03.562] Build status: STARTED
[06:23:03.562] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:9:0) after 4m28s
[06:27:31.663] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:9:0)
[06:27:31.685] Build status: STARTED
[06:27:31.685] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:10:0) after 2m52s
[06:30:24.077] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:10:0)
[06:30:24.104] Build status: STARTED
[06:30:24.104] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:11:0) after 7m40s
[06:38:04.524] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:11:0)
[06:38:04.550] Build status: STARTED
[06:38:04.550] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:12:0) after 6m52s
[06:44:56.973] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:12:0)
[06:44:57.006] Build status: STARTED
[06:44:57.006] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:13:0) after 2m49s
[06:47:46.026] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:13:0)
[06:47:46.091] Build status: STARTED
[06:47:46.091] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:14:0) after 5m38s
[06:53:25.515] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:14:0)
[06:53:25.545] Build status: STARTED
[06:53:25.545] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:15:0) after 5m50s
[06:59:15.715] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:15:0)
[06:59:15.735] Build status: STARTED
[06:59:15.735] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:16:0) after 1m32s
[07:00:47.729] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:16:0)
[07:00:47.765] Build status: STARTED
[07:00:47.765] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:17:0) after 9m37s
[07:10:24.954] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:17:0)
[07:10:24.979] Build status: STARTED
[07:10:24.979] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:18:0) after 4m4s
[07:14:28.999] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:18:0)
[07:14:29.059] Build status: STARTED
[07:14:29.059] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:19:0) after 2m11s
[07:16:40.087] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:19:0)
[07:16:40.121] Build status: STARTED
[07:16:40.121] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:20:0) after 5m57s
[07:22:37.148] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:20:0)
[07:22:37.177] Build status: STARTED
[07:22:37.177] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:21:0) after 3m9s
[07:25:46.241] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:21:0)
[07:25:46.267] Build status: STARTED
[07:25:46.267] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:22:0) after 8m57s
[07:34:43.397] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:22:0)
[07:34:43.466] Build status: STARTED
[07:34:43.466] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:23:0) after 2m34s
[07:37:17.485] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:23:0)
[07:37:17.510] Build status: STARTED
[07:37:17.510] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:24:0) after 7m23s
[07:44:40.528] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:24:0)
[07:44:40.620] Build status: STARTED
[07:44:40.620] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:25:0) after 4m26s
[07:49:06.643] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:25:0)
[07:49:06.666] Build status: STARTED
[07:49:06.666] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:26:0) after 4m31s
[07:53:37.699] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:26:0)
[07:53:37.726] Build status: STARTED
[07:53:37.726] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:27:0) after 1m10s
[07:54:47.847] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:27:0)
[07:54:47.875] Build status: STARTED
[07:54:47.876] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:28:0) after 6m7s
[08:00:54.903] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:28:0)
[08:00:54.930] Build status: STARTED
[08:00:54.931] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:29:0) after 8m39s
[08:09:33.961] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:29:0)
[08:09:34.002] Build status: STARTED
[08:09:34.002] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:30:0) after 9m18s
[08:18:52.170] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:30:0)
[08:18:52.219] Build status: STARTED
[08:18:52.219] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:31:0) after 3m39s
[08:22:31.327] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:31:0)
[08:22:31.350] Build status: STARTED
[08:22:31.350] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:32:0) after 4m19s
[08:26:50.702] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:32:0)
[08:26:50.727] Build status: STARTED
[08:26:50.727] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:33:0) after 1m23s
[08:28:14.631] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:33:0)
[08:28:14.656] Build status: STARTED
[08:28:14.656] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:34:0) after 4m25s
[08:32:39.669] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:34:0)
[08:32:39.689] Build status: STARTED
[08:32:39.689] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:35:0) after 6m5s
[08:38:44.711] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:35:0)
[08:38:44.734] Build status: STARTED
[08:38:44.734] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:36:0) after 8m20s
[08:47:04.765] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:36:0)
[08:47:04.798] Build status: STARTED
[08:47:04.798] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:37:0) after 7m56s
[08:55:00.873] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:37:0)
[08:55:00.900] Build status: STARTED
[08:55:00.900] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:38:0) after 5m43s
[09:00:43.931] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:38:0)
[09:00:43.964] Build status: STARTED
[09:00:43.964] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:39:0) after 9m5s
[09:09:49.181] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:39:0)
[09:09:49.203] Build status: STARTED
[09:09:49.203] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:40:0) after 4m56s
[09:14:45.388] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:40:0)
[09:14:45.421] Build status: STARTED
[09:14:45.421] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:41:0) after 2m53s
[09:17:39.053] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:41:0)
[09:17:39.078] Build status: STARTED
[09:17:39.078] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:42:0) after 4m12s
[09:21:51.166] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:42:0)
[09:21:51.196] Build status: STARTED
[09:21:51.196] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:43:0) after 8m32s
[09:30:23.415] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:43:0)
[09:30:23.446] Build status: STARTED
[09:30:23.446] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:44:0) after 2m15s
[09:32:39.471] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:44:0)
[09:32:39.490] Build status: STARTED
[09:32:39.490] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:45:0) after 2m27s
[09:35:06.629] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:45:0)
[09:35:06.652] Build status: STARTED
[09:35:06.652] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:46:0) after 1m56s
[09:37:02.676] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:46:0)
[09:37:02.699] Build status: STARTED
[09:37:02.699] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:47:0) after 1m51s
[09:38:53.822] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:47:0)
[09:38:53.847] Build status: STARTED
[09:38:53.847] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:48:0) after 9m7s
[09:48:00.870] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:48:0)
[09:48:00.988] Build status: STARTED
[09:48:00.988] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:49:0) after 8m5s
[09:56:06.013] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:49:0)
[09:56:06.038] Build status: STARTED
[09:56:06.038] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:50:0) after 8m7s
[10:04:13.068] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:50:0)
[10:04:13.096] Build status: STARTED
[10:04:13.096] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:51:0) after 5m30s
[10:09:43.386] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:51:0)
[10:09:43.410] Build status: STARTED
[10:09:43.410] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:52:0) after 3m4s
[10:12:47.453] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:52:0)
[10:12:47.477] Build status: STARTED
[10:12:47.477] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:53:0) after 2m0s
[10:14:47.861] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:53:0)
[10:14:47.884] Build status: STARTED
[10:14:47.884] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:54:0) after 8m38s
[10:23:25.908] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:54:0)
[10:23:25.929] Build status: STARTED
[10:23:25.929] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:55:0) after 2m20s
[10:25:45.950] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:55:0)
[10:25:45.974] Build status: STARTED
[10:25:45.974] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:56:0) after 6m18s
[10:32:04.019] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:56:0)
[10:32:04.046] Build status: STARTED
[10:32:04.046] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:57:0) after 5m6s
[10:37:10.074] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:57:0)
[10:37:10.098] Build status: STARTED
[10:37:10.098] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:58:0) after 5m41s
[10:42:51.252] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:58:0)
[10:42:51.278] Build status: STARTED
[10:42:51.278] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:59:0) after 2m29s
[10:45:20.473] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:59:0)
[10:45:20.496] Build status: STARTED
[10:45:20.496] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:60:0) after 3m32s
[10:48:53.066] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:60:0)
[10:48:53.094] Build status: STARTED
[10:48:53.094] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:61:0) after 5m44s
[10:54:37.269] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:61:0)
[10:54:37.294] Build status: STARTED
[10:54:37.294] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:62:0) after 3m23s
[10:58:00.939] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:62:0)
[10:58:00.963] Build status: STARTED
[10:58:00.963] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:63:0) after 3m25s
[11:01:26.388] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:63:0)
[11:01:26.488] Build status: STARTED
[11:01:26.488] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:64:0) after 4m17s
[11:05:43.512] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:64:0)
[11:05:43.537] Build status: STARTED
[11:05:43.537] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:65:0) after 5m3s
[11:10:46.866] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:65:0)
[11:10:46.891] Build status: STARTED
[11:10:46.891] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:66:0) after 5m20s
[11:16:06.975] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:66:0)
[11:16:07.003] Build status: STARTED
[11:16:07.003] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:67:0) after 9m15s
[11:25:22.027] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:67:0)
[11:25:22.061] Build status: STARTED
[11:25:22.061] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:68:0) after 1m48s
[11:27:10.134] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:68:0)
[11:27:10.160] Build status: STARTED
[11:27:10.160] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:69:0) after 1m1s
[11:28:11.185] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:69:0)
[11:28:11.238] Build status: STARTED
[11:28:11.238] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:70:0) after 8m54s
[11:37:05.260] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:70:0)
[11:37:05.290] Build status: STARTED
[11:37:05.290] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:71:0) after 3m53s
[11:40:58.315] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:71:0)
[11:40:58.349] Build status: STARTED
[11:40:58.349] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:72:0) after 7m16s
[11:48:14.371] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:72:0)
[11:48:14.396] Build status: STARTED
[11:48:14.396] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:73:0) after 1m4s
[11:49:18.420] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:73:0)
[11:49:18.443] Build status: STARTED
[11:49:18.443] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:74:0) after 3m15s
[11:52:33.699] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:74:0)
[11:52:33.722] Build status: STARTED
[11:52:33.722] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:75:0) after 3m13s
[11:55:46.847] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:75:0)
[11:55:46.874] Build status: STARTED
[11:55:46.875] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:76:0) after 5m2s
[12:00:49.182] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:76:0)
[12:00:49.204] Build status: STARTED
[12:00:49.204] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:77:0) after 4m37s
[12:05:26.536] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:77:0)
[12:05:26.561] Build status: STARTED
[12:05:26.561] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:78:0) after 6m2s
[12:11:28.583] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:78:0)
[12:11:28.608] Build status: STARTED
[12:11:28.608] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:79:0) after 3m37s
[12:15:05.719] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:79:0)
[12:15:05.743] Build status: STARTED
[12:15:05.743] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:80:0) after 4m54s
[12:19:59.779] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:80:0)
[12:19:59.803] Build status: STARTED
[12:19:59.803] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:81:0) after 2m36s
[12:22:35.787] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:81:0)
[12:22:35.808] Build status: STARTED
[12:22:35.808] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:82:0) after 2m13s
[12:24:49.047] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:82:0)
[12:24:49.073] Build status: STARTED
[12:24:49.073] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:83:0) after 8m40s
[12:33:29.095] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:83:0)
[12:33:29.118] Build status: STARTED
[12:33:29.119] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:84:0) after 3m46s
[12:37:15.145] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:84:0)
[12:37:15.169] Build status: STARTED
[12:37:15.169] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:85:0) after 6m56s
[12:44:11.194] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:85:0)
[12:44:11.216] Build status: STARTED
[12:44:11.216] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:86:0) after 8m16s
[12:52:27.241] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:86:0)
[12:52:27.262] Build status: STARTED
[12:52:27.262] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:87:0) after 1m29s
[12:53:56.374] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:87:0)
[12:53:56.401] Build status: STARTED
[12:53:56.401] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:88:0) after 3m45s
[12:57:41.424] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:88:0)
[12:57:41.444] Build status: STARTED
[12:57:41.445] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:89:0) after 8m46s
[13:06:27.479] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:89:0)
[13:06:27.505] Build status: STARTED
[13:06:27.505] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:90:0) after 3m56s
[13:10:23.533] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:90:0)
[13:10:23.585] Build status: STARTED
[13:10:23.585] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:91:0) after 9m39s
[13:20:02.608] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:91:0)
[13:20:02.638] Build status: STARTED
[13:20:02.638] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:92:0) after 3m47s
[13:23:49.668] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:92:0)
[13:23:49.689] Build status: STARTED
[13:23:49.689] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:93:0) after 7m29s
[13:31:18.717] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:93:0)
[13:31:18.740] Build status: STARTED
[13:31:18.740] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:94:0) after 1m58s
[13:33:16.764] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:94:0)
[13:33:16.796] Build status: STARTED
[13:33:16.796] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:95:0) after 9m39s
[13:42:56.311] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:95:0)
[13:42:56.331] Build status: STARTED
[13:42:56.331] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:96:0) after 8m10s
[13:51:06.350] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:96:0)
[13:51:06.374] Build status: STARTED
[13:51:06.374] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:97:0) after 9m38s
[14:00:44.496] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:97:0)
[14:00:44.524] Build status: STARTED
[14:00:44.524] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:98:0) after 2m26s
[14:03:10.556] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:98:0)
[14:03:10.675] Build status: STARTED
[14:03:10.675] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:99:0) after 7m56s
[14:11:06.823] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:99:0)
[14:11:06.854] Build status: STARTED
[14:11:06.854] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:100:0) after 8m23s
[14:19:29.877] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:100:0)
[14:19:29.902] Build status: STARTED
[14:19:29.902] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:101:0) after 5m42s
[14:25:11.908] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:101:0)
[14:25:11.932] Build status: STARTED
[14:25:11.932] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:102:0) after 6m52s
[14:32:04.095] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:102:0)
[14:32:04.123] Build status: STARTED
[14:32:04.123] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:103:0) after 7m48s
[14:39:52.145] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:103:0)
[14:39:52.171] Build status: STARTED
[14:39:52.171] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:104:0) after 5m4s
[14:44:56.259] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:104:0)
[14:44:56.290] Build status: STARTED
[14:44:56.290] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:105:0) after 1m42s
[14:46:38.411] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:105:0)
[14:46:38.434] Build status: STARTED
[14:46:38.434] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:106:0) after 6m11s
[14:52:49.456] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:106:0)
[14:52:49.480] Build status: STARTED
[14:52:49.480] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:107:0) after 7m14s
[15:00:03.512] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:107:0)
[15:00:03.536] Build status: STARTED
[15:00:03.536] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:108:0) after 3m57s
[15:04:00.991] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:108:0)
[15:04:01.075] Build status: STARTED
[15:04:01.075] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:109:0) after 1m47s
[15:05:48.594] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:109:0)
[15:05:48.619] Build status: STARTED
[15:05:48.619] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:110:0) after 4m19s
[15:10:07.678] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:110:0)
[15:10:07.714] Build status: STARTED
[15:10:07.714] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8963699642575606544:111:0) after 7m44s
[15:16:24.316] Received PubSub notification, asking Buildbucket for the build status
[15:16:24.343] Build:
{
  "id": "8798269580453663697",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTWin64PGO"
  },
  "number": 4012,
  "createdBy": "project:chromium",
  "createTime": "2022-11-06T05:41:34.510010740Z",
  "startTime": "2022-11-06T05:44:50.446057Z",
  "endTime": "2022-11-06T15:16:24.104260206Z",
  "updateTime": "2022-11-06T15:16:24.104260206Z",
  "status": "FAILURE",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "578743fc1a2fc15aaaf100a1e8543b91d48a437a",
      "ref": "refs/heads/main"
    }
  }
}
[15:16:24.343] Invocation finished in 9h34m51.24042956s with status FAILED