LUCI Scheduler :: chromium :: Windows Cross deterministic

Status: FAILED

Triggered by: -

Duration: 8 hours

Actions:

Definition (rev 7e7ca5cd047c45b3be7281cd6c03a9eb5b0edf34)

buildbucket: <
  server: "cr-buildbucket.appspot.com"
  bucket: "reclient"
  builder: "Windows Cross deterministic"
>

Incoming triggers

3322a1165e8b8f55ce69232855214966ff0aac7a (2 months ago)
3f78a78e0127e83136728bd3f312ff0d16f46b4b (2 months ago)
40eec21f2aa8cd3aa99b510f3fea8d434f205b4e (2 months ago)
6b0184471e393034f0ff53926008f199abdbbb5d (2 months ago)
1554d16a029008d955f7bd00057cdf556b1d369c (2 months ago)
945501c8f198102dd041c9c8be0b5dcb7a221d14 (2 months ago)
6f6a726cdd4a6b64fdd412b6425e7a02aef8f02e (2 months ago)
7f042a58f92eeeb5f557a6502e286fad13c222d2 (2 months ago)
f6dc74c34c4b5e70692d9a212b9eee2526c2d47a (2 months ago)
c0e26d84523e91e2b06af1e3bd75895f51bc1511 (2 months ago)
7234b40f08856d596edf27de9f54c58a96cc885d (2 months ago)
443452b2d2f2311122c718a8d524a90e5ce3da8f (2 months ago)

Incoming properties

{
  "branch": "refs/heads/main",
  "repository": "https://chromium.googlesource.com/chromium/src",
  "revision": "443452b2d2f2311122c718a8d524a90e5ce3da8f"
}

Incoming tags

buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/443452b2d2f2311122c718a8d524a90e5ce3da8f
gitiles_ref:refs/heads/main

Debug log (UTC)

[13:54:17.013] New invocation is queued and will start shortly
[13:54:18.127] Starting the invocation (attempt 1)
[13:54:18.151] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/443452b2d2f2311122c718a8d524a90e5ce3da8f"
[13:54:18.151] Popped gitiles commit info from properties and tags
[13:54:18.151] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[13:54:18.151] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[13:54:18.151] Buildbucket request:
{
  "requestId": "8896445693515535904",
  "builder": {
    "project": "chromium",
    "bucket": "reclient",
    "builder": "Windows Cross deterministic"
  },
  "properties": {
    },
  "gitilesCommit": {
    "host": "chromium.googlesource.com",
    "project": "chromium/src",
    "id": "443452b2d2f2311122c718a8d524a90e5ce3da8f",
    "ref": "refs/heads/main"
  },
  "tags": [
    {
      "key": "scheduler_invocation_id",
      "value": "8896445693515535904"
    },
    {
      "key": "scheduler_job_id",
      "value": "chromium/Windows Cross deterministic"
    },
    {
      "key": "user_agent",
      "value": "luci-scheduler"
    }
  ],
  "notify": {
    "pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
  }
}
[13:54:18.642] Scheduled build:
{
  "id": "8731015631604742833",
  "builder": {
    "project": "chromium",
    "bucket": "reclient",
    "builder": "Windows Cross deterministic"
  },
  "number": 2967,
  "createdBy": "project:chromium",
  "createTime": "2024-11-17T13:54:18.205774307Z",
  "updateTime": "2024-11-17T13:54:18.205774307Z",
  "status": "SCHEDULED",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "443452b2d2f2311122c718a8d524a90e5ce3da8f",
      "ref": "refs/heads/main"
    }
  },
  "canary": true
}
[13:54:18.642] Task URL: https://cr-buildbucket.appspot.com/build/8731015631604742833
[13:54:18.642] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:2:0) after 8m11s
[13:54:19.604] Received PubSub notification, asking Buildbucket for the build status
[13:54:19.619] Build status: SCHEDULED
[14:02:29.663] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:2:0)
[14:02:29.691] Build status: SCHEDULED
[14:02:29.691] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:4:0) after 2m12s
[14:04:41.933] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:4:0)
[14:04:42.130] Build status: SCHEDULED
[14:04:42.130] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:5:0) after 6m50s
[14:11:32.343] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:5:0)
[14:11:32.361] Build status: SCHEDULED
[14:11:32.361] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:6:0) after 6m35s
[14:15:44.185] Received PubSub notification, asking Buildbucket for the build status
[14:15:44.263] Build status: STARTED
[14:18:07.380] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:6:0)
[14:18:07.445] Build status: STARTED
[14:18:07.445] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:8:0) after 8m47s
[14:26:54.708] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:8:0)
[14:26:54.732] Build status: STARTED
[14:26:54.732] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:9:0) after 9m34s
[14:36:28.751] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:9:0)
[14:36:28.789] Build status: STARTED
[14:36:28.789] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:10:0) after 9m46s
[14:46:14.819] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:10:0)
[14:46:14.868] Build status: STARTED
[14:46:14.869] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:11:0) after 8m5s
[14:54:19.891] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:11:0)
[14:54:19.952] Build status: STARTED
[14:54:19.952] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:12:0) after 5m59s
[15:00:19.173] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:12:0)
[15:00:19.190] Build status: STARTED
[15:00:19.190] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:13:0) after 1m19s
[15:01:38.256] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:13:0)
[15:01:38.274] Build status: STARTED
[15:01:38.274] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:14:0) after 3m54s
[15:05:32.437] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:14:0)
[15:05:32.462] Build status: STARTED
[15:05:32.462] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:15:0) after 2m20s
[15:07:52.572] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:15:0)
[15:07:52.596] Build status: STARTED
[15:07:52.596] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:16:0) after 1m55s
[15:09:47.672] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:16:0)
[15:09:47.755] Build status: STARTED
[15:09:47.755] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:17:0) after 4m21s
[15:14:08.945] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:17:0)
[15:14:09.017] Build status: STARTED
[15:14:09.017] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:18:0) after 5m20s
[15:19:29.032] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:18:0)
[15:19:29.056] Build status: STARTED
[15:19:29.056] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:19:0) after 9m14s
[15:28:43.074] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:19:0)
[15:28:43.112] Build status: STARTED
[15:28:43.112] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:20:0) after 9m40s
[15:38:23.176] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:20:0)
[15:38:23.208] Build status: STARTED
[15:38:23.208] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:21:0) after 3m14s
[15:41:37.287] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:21:0)
[15:41:37.315] Build status: STARTED
[15:41:37.315] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:22:0) after 6m39s
[15:48:16.432] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:22:0)
[15:48:16.461] Build status: STARTED
[15:48:16.461] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:23:0) after 2m16s
[15:50:32.476] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:23:0)
[15:50:32.498] Build status: STARTED
[15:50:32.498] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:24:0) after 3m29s
[15:54:01.583] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:24:0)
[15:54:01.666] Build status: STARTED
[15:54:01.667] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:25:0) after 1m20s
[15:55:21.767] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:25:0)
[15:55:21.791] Build status: STARTED
[15:55:21.791] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:26:0) after 8m9s
[16:03:30.834] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:26:0)
[16:03:30.855] Build status: STARTED
[16:03:30.855] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:27:0) after 9m19s
[16:12:49.990] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:27:0)
[16:12:50.005] Build status: STARTED
[16:12:50.005] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:28:0) after 6m43s
[16:19:33.024] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:28:0)
[16:19:33.040] Build status: STARTED
[16:19:33.040] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:29:0) after 6m28s
[16:26:01.352] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:29:0)
[16:26:01.367] Build status: STARTED
[16:26:01.367] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:30:0) after 7m0s
[16:33:01.478] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:30:0)
[16:33:01.493] Build status: STARTED
[16:33:01.493] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:31:0) after 2m54s
[16:35:55.510] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:31:0)
[16:35:55.528] Build status: STARTED
[16:35:55.528] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:32:0) after 3m42s
[16:39:37.544] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:32:0)
[16:39:37.565] Build status: STARTED
[16:39:37.565] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:33:0) after 7m52s
[16:47:29.583] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:33:0)
[16:47:29.606] Build status: STARTED
[16:47:29.606] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:34:0) after 6m19s
[16:53:48.654] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:34:0)
[16:53:48.671] Build status: STARTED
[16:53:48.671] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:35:0) after 2m10s
[16:55:58.859] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:35:0)
[16:55:58.876] Build status: STARTED
[16:55:58.876] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:36:0) after 4m27s
[17:00:25.866] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:36:0)
[17:00:25.885] Build status: STARTED
[17:00:25.885] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:37:0) after 5m1s
[17:05:26.902] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:37:0)
[17:05:26.919] Build status: STARTED
[17:05:26.919] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:38:0) after 7m14s
[17:12:40.992] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:38:0)
[17:12:41.015] Build status: STARTED
[17:12:41.015] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:39:0) after 1m46s
[17:14:27.110] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:39:0)
[17:14:27.133] Build status: STARTED
[17:14:27.133] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:40:0) after 8m25s
[17:22:52.251] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:40:0)
[17:22:52.277] Build status: STARTED
[17:22:52.277] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:41:0) after 6m7s
[17:28:59.294] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:41:0)
[17:28:59.318] Build status: STARTED
[17:28:59.318] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:42:0) after 1m8s
[17:30:07.483] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:42:0)
[17:30:07.507] Build status: STARTED
[17:30:07.507] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:43:0) after 9m31s
[17:39:38.522] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:43:0)
[17:39:38.544] Build status: STARTED
[17:39:38.544] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:44:0) after 9m57s
[17:49:35.775] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:44:0)
[17:49:35.820] Build status: STARTED
[17:49:35.820] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:45:0) after 4m55s
[17:54:31.163] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:45:0)
[17:54:31.261] Build status: STARTED
[17:54:31.261] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:46:0) after 8m18s
[18:02:49.497] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:46:0)
[18:02:49.589] Build status: STARTED
[18:02:49.589] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:47:0) after 6m11s
[18:09:00.921] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:47:0)
[18:09:00.941] Build status: STARTED
[18:09:00.941] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:48:0) after 3m38s
[18:12:38.958] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:48:0)
[18:12:38.979] Build status: STARTED
[18:12:38.979] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:49:0) after 6m17s
[18:18:56.095] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:49:0)
[18:18:56.171] Build status: STARTED
[18:18:56.171] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:50:0) after 5m9s
[18:24:05.240] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:50:0)
[18:24:05.256] Build status: STARTED
[18:24:05.256] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:51:0) after 3m55s
[18:28:00.382] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:51:0)
[18:28:00.404] Build status: STARTED
[18:28:00.404] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:52:0) after 5m1s
[18:33:01.546] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:52:0)
[18:33:01.587] Build status: STARTED
[18:33:01.587] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:53:0) after 2m5s
[18:35:06.602] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:53:0)
[18:35:06.655] Build status: STARTED
[18:35:06.655] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:54:0) after 9m8s
[18:44:14.671] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:54:0)
[18:44:14.687] Build status: STARTED
[18:44:14.687] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:55:0) after 2m21s
[18:46:35.703] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:55:0)
[18:46:35.780] Build status: STARTED
[18:46:35.780] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:56:0) after 3m28s
[18:50:03.822] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:56:0)
[18:50:03.849] Build status: STARTED
[18:50:03.849] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:57:0) after 8m34s
[18:58:37.865] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:57:0)
[18:58:37.910] Build status: STARTED
[18:58:37.910] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:58:0) after 7m55s
[19:06:32.918] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:58:0)
[19:06:32.953] Build status: STARTED
[19:06:32.953] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:59:0) after 3m7s
[19:09:39.972] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:59:0)
[19:09:39.998] Build status: STARTED
[19:09:39.998] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:60:0) after 6m14s
[19:15:54.015] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:60:0)
[19:15:54.032] Build status: STARTED
[19:15:54.033] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:61:0) after 1m2s
[19:16:56.054] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:61:0)
[19:16:56.076] Build status: STARTED
[19:16:56.076] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:62:0) after 5m13s
[19:22:09.266] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:62:0)
[19:22:09.281] Build status: STARTED
[19:22:09.281] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:63:0) after 7m19s
[19:29:28.277] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:63:0)
[19:29:28.299] Build status: STARTED
[19:29:28.299] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:64:0) after 6m48s
[19:36:16.447] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:64:0)
[19:36:16.528] Build status: STARTED
[19:36:16.528] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:65:0) after 5m58s
[19:42:14.627] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:65:0)
[19:42:14.649] Build status: STARTED
[19:42:14.649] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:66:0) after 3m27s
[19:45:41.809] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:66:0)
[19:45:41.836] Build status: STARTED
[19:45:41.836] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:67:0) after 3m25s
[19:49:06.852] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:67:0)
[19:49:06.878] Build status: STARTED
[19:49:06.878] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:68:0) after 9m10s
[19:58:16.894] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:68:0)
[19:58:16.927] Build status: STARTED
[19:58:16.927] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:69:0) after 1m57s
[20:00:14.064] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:69:0)
[20:00:14.083] Build status: STARTED
[20:00:14.083] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:70:0) after 1m0s
[20:01:14.354] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:70:0)
[20:01:14.371] Build status: STARTED
[20:01:14.371] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:71:0) after 6m28s
[20:07:42.506] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:71:0)
[20:07:42.529] Build status: STARTED
[20:07:42.529] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:72:0) after 6m51s
[20:14:33.595] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:72:0)
[20:14:33.622] Build status: STARTED
[20:14:33.622] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:73:0) after 3m58s
[20:18:31.643] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:73:0)
[20:18:31.712] Build status: STARTED
[20:18:31.712] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:74:0) after 7m38s
[20:26:09.790] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:74:0)
[20:26:09.871] Build status: STARTED
[20:26:09.871] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:75:0) after 3m32s
[20:29:41.892] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:75:0)
[20:29:41.932] Build status: STARTED
[20:29:41.932] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:76:0) after 6m42s
[20:36:23.952] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:76:0)
[20:36:23.971] Build status: STARTED
[20:36:23.971] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:77:0) after 1m58s
[20:38:22.088] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:77:0)
[20:38:22.110] Build status: STARTED
[20:38:22.110] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:78:0) after 4m14s
[20:42:36.128] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:78:0)
[20:42:36.218] Build status: STARTED
[20:42:36.218] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:79:0) after 5m7s
[20:47:43.261] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:79:0)
[20:47:43.277] Build status: STARTED
[20:47:43.277] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:80:0) after 6m38s
[20:54:21.523] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:80:0)
[20:54:21.594] Build status: STARTED
[20:54:21.594] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:81:0) after 1m19s
[20:55:40.609] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:81:0)
[20:55:40.709] Build status: STARTED
[20:55:40.709] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:82:0) after 2m23s
[20:58:03.725] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:82:0)
[20:58:03.763] Build status: STARTED
[20:58:03.763] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:83:0) after 1m48s
[20:59:51.781] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:83:0)
[20:59:51.800] Build status: STARTED
[20:59:51.800] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:84:0) after 5m30s
[21:05:21.826] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:84:0)
[21:05:21.846] Build status: STARTED
[21:05:21.846] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:85:0) after 2m54s
[21:08:16.477] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:85:0)
[21:08:16.494] Build status: STARTED
[21:08:16.494] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:86:0) after 2m57s
[21:11:13.847] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:86:0)
[21:11:13.877] Build status: STARTED
[21:11:13.877] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:87:0) after 4m49s
[21:16:03.450] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:87:0)
[21:16:03.469] Build status: STARTED
[21:16:03.469] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:88:0) after 6m33s
[21:22:36.551] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:88:0)
[21:22:36.614] Build status: STARTED
[21:22:36.614] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:89:0) after 5m42s
[21:28:18.632] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:89:0)
[21:28:18.671] Build status: STARTED
[21:28:18.671] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:90:0) after 7m45s
[21:36:03.759] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:90:0)
[21:36:03.790] Build status: STARTED
[21:36:03.790] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:91:0) after 8m51s
[21:44:54.807] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:91:0)
[21:44:54.825] Build status: STARTED
[21:44:54.825] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:92:0) after 4m1s
[21:48:55.842] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:92:0)
[21:48:55.862] Build status: STARTED
[21:48:55.862] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:93:0) after 9m31s
[21:58:27.150] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:93:0)
[21:58:27.166] Build status: STARTED
[21:58:27.166] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:94:0) after 9m20s
[22:07:47.266] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:94:0)
[22:07:47.287] Build status: STARTED
[22:07:47.287] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:95:0) after 8m44s
[22:16:31.339] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:95:0)
[22:16:31.357] Build status: STARTED
[22:16:31.357] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:96:0) after 7m41s
[22:24:12.374] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:96:0)
[22:24:12.394] Build status: STARTED
[22:24:12.394] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:97:0) after 8m57s
[22:33:09.553] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:97:0)
[22:33:09.574] Build status: STARTED
[22:33:09.574] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:98:0) after 5m11s
[22:38:20.595] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:98:0)
[22:38:20.611] Build status: STARTED
[22:38:20.611] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:99:0) after 3m10s
[22:41:30.633] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:99:0)
[22:41:30.652] Build status: STARTED
[22:41:30.652] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:100:0) after 3m1s
[22:44:31.713] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:100:0)
[22:44:31.735] Build status: STARTED
[22:44:31.735] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:101:0) after 2m27s
[22:46:58.763] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:101:0)
[22:46:58.779] Build status: STARTED
[22:46:58.779] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896445693515535904:102:0) after 7m9s
[22:52:58.568] Received PubSub notification, asking Buildbucket for the build status
[22:52:58.600] Build:
{
  "id": "8731015631604742833",
  "builder": {
    "project": "chromium",
    "bucket": "reclient",
    "builder": "Windows Cross deterministic"
  },
  "number": 2967,
  "createdBy": "project:chromium",
  "createTime": "2024-11-17T13:54:18.205774307Z",
  "startTime": "2024-11-17T14:15:43.933084087Z",
  "endTime": "2024-11-17T22:52:58.255898099Z",
  "updateTime": "2024-11-17T22:52:58.255898099Z",
  "status": "INFRA_FAILURE",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "443452b2d2f2311122c718a8d524a90e5ce3da8f",
      "ref": "refs/heads/main"
    }
  },
  "canary": true
}
[22:52:58.600] Invocation finished in 8h58m41.600752759s with status FAILED