LUCI Scheduler :: chromium :: Windows Cross deterministic

Status: FAILED

Triggered by: -

Duration: 10 hours

Actions:

Definition (rev 7e7ca5cd047c45b3be7281cd6c03a9eb5b0edf34)

buildbucket: <
  server: "cr-buildbucket.appspot.com"
  bucket: "reclient"
  builder: "Windows Cross deterministic"
>

Incoming triggers

7e1dae691ab1ebbabcc29dd991d32e8d20ee43f3 (2 years ago)
451fc725f144ca60bd9be581849c33b73e075a5d (2 years ago)

Incoming properties

{
  "branch": "refs/heads/main",
  "repository": "https://chromium.googlesource.com/chromium/src",
  "revision": "451fc725f144ca60bd9be581849c33b73e075a5d"
}

Incoming tags

buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/451fc725f144ca60bd9be581849c33b73e075a5d
gitiles_ref:refs/heads/main

Debug log (UTC)

[19:38:24.266] New invocation is queued and will start shortly
[19:38:25.455] Starting the invocation (attempt 1)
[19:38:25.484] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/451fc725f144ca60bd9be581849c33b73e075a5d"
[19:38:25.484] Popped gitiles commit info from properties and tags
[19:38:25.484] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[19:38:25.484] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[19:38:25.485] Buildbucket request:
{
  "requestId": "8954949683597182464",
  "builder": {
    "project": "chromium",
    "bucket": "reclient",
    "builder": "Windows Cross deterministic"
  },
  "properties": {
    },
  "gitilesCommit": {
    "host": "chromium.googlesource.com",
    "project": "chromium/src",
    "id": "451fc725f144ca60bd9be581849c33b73e075a5d",
    "ref": "refs/heads/main"
  },
  "tags": [
    {
      "key": "scheduler_invocation_id",
      "value": "8954949683597182464"
    },
    {
      "key": "scheduler_job_id",
      "value": "chromium/Windows Cross deterministic"
    },
    {
      "key": "user_agent",
      "value": "luci-scheduler"
    }
  ],
  "notify": {
    "pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
  }
}
[19:38:26.439] Scheduled build:
{
  "id": "8789519621522406913",
  "builder": {
    "project": "chromium",
    "bucket": "reclient",
    "builder": "Windows Cross deterministic"
  },
  "number": 1198,
  "createdBy": "project:chromium",
  "createTime": "2023-02-10T19:38:25.613866819Z",
  "updateTime": "2023-02-10T19:38:25.613866819Z",
  "status": "SCHEDULED",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "451fc725f144ca60bd9be581849c33b73e075a5d",
      "ref": "refs/heads/main"
    }
  }
}
[19:38:26.439] Task URL: https://cr-buildbucket.appspot.com/build/8789519621522406913
[19:38:26.439] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:2:0) after 6m21s
[19:38:35.575] Received PubSub notification, asking Buildbucket for the build status
[19:38:35.682] Build status: STARTED
[19:44:47.512] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:2:0)
[19:44:47.538] Build status: STARTED
[19:44:47.538] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:4:0) after 6m47s
[19:51:34.553] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:4:0)
[19:51:35.115] Build status: STARTED
[19:51:35.115] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:5:0) after 1m7s
[19:52:42.211] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:5:0)
[19:52:42.254] Build status: STARTED
[19:52:42.254] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:6:0) after 4m15s
[19:56:57.326] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:6:0)
[19:56:57.349] Build status: STARTED
[19:56:57.349] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:7:0) after 8m0s
[20:04:57.377] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:7:0)
[20:04:57.417] Build status: STARTED
[20:04:57.417] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:8:0) after 6m18s
[20:11:15.431] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:8:0)
[20:11:15.485] Build status: STARTED
[20:11:15.485] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:9:0) after 5m37s
[20:16:52.561] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:9:0)
[20:16:52.583] Build status: STARTED
[20:16:52.583] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:10:0) after 9m33s
[20:26:25.608] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:10:0)
[20:26:25.629] Build status: STARTED
[20:26:25.629] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:11:0) after 5m18s
[20:31:43.646] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:11:0)
[20:31:43.667] Build status: STARTED
[20:31:43.667] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:12:0) after 9m22s
[20:41:05.724] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:12:0)
[20:41:05.756] Build status: STARTED
[20:41:05.756] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:13:0) after 5m10s
[20:46:15.775] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:13:0)
[20:46:15.794] Build status: STARTED
[20:46:15.795] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:14:0) after 1m44s
[20:47:59.836] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:14:0)
[20:47:59.865] Build status: STARTED
[20:47:59.865] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:15:0) after 7m6s
[20:55:05.907] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:15:0)
[20:55:05.939] Build status: STARTED
[20:55:05.939] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:16:0) after 1m58s
[20:57:03.967] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:16:0)
[20:57:04.018] Build status: STARTED
[20:57:04.018] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:17:0) after 1m25s
[20:58:29.031] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:17:0)
[20:58:29.069] Build status: STARTED
[20:58:29.069] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:18:0) after 4m32s
[21:03:01.115] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:18:0)
[21:03:01.193] Build status: STARTED
[21:03:01.193] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:19:0) after 1m10s
[21:04:11.284] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:19:0)
[21:04:11.308] Build status: STARTED
[21:04:11.308] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:20:0) after 8m23s
[21:12:34.326] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:20:0)
[21:12:34.360] Build status: STARTED
[21:12:34.360] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:21:0) after 5m16s
[21:17:50.378] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:21:0)
[21:17:50.414] Build status: STARTED
[21:17:50.414] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:22:0) after 7m6s
[21:24:56.529] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:22:0)
[21:24:56.701] Build status: STARTED
[21:24:56.701] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:23:0) after 4m57s
[21:29:53.726] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:23:0)
[21:29:53.747] Build status: STARTED
[21:29:53.747] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:24:0) after 8m41s
[21:38:34.764] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:24:0)
[21:38:34.788] Build status: STARTED
[21:38:34.788] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:25:0) after 5m40s
[21:44:15.486] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:25:0)
[21:44:15.516] Build status: STARTED
[21:44:15.516] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:26:0) after 2m50s
[21:47:05.532] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:26:0)
[21:47:05.553] Build status: STARTED
[21:47:05.553] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:27:0) after 3m24s
[21:50:29.850] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:27:0)
[21:50:29.888] Build status: STARTED
[21:50:29.888] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:28:0) after 9m54s
[22:00:23.906] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:28:0)
[22:00:23.939] Build status: STARTED
[22:00:23.940] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:29:0) after 1m22s
[22:01:45.967] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:29:0)
[22:01:45.994] Build status: STARTED
[22:01:45.994] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:30:0) after 3m52s
[22:05:38.103] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:30:0)
[22:05:38.134] Build status: STARTED
[22:05:38.134] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:31:0) after 6m34s
[22:12:12.212] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:31:0)
[22:12:12.278] Build status: STARTED
[22:12:12.278] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:32:0) after 6m35s
[22:18:47.678] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:32:0)
[22:18:47.701] Build status: STARTED
[22:18:47.701] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:33:0) after 5m59s
[22:24:46.725] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:33:0)
[22:24:46.746] Build status: STARTED
[22:24:46.746] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:34:0) after 4m4s
[22:28:50.765] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:34:0)
[22:28:50.807] Build status: STARTED
[22:28:50.807] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:35:0) after 8m8s
[22:36:59.462] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:35:0)
[22:36:59.485] Build status: STARTED
[22:36:59.485] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:36:0) after 4m21s
[22:41:20.845] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:36:0)
[22:41:20.864] Build status: STARTED
[22:41:20.864] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:37:0) after 2m56s
[22:44:16.952] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:37:0)
[22:44:16.974] Build status: STARTED
[22:44:16.974] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:38:0) after 4m41s
[22:48:58.012] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:38:0)
[22:48:58.029] Build status: STARTED
[22:48:58.029] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:39:0) after 3m22s
[22:52:20.049] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:39:0)
[22:52:20.074] Build status: STARTED
[22:52:20.074] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:40:0) after 5m14s
[22:57:34.176] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:40:0)
[22:57:34.196] Build status: STARTED
[22:57:34.196] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:41:0) after 7m9s
[23:04:43.228] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:41:0)
[23:04:43.267] Build status: STARTED
[23:04:43.268] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:42:0) after 2m20s
[23:07:03.289] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:42:0)
[23:07:03.312] Build status: STARTED
[23:07:03.312] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:43:0) after 5m20s
[23:12:23.419] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:43:0)
[23:12:23.440] Build status: STARTED
[23:12:23.440] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:44:0) after 2m11s
[23:14:34.567] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:44:0)
[23:14:34.599] Build status: STARTED
[23:14:34.599] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:45:0) after 8m53s
[23:23:27.718] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:45:0)
[23:23:27.747] Build status: STARTED
[23:23:27.747] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:46:0) after 1m5s
[23:24:32.909] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:46:0)
[23:24:32.945] Build status: STARTED
[23:24:32.945] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:47:0) after 3m31s
[23:28:04.368] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:47:0)
[23:28:04.536] Build status: STARTED
[23:28:04.536] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:48:0) after 8m58s
[23:37:02.555] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:48:0)
[23:37:02.577] Build status: STARTED
[23:37:02.577] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:49:0) after 1m31s
[23:38:33.658] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:49:0)
[23:38:33.695] Build status: STARTED
[23:38:33.695] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:50:0) after 8m5s
[23:46:38.787] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:50:0)
[23:46:38.808] Build status: STARTED
[23:46:38.808] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:51:0) after 6m43s
[23:53:22.172] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:51:0)
[23:53:22.195] Build status: STARTED
[23:53:22.195] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:52:0) after 1m16s
[23:54:38.214] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:52:0)
[23:54:38.244] Build status: STARTED
[23:54:38.244] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:53:0) after 7m25s
[00:02:03.380] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:53:0)
[00:02:03.404] Build status: STARTED
[00:02:03.404] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:54:0) after 1m30s
[00:03:33.454] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:54:0)
[00:03:33.475] Build status: STARTED
[00:03:33.475] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:55:0) after 7m2s
[00:10:35.741] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:55:0)
[00:10:35.762] Build status: STARTED
[00:10:35.762] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:56:0) after 2m15s
[00:12:51.959] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:56:0)
[00:12:51.988] Build status: STARTED
[00:12:51.988] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:57:0) after 7m20s
[00:20:12.328] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:57:0)
[00:20:12.354] Build status: STARTED
[00:20:12.354] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:58:0) after 9m32s
[00:29:44.483] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:58:0)
[00:29:44.621] Build status: STARTED
[00:29:44.621] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:59:0) after 4m12s
[00:33:56.666] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:59:0)
[00:33:56.691] Build status: STARTED
[00:33:56.691] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:60:0) after 3m57s
[00:37:53.702] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:60:0)
[00:37:53.745] Build status: STARTED
[00:37:53.745] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:61:0) after 9m4s
[00:46:57.942] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:61:0)
[00:46:57.963] Build status: STARTED
[00:46:57.963] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:62:0) after 9m31s
[00:56:28.972] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:62:0)
[00:56:28.997] Build status: STARTED
[00:56:28.997] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:63:0) after 7m9s
[01:03:38.330] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:63:0)
[01:03:38.349] Build status: STARTED
[01:03:38.349] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:64:0) after 3m48s
[01:07:26.561] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:64:0)
[01:07:26.583] Build status: STARTED
[01:07:26.583] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:65:0) after 8m58s
[01:16:24.592] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:65:0)
[01:16:24.612] Build status: STARTED
[01:16:24.612] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:66:0) after 8m2s
[01:24:26.747] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:66:0)
[01:24:26.772] Build status: STARTED
[01:24:26.772] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:67:0) after 3m7s
[01:27:33.874] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:67:0)
[01:27:33.910] Build status: STARTED
[01:27:33.910] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:68:0) after 4m2s
[01:31:35.930] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:68:0)
[01:31:35.954] Build status: STARTED
[01:31:35.954] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:69:0) after 5m36s
[01:37:12.205] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:69:0)
[01:37:12.244] Build status: STARTED
[01:37:12.244] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:70:0) after 8m23s
[01:45:35.492] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:70:0)
[01:45:35.544] Build status: STARTED
[01:45:35.544] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:71:0) after 1m8s
[01:46:43.565] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:71:0)
[01:46:43.586] Build status: STARTED
[01:46:43.586] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:72:0) after 9m8s
[01:55:51.711] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:72:0)
[01:55:51.741] Build status: STARTED
[01:55:51.741] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:73:0) after 1m10s
[01:57:01.778] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:73:0)
[01:57:01.823] Build status: STARTED
[01:57:01.823] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:74:0) after 5m44s
[02:02:46.156] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:74:0)
[02:02:46.184] Build status: STARTED
[02:02:46.184] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:75:0) after 2m54s
[02:05:40.318] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:75:0)
[02:05:40.361] Build status: STARTED
[02:05:40.362] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:76:0) after 9m45s
[02:15:25.581] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:76:0)
[02:15:25.604] Build status: STARTED
[02:15:25.604] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:77:0) after 5m58s
[02:21:23.624] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:77:0)
[02:21:23.670] Build status: STARTED
[02:21:23.670] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:78:0) after 7m38s
[02:29:01.800] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:78:0)
[02:29:01.825] Build status: STARTED
[02:29:01.825] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:79:0) after 2m22s
[02:31:23.943] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:79:0)
[02:31:23.965] Build status: STARTED
[02:31:23.965] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:80:0) after 7m31s
[02:38:54.986] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:80:0)
[02:38:55.012] Build status: STARTED
[02:38:55.012] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:81:0) after 7m58s
[02:46:53.181] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:81:0)
[02:46:53.204] Build status: STARTED
[02:46:53.204] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:82:0) after 7m42s
[02:54:35.226] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:82:0)
[02:54:35.260] Build status: STARTED
[02:54:35.260] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:83:0) after 1m40s
[02:56:15.279] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:83:0)
[02:56:15.301] Build status: STARTED
[02:56:15.301] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:84:0) after 9m36s
[03:05:51.428] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:84:0)
[03:05:51.451] Build status: STARTED
[03:05:51.451] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:85:0) after 7m19s
[03:13:10.473] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:85:0)
[03:13:10.492] Build status: STARTED
[03:13:10.492] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:86:0) after 5m18s
[03:18:28.643] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:86:0)
[03:18:28.667] Build status: STARTED
[03:18:28.667] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:87:0) after 3m0s
[03:21:29.131] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:87:0)
[03:21:29.163] Build status: STARTED
[03:21:29.163] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:88:0) after 9m4s
[03:30:33.247] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:88:0)
[03:30:33.283] Build status: STARTED
[03:30:33.283] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:89:0) after 7m12s
[03:37:45.876] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:89:0)
[03:37:45.897] Build status: STARTED
[03:37:45.897] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:90:0) after 1m56s
[03:39:41.912] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:90:0)
[03:39:41.934] Build status: STARTED
[03:39:41.934] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:91:0) after 7m51s
[03:47:32.956] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:91:0)
[03:47:33.012] Build status: STARTED
[03:47:33.012] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:92:0) after 9m7s
[03:56:40.312] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:92:0)
[03:56:40.336] Build status: STARTED
[03:56:40.336] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:93:0) after 3m47s
[04:00:27.591] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:93:0)
[04:00:27.760] Build status: STARTED
[04:00:27.760] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:94:0) after 3m15s
[04:03:42.931] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:94:0)
[04:03:42.953] Build status: STARTED
[04:03:42.953] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:95:0) after 6m43s
[04:10:25.971] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:95:0)
[04:10:26.053] Build status: STARTED
[04:10:26.054] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:96:0) after 6m31s
[04:16:57.094] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:96:0)
[04:16:57.124] Build status: STARTED
[04:16:57.124] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:97:0) after 9m16s
[04:26:13.097] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:97:0)
[04:26:13.273] Build status: STARTED
[04:26:13.273] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:98:0) after 9m23s
[04:35:36.390] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:98:0)
[04:35:36.429] Build status: STARTED
[04:35:36.429] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:99:0) after 2m35s
[04:38:11.446] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:99:0)
[04:38:11.475] Build status: STARTED
[04:38:11.475] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:100:0) after 2m38s
[04:40:49.492] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:100:0)
[04:40:49.515] Build status: STARTED
[04:40:49.515] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:101:0) after 5m7s
[04:45:56.554] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:101:0)
[04:45:56.576] Build status: STARTED
[04:45:56.576] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:102:0) after 4m59s
[04:50:55.696] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:102:0)
[04:50:55.719] Build status: STARTED
[04:50:55.719] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:103:0) after 7m55s
[04:58:50.752] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:103:0)
[04:58:50.827] Build status: STARTED
[04:58:50.827] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:104:0) after 7m42s
[05:06:32.930] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:104:0)
[05:06:32.952] Build status: STARTED
[05:06:32.952] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:105:0) after 1m56s
[05:08:29.006] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:105:0)
[05:08:29.056] Build status: STARTED
[05:08:29.056] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:106:0) after 5m52s
[05:14:21.081] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:106:0)
[05:14:21.145] Build status: STARTED
[05:14:21.145] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:107:0) after 6m0s
[05:20:21.286] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:107:0)
[05:20:21.319] Build status: STARTED
[05:20:21.319] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:108:0) after 1m39s
[05:22:00.481] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:108:0)
[05:22:00.505] Build status: STARTED
[05:22:00.505] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:109:0) after 4m59s
[05:26:59.522] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:109:0)
[05:26:59.555] Build status: STARTED
[05:26:59.555] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:110:0) after 3m54s
[05:30:53.706] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:110:0)
[05:30:53.743] Build status: STARTED
[05:30:53.743] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:111:0) after 7m5s
[05:37:58.761] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:111:0)
[05:37:58.794] Build status: STARTED
[05:37:58.794] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:112:0) after 5m30s
[05:43:28.817] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:112:0)
[05:43:29.007] Build status: STARTED
[05:43:29.007] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:113:0) after 9m41s
[05:53:10.076] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:113:0)
[05:53:10.101] Build status: STARTED
[05:53:10.101] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:114:0) after 8m16s
[06:01:26.230] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:114:0)
[06:01:26.254] Build status: STARTED
[06:01:26.254] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954949683597182464:115:0) after 2m18s
[06:03:37.157] Received PubSub notification, asking Buildbucket for the build status
[06:03:37.181] Build:
{
  "id": "8789519621522406913",
  "builder": {
    "project": "chromium",
    "bucket": "reclient",
    "builder": "Windows Cross deterministic"
  },
  "number": 1198,
  "createdBy": "project:chromium",
  "createTime": "2023-02-10T19:38:25.613866819Z",
  "startTime": "2023-02-10T19:38:35.040209Z",
  "endTime": "2023-02-11T06:03:36.455001206Z",
  "updateTime": "2023-02-11T06:03:36.455001206Z",
  "status": "INFRA_FAILURE",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "451fc725f144ca60bd9be581849c33b73e075a5d",
      "ref": "refs/heads/main"
    }
  }
}
[06:03:37.181] Invocation finished in 10h25m12.930422255s with status FAILED