LUCI Scheduler :: chromium :: Windows Cross deterministic

Status: FAILED

Triggered by: -

Duration: 12 hours

Actions:

Definition (rev 7e7ca5cd047c45b3be7281cd6c03a9eb5b0edf34)

buildbucket: <
  server: "cr-buildbucket.appspot.com"
  bucket: "reclient"
  builder: "Windows Cross deterministic"
>

Incoming triggers

3a6cacf369a15da88dfa4b4e2a1eefaa9b968d59 (1 year ago)
bfc238f2159c974c44075706593d802c1ff7c38e (1 year ago)

Incoming properties

{
  "branch": "refs/heads/main",
  "repository": "https://chromium.googlesource.com/chromium/src",
  "revision": "bfc238f2159c974c44075706593d802c1ff7c38e"
}

Incoming tags

buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/bfc238f2159c974c44075706593d802c1ff7c38e
gitiles_ref:refs/heads/main

Debug log (UTC)

[15:32:24.978] New invocation is queued and will start shortly
[15:32:26.127] Starting the invocation (attempt 1)
[15:32:26.156] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/bfc238f2159c974c44075706593d802c1ff7c38e"
[15:32:26.156] Popped gitiles commit info from properties and tags
[15:32:26.156] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[15:32:26.158] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[15:32:26.158] Buildbucket request:
{
  "requestId": "8936483378684864080",
  "builder": {
    "project": "chromium",
    "bucket": "reclient",
    "builder": "Windows Cross deterministic"
  },
  "properties": {
    },
  "gitilesCommit": {
    "host": "chromium.googlesource.com",
    "project": "chromium/src",
    "id": "bfc238f2159c974c44075706593d802c1ff7c38e",
    "ref": "refs/heads/main"
  },
  "tags": [
    {
      "key": "scheduler_invocation_id",
      "value": "8936483378684864080"
    },
    {
      "key": "scheduler_job_id",
      "value": "chromium/Windows Cross deterministic"
    },
    {
      "key": "user_agent",
      "value": "luci-scheduler"
    }
  ],
  "notify": {
    "pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
  }
}
[15:32:26.738] Scheduled build:
{
  "id": "8771053316707754273",
  "builder": {
    "project": "chromium",
    "bucket": "reclient",
    "builder": "Windows Cross deterministic"
  },
  "number": 1646,
  "createdBy": "project:chromium",
  "createTime": "2023-09-02T15:32:26.233561873Z",
  "updateTime": "2023-09-02T15:32:26.233561873Z",
  "status": "SCHEDULED",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "bfc238f2159c974c44075706593d802c1ff7c38e",
      "ref": "refs/heads/main"
    }
  }
}
[15:32:26.738] Task URL: https://cr-buildbucket.appspot.com/build/8771053316707754273
[15:32:26.738] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:2:0) after 4m29s
[15:32:27.757] Received PubSub notification, asking Buildbucket for the build status
[15:32:27.789] Build status: SCHEDULED
[15:33:22.363] Received PubSub notification, asking Buildbucket for the build status
[15:33:22.409] Build status: STARTED
[15:36:55.772] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:2:0)
[15:36:55.798] Build status: STARTED
[15:36:55.798] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:5:0) after 9m34s
[15:46:29.819] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:5:0)
[15:46:29.855] Build status: STARTED
[15:46:29.855] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:6:0) after 3m50s
[15:50:19.838] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:6:0)
[15:50:19.861] Build status: STARTED
[15:50:19.861] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:7:0) after 2m57s
[15:53:17.283] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:7:0)
[15:53:17.299] Build status: STARTED
[15:53:17.299] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:8:0) after 5m41s
[15:58:58.582] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:8:0)
[15:58:58.610] Build status: STARTED
[15:58:58.610] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:9:0) after 7m55s
[16:06:53.961] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:9:0)
[16:06:54.025] Build status: STARTED
[16:06:54.025] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:10:0) after 2m32s
[16:09:26.113] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:10:0)
[16:09:26.150] Build status: STARTED
[16:09:26.150] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:11:0) after 2m15s
[16:11:41.299] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:11:0)
[16:11:41.326] Build status: STARTED
[16:11:41.326] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:12:0) after 8m26s
[16:20:07.343] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:12:0)
[16:20:07.390] Build status: STARTED
[16:20:07.390] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:13:0) after 3m5s
[16:23:12.443] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:13:0)
[16:23:12.537] Build status: STARTED
[16:23:12.537] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:14:0) after 4m30s
[16:27:42.553] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:14:0)
[16:27:42.572] Build status: STARTED
[16:27:42.572] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:15:0) after 6m51s
[16:34:33.592] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:15:0)
[16:34:33.622] Build status: STARTED
[16:34:33.622] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:16:0) after 7m51s
[16:42:24.636] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:16:0)
[16:42:24.655] Build status: STARTED
[16:42:24.655] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:17:0) after 8m25s
[16:50:49.807] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:17:0)
[16:50:49.826] Build status: STARTED
[16:50:49.826] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:18:0) after 2m2s
[16:52:52.241] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:18:0)
[16:52:52.280] Build status: STARTED
[16:52:52.280] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:19:0) after 5m1s
[16:57:53.394] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:19:0)
[16:57:53.416] Build status: STARTED
[16:57:53.416] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:20:0) after 2m4s
[16:59:57.474] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:20:0)
[16:59:57.494] Build status: STARTED
[16:59:57.494] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:21:0) after 9m54s
[17:09:51.591] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:21:0)
[17:09:51.685] Build status: STARTED
[17:09:51.685] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:22:0) after 2m47s
[17:12:38.710] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:22:0)
[17:12:38.737] Build status: STARTED
[17:12:38.737] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:23:0) after 1m4s
[17:13:42.853] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:23:0)
[17:13:42.909] Build status: STARTED
[17:13:42.909] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:24:0) after 7m33s
[17:21:16.110] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:24:0)
[17:21:16.145] Build status: STARTED
[17:21:16.145] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:25:0) after 3m0s
[17:24:16.407] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:25:0)
[17:24:16.427] Build status: STARTED
[17:24:16.427] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:26:0) after 9m28s
[17:33:44.447] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:26:0)
[17:33:44.466] Build status: STARTED
[17:33:44.466] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:27:0) after 5m36s
[17:39:20.484] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:27:0)
[17:39:20.515] Build status: STARTED
[17:39:20.515] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:28:0) after 1m54s
[17:41:14.558] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:28:0)
[17:41:14.590] Build status: STARTED
[17:41:14.590] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:29:0) after 9m42s
[17:50:56.632] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:29:0)
[17:50:56.652] Build status: STARTED
[17:50:56.652] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:30:0) after 2m31s
[17:53:27.715] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:30:0)
[17:53:27.732] Build status: STARTED
[17:53:27.732] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:31:0) after 1m25s
[17:54:52.910] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:31:0)
[17:54:52.932] Build status: STARTED
[17:54:52.932] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:32:0) after 1m39s
[17:56:32.053] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:32:0)
[17:56:32.078] Build status: STARTED
[17:56:32.078] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:33:0) after 1m15s
[17:57:47.560] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:33:0)
[17:57:47.581] Build status: STARTED
[17:57:47.581] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:34:0) after 9m30s
[18:07:17.702] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:34:0)
[18:07:17.719] Build status: STARTED
[18:07:17.719] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:35:0) after 4m2s
[18:11:19.725] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:35:0)
[18:11:19.743] Build status: STARTED
[18:11:19.743] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:36:0) after 9m56s
[18:21:15.878] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:36:0)
[18:21:15.895] Build status: STARTED
[18:21:15.895] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:37:0) after 3m59s
[18:25:14.935] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:37:0)
[18:25:14.954] Build status: STARTED
[18:25:14.954] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:38:0) after 8m37s
[18:33:52.183] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:38:0)
[18:33:52.202] Build status: STARTED
[18:33:52.202] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:39:0) after 5m12s
[18:39:04.219] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:39:0)
[18:39:04.236] Build status: STARTED
[18:39:04.236] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:40:0) after 1m26s
[18:40:30.339] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:40:0)
[18:40:30.357] Build status: STARTED
[18:40:30.357] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:41:0) after 1m27s
[18:41:57.350] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:41:0)
[18:41:57.369] Build status: STARTED
[18:41:57.370] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:42:0) after 5m2s
[18:46:59.339] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:42:0)
[18:46:59.357] Build status: STARTED
[18:46:59.357] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:43:0) after 3m37s
[18:50:36.382] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:43:0)
[18:50:36.414] Build status: STARTED
[18:50:36.414] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:44:0) after 7m34s
[18:58:10.434] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:44:0)
[18:58:10.506] Build status: STARTED
[18:58:10.506] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:45:0) after 6m16s
[19:04:26.537] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:45:0)
[19:04:26.556] Build status: STARTED
[19:04:26.556] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:46:0) after 6m52s
[19:11:18.573] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:46:0)
[19:11:18.674] Build status: STARTED
[19:11:18.674] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:47:0) after 7m10s
[19:18:28.698] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:47:0)
[19:18:28.723] Build status: STARTED
[19:18:28.723] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:48:0) after 6m30s
[19:24:58.768] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:48:0)
[19:24:58.785] Build status: STARTED
[19:24:58.786] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:49:0) after 3m51s
[19:28:49.806] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:49:0)
[19:28:49.827] Build status: STARTED
[19:28:49.827] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:50:0) after 5m45s
[19:34:34.853] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:50:0)
[19:34:34.872] Build status: STARTED
[19:34:34.872] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:51:0) after 8m10s
[19:42:44.888] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:51:0)
[19:42:44.908] Build status: STARTED
[19:42:44.908] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:52:0) after 2m35s
[19:45:20.036] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:52:0)
[19:45:20.134] Build status: STARTED
[19:45:20.134] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:53:0) after 7m49s
[19:53:09.308] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:53:0)
[19:53:09.333] Build status: STARTED
[19:53:09.333] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:54:0) after 9m5s
[20:02:14.359] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:54:0)
[20:02:14.390] Build status: STARTED
[20:02:14.390] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:55:0) after 6m54s
[20:09:08.440] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:55:0)
[20:09:08.459] Build status: STARTED
[20:09:08.459] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:56:0) after 7m32s
[20:16:40.475] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:56:0)
[20:16:40.510] Build status: STARTED
[20:16:40.510] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:57:0) after 1m15s
[20:17:55.606] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:57:0)
[20:17:55.633] Build status: STARTED
[20:17:55.633] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:58:0) after 9m13s
[20:27:08.748] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:58:0)
[20:27:08.767] Build status: STARTED
[20:27:08.767] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:59:0) after 4m5s
[20:31:13.817] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:59:0)
[20:31:13.839] Build status: STARTED
[20:31:13.839] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:60:0) after 3m30s
[20:34:43.954] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:60:0)
[20:34:43.979] Build status: STARTED
[20:34:43.979] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:61:0) after 3m20s
[20:38:04.017] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:61:0)
[20:38:04.038] Build status: STARTED
[20:38:04.039] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:62:0) after 3m34s
[20:41:38.084] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:62:0)
[20:41:38.101] Build status: STARTED
[20:41:38.101] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:63:0) after 8m27s
[20:50:05.431] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:63:0)
[20:50:05.451] Build status: STARTED
[20:50:05.452] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:64:0) after 4m19s
[20:54:24.479] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:64:0)
[20:54:24.508] Build status: STARTED
[20:54:24.508] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:65:0) after 6m13s
[21:00:37.581] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:65:0)
[21:00:37.602] Build status: STARTED
[21:00:37.602] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:66:0) after 9m41s
[21:10:18.668] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:66:0)
[21:10:18.685] Build status: STARTED
[21:10:18.685] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:67:0) after 9m11s
[21:19:29.796] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:67:0)
[21:19:29.876] Build status: STARTED
[21:19:29.876] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:68:0) after 3m11s
[21:22:40.893] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:68:0)
[21:22:41.089] Build status: STARTED
[21:22:41.089] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:69:0) after 3m27s
[21:26:08.291] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:69:0)
[21:26:08.317] Build status: STARTED
[21:26:08.317] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:70:0) after 6m35s
[21:32:43.436] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:70:0)
[21:32:43.463] Build status: STARTED
[21:32:43.463] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:71:0) after 6m14s
[21:38:59.174] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:71:0)
[21:38:59.191] Build status: STARTED
[21:38:59.191] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:72:0) after 3m21s
[21:42:20.223] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:72:0)
[21:42:20.244] Build status: STARTED
[21:42:20.244] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:73:0) after 9m36s
[21:51:56.390] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:73:0)
[21:51:56.407] Build status: STARTED
[21:51:56.407] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:74:0) after 7m3s
[21:58:59.437] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:74:0)
[21:58:59.459] Build status: STARTED
[21:58:59.459] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:75:0) after 5m33s
[22:04:32.625] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:75:0)
[22:04:32.645] Build status: STARTED
[22:04:32.645] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:76:0) after 8m27s
[22:12:59.665] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:76:0)
[22:12:59.692] Build status: STARTED
[22:12:59.692] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:77:0) after 3m30s
[22:16:29.708] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:77:0)
[22:16:29.805] Build status: STARTED
[22:16:29.805] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:78:0) after 2m20s
[22:18:49.884] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:78:0)
[22:18:49.904] Build status: STARTED
[22:18:49.904] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:79:0) after 3m4s
[22:21:53.931] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:79:0)
[22:21:53.954] Build status: STARTED
[22:21:53.954] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:80:0) after 2m14s
[22:24:08.223] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:80:0)
[22:24:08.244] Build status: STARTED
[22:24:08.244] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:81:0) after 1m3s
[22:25:11.266] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:81:0)
[22:25:11.286] Build status: STARTED
[22:25:11.286] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:82:0) after 5m51s
[22:31:02.620] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:82:0)
[22:31:02.709] Build status: STARTED
[22:31:02.709] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:83:0) after 5m36s
[22:36:38.775] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:83:0)
[22:36:39.049] Build status: STARTED
[22:36:39.049] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:84:0) after 3m0s
[22:39:39.127] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:84:0)
[22:39:39.146] Build status: STARTED
[22:39:39.146] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:85:0) after 9m13s
[22:48:52.260] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:85:0)
[22:48:52.279] Build status: STARTED
[22:48:52.280] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:86:0) after 8m52s
[22:57:44.298] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:86:0)
[22:57:44.381] Build status: STARTED
[22:57:44.381] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:87:0) after 9m10s
[23:06:54.424] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:87:0)
[23:06:54.509] Build status: STARTED
[23:06:54.509] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:88:0) after 5m32s
[23:12:26.733] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:88:0)
[23:12:26.762] Build status: STARTED
[23:12:26.762] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:89:0) after 5m47s
[23:18:13.786] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:89:0)
[23:18:13.813] Build status: STARTED
[23:18:13.813] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:90:0) after 2m8s
[23:20:21.946] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:90:0)
[23:20:21.969] Build status: STARTED
[23:20:21.969] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:91:0) after 8m56s
[23:29:18.151] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:91:0)
[23:29:18.197] Build status: STARTED
[23:29:18.197] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:92:0) after 6m51s
[23:36:09.223] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:92:0)
[23:36:09.252] Build status: STARTED
[23:36:09.252] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:93:0) after 7m13s
[23:43:22.885] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:93:0)
[23:43:22.902] Build status: STARTED
[23:43:22.902] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:94:0) after 1m2s
[23:44:24.972] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:94:0)
[23:44:25.022] Build status: STARTED
[23:44:25.022] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:95:0) after 7m31s
[23:51:56.044] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:95:0)
[23:51:56.066] Build status: STARTED
[23:51:56.066] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:96:0) after 9m53s
[00:01:49.154] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:96:0)
[00:01:49.196] Build status: STARTED
[00:01:49.196] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:97:0) after 9m38s
[00:11:27.298] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:97:0)
[00:11:27.315] Build status: STARTED
[00:11:27.315] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:98:0) after 3m18s
[00:14:45.344] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:98:0)
[00:14:45.391] Build status: STARTED
[00:14:45.391] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:99:0) after 7m42s
[00:22:27.405] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:99:0)
[00:22:27.426] Build status: STARTED
[00:22:27.426] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:100:0) after 8m24s
[00:30:51.608] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:100:0)
[00:30:51.626] Build status: STARTED
[00:30:51.626] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:101:0) after 3m32s
[00:34:23.713] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:101:0)
[00:34:23.730] Build status: STARTED
[00:34:23.731] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:102:0) after 1m16s
[00:35:39.755] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:102:0)
[00:35:39.841] Build status: STARTED
[00:35:39.841] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:103:0) after 7m57s
[00:43:37.060] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:103:0)
[00:43:37.078] Build status: STARTED
[00:43:37.078] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:104:0) after 9m55s
[00:53:32.102] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:104:0)
[00:53:32.125] Build status: STARTED
[00:53:32.125] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:105:0) after 8m32s
[01:02:04.237] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:105:0)
[01:02:04.261] Build status: STARTED
[01:02:04.261] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:106:0) after 7m17s
[01:09:21.315] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:106:0)
[01:09:21.340] Build status: STARTED
[01:09:21.340] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:107:0) after 3m28s
[01:12:49.785] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:107:0)
[01:12:49.824] Build status: STARTED
[01:12:49.824] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:108:0) after 1m53s
[01:14:42.839] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:108:0)
[01:14:42.872] Build status: STARTED
[01:14:42.872] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:109:0) after 3m47s
[01:18:29.886] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:109:0)
[01:18:29.905] Build status: STARTED
[01:18:29.905] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:110:0) after 8m47s
[01:27:16.980] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:110:0)
[01:27:16.998] Build status: STARTED
[01:27:16.998] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:111:0) after 1m8s
[01:28:25.113] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:111:0)
[01:28:25.133] Build status: STARTED
[01:28:25.133] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:112:0) after 1m10s
[01:29:35.178] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:112:0)
[01:29:35.343] Build status: STARTED
[01:29:35.343] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:113:0) after 3m13s
[01:32:48.360] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:113:0)
[01:32:48.390] Build status: STARTED
[01:32:48.390] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:114:0) after 6m59s
[01:39:47.422] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:114:0)
[01:39:47.440] Build status: STARTED
[01:39:47.440] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:115:0) after 6m34s
[01:46:21.506] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:115:0)
[01:46:21.527] Build status: STARTED
[01:46:21.527] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:116:0) after 6m45s
[01:53:06.588] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:116:0)
[01:53:06.605] Build status: STARTED
[01:53:06.605] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:117:0) after 3m4s
[01:56:10.661] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:117:0)
[01:56:10.678] Build status: STARTED
[01:56:10.679] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:118:0) after 2m50s
[01:59:00.697] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:118:0)
[01:59:00.716] Build status: STARTED
[01:59:00.716] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:119:0) after 5m39s
[02:04:39.848] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:119:0)
[02:04:39.863] Build status: STARTED
[02:04:39.863] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:120:0) after 2m47s
[02:07:26.987] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:120:0)
[02:07:27.005] Build status: STARTED
[02:07:27.005] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:121:0) after 7m55s
[02:15:22.002] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:121:0)
[02:15:22.022] Build status: STARTED
[02:15:22.022] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:122:0) after 3m38s
[02:19:00.138] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:122:0)
[02:19:00.165] Build status: STARTED
[02:19:00.165] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:123:0) after 1m42s
[02:20:42.187] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:123:0)
[02:20:42.211] Build status: STARTED
[02:20:42.211] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:124:0) after 2m22s
[02:23:04.306] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:124:0)
[02:23:04.324] Build status: STARTED
[02:23:04.324] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:125:0) after 2m0s
[02:25:04.494] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:125:0)
[02:25:04.511] Build status: STARTED
[02:25:04.511] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:126:0) after 4m28s
[02:29:32.619] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:126:0)
[02:29:32.635] Build status: STARTED
[02:29:32.635] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:127:0) after 3m8s
[02:32:40.723] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:127:0)
[02:32:40.758] Build status: STARTED
[02:32:40.758] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:128:0) after 1m53s
[02:34:33.797] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:128:0)
[02:34:33.814] Build status: STARTED
[02:34:33.814] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:129:0) after 5m38s
[02:40:11.833] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:129:0)
[02:40:11.864] Build status: STARTED
[02:40:11.864] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:130:0) after 6m47s
[02:46:58.990] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:130:0)
[02:46:59.011] Build status: STARTED
[02:46:59.011] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:131:0) after 8m59s
[02:55:58.146] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:131:0)
[02:55:58.173] Build status: STARTED
[02:55:58.174] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:132:0) after 9m38s
[03:05:36.434] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:132:0)
[03:05:36.468] Build status: STARTED
[03:05:36.468] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:133:0) after 5m1s
[03:10:37.648] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:133:0)
[03:10:37.677] Build status: STARTED
[03:10:37.677] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:134:0) after 3m27s
[03:14:04.822] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:134:0)
[03:14:04.849] Build status: STARTED
[03:14:04.849] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:135:0) after 8m33s
[03:22:37.967] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:135:0)
[03:22:37.987] Build status: STARTED
[03:22:37.987] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:136:0) after 5m11s
[03:27:49.103] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:136:0)
[03:27:49.122] Build status: STARTED
[03:27:49.122] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8936483378684864080:137:0) after 9m48s
[03:33:30.085] Received PubSub notification, asking Buildbucket for the build status
[03:33:30.104] Build:
{
  "id": "8771053316707754273",
  "builder": {
    "project": "chromium",
    "bucket": "reclient",
    "builder": "Windows Cross deterministic"
  },
  "number": 1646,
  "createdBy": "project:chromium",
  "createTime": "2023-09-02T15:32:26.233561873Z",
  "startTime": "2023-09-02T15:33:22.072550740Z",
  "endTime": "2023-09-03T03:33:29.840168588Z",
  "updateTime": "2023-09-03T03:33:29.840168588Z",
  "status": "INFRA_FAILURE",
  "statusDetails": {
    "timeout": {

    }
  },
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "bfc238f2159c974c44075706593d802c1ff7c38e",
      "ref": "refs/heads/main"
    }
  }
}
[03:33:30.104] Invocation finished in 12h1m5.139993801s with status FAILED