LUCI Scheduler :: chromium :: Win x64 Cross Builder (reclient compare)

Status: FAILED

Triggered by: -

Duration: 10 hours

Actions:

Definition (rev 2c5f34b1036de1e37fc417204092a72337266584)

buildbucket: <
  server: "cr-buildbucket.appspot.com"
  bucket: "reclient"
  builder: "Win x64 Cross Builder (reclient compare)"
>

Incoming triggers

f9fee809756c9975b9f7499a173ae8e0579444bb (4 months ago)

Incoming properties

{
  "branch": "refs/heads/main",
  "repository": "https://chromium.googlesource.com/chromium/src",
  "revision": "f9fee809756c9975b9f7499a173ae8e0579444bb"
}

Incoming tags

buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/f9fee809756c9975b9f7499a173ae8e0579444bb
gitiles_ref:refs/heads/main

Debug log (UTC)

[12:58:29.264] New invocation is queued and will start shortly
[12:58:30.332] Starting the invocation (attempt 1)
[12:58:30.357] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/f9fee809756c9975b9f7499a173ae8e0579444bb"
[12:58:30.357] Popped gitiles commit info from properties and tags
[12:58:30.357] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[12:58:30.357] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[12:58:30.357] Buildbucket request:
{
  "requestId": "8893278310061751200",
  "builder": {
    "project": "chromium",
    "bucket": "reclient",
    "builder": "Win x64 Cross Builder (reclient compare)"
  },
  "properties": {
    },
  "gitilesCommit": {
    "host": "chromium.googlesource.com",
    "project": "chromium/src",
    "id": "f9fee809756c9975b9f7499a173ae8e0579444bb",
    "ref": "refs/heads/main"
  },
  "tags": [
    {
      "key": "scheduler_invocation_id",
      "value": "8893278310061751200"
    },
    {
      "key": "scheduler_job_id",
      "value": "chromium/Win x64 Cross Builder (reclient compare)"
    },
    {
      "key": "user_agent",
      "value": "luci-scheduler"
    }
  ],
  "notify": {
    "pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
  }
}
[12:58:30.922] Scheduled build:
{
  "id": "8727848248176368465",
  "builder": {
    "project": "chromium",
    "bucket": "reclient",
    "builder": "Win x64 Cross Builder (reclient compare)"
  },
  "number": 2927,
  "createdBy": "project:chromium",
  "createTime": "2024-12-22T12:58:30.430501156Z",
  "updateTime": "2024-12-22T12:58:30.430501156Z",
  "status": "SCHEDULED",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "f9fee809756c9975b9f7499a173ae8e0579444bb",
      "ref": "refs/heads/main"
    }
  }
}
[12:58:30.922] Task URL: https://cr-buildbucket.appspot.com/build/8727848248176368465
[12:58:30.922] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:2:0) after 2m55s
[12:58:31.207] Received PubSub notification, asking Buildbucket for the build status
[12:58:31.278] Build status: SCHEDULED
[12:58:41.937] Received PubSub notification, asking Buildbucket for the build status
[12:58:42.042] Build status: STARTED
[13:01:25.997] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:2:0)
[13:01:26.025] Build status: STARTED
[13:01:26.025] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:5:0) after 8m41s
[13:10:07.098] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:5:0)
[13:10:07.122] Build status: STARTED
[13:10:07.122] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:6:0) after 6m50s
[13:16:57.158] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:6:0)
[13:16:57.183] Build status: STARTED
[13:16:57.183] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:7:0) after 1m30s
[13:18:27.200] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:7:0)
[13:18:27.232] Build status: STARTED
[13:18:27.232] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:8:0) after 5m33s
[13:24:00.256] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:8:0)
[13:24:00.290] Build status: STARTED
[13:24:00.290] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:9:0) after 8m59s
[13:32:59.455] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:9:0)
[13:32:59.484] Build status: STARTED
[13:32:59.484] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:10:0) after 7m9s
[13:40:08.770] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:10:0)
[13:40:08.805] Build status: STARTED
[13:40:08.805] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:11:0) after 2m44s
[13:42:52.829] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:11:0)
[13:42:52.855] Build status: STARTED
[13:42:52.855] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:12:0) after 1m26s
[13:44:18.874] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:12:0)
[13:44:18.912] Build status: STARTED
[13:44:18.912] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:13:0) after 6m35s
[13:50:54.080] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:13:0)
[13:50:54.104] Build status: STARTED
[13:50:54.104] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:14:0) after 8m19s
[13:59:13.332] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:14:0)
[13:59:13.356] Build status: STARTED
[13:59:13.356] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:15:0) after 1m14s
[14:00:27.375] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:15:0)
[14:00:27.402] Build status: STARTED
[14:00:27.402] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:16:0) after 8m38s
[14:09:05.545] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:16:0)
[14:09:05.579] Build status: STARTED
[14:09:05.579] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:17:0) after 1m57s
[14:11:02.819] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:17:0)
[14:11:02.837] Build status: STARTED
[14:11:02.837] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:18:0) after 7m2s
[14:18:04.912] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:18:0)
[14:18:04.937] Build status: STARTED
[14:18:04.937] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:19:0) after 9m8s
[14:27:13.008] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:19:0)
[14:27:13.034] Build status: STARTED
[14:27:13.034] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:20:0) after 3m57s
[14:31:10.056] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:20:0)
[14:31:10.072] Build status: STARTED
[14:31:10.072] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:21:0) after 5m6s
[14:36:16.178] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:21:0)
[14:36:16.197] Build status: STARTED
[14:36:16.197] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:22:0) after 1m54s
[14:38:10.220] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:22:0)
[14:38:10.238] Build status: STARTED
[14:38:10.238] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:23:0) after 9m18s
[14:47:28.256] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:23:0)
[14:47:28.271] Build status: STARTED
[14:47:28.271] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:24:0) after 5m58s
[14:53:26.291] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:24:0)
[14:53:26.331] Build status: STARTED
[14:53:26.331] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:25:0) after 2m5s
[14:55:31.354] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:25:0)
[14:55:31.377] Build status: STARTED
[14:55:31.377] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:26:0) after 3m41s
[14:59:12.512] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:26:0)
[14:59:12.531] Build status: STARTED
[14:59:12.532] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:27:0) after 6m50s
[15:06:02.556] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:27:0)
[15:06:02.572] Build status: STARTED
[15:06:02.572] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:28:0) after 9m59s
[15:16:01.701] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:28:0)
[15:16:01.721] Build status: STARTED
[15:16:01.721] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:29:0) after 5m17s
[15:21:18.742] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:29:0)
[15:21:18.756] Build status: STARTED
[15:21:18.756] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:30:0) after 6m17s
[15:27:35.757] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:30:0)
[15:27:35.780] Build status: STARTED
[15:27:35.780] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:31:0) after 6m8s
[15:33:43.806] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:31:0)
[15:33:43.826] Build status: STARTED
[15:33:43.826] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:32:0) after 3m19s
[15:37:02.815] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:32:0)
[15:37:02.837] Build status: STARTED
[15:37:02.837] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:33:0) after 1m44s
[15:38:46.892] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:33:0)
[15:38:46.906] Build status: STARTED
[15:38:46.906] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:34:0) after 3m32s
[15:42:18.930] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:34:0)
[15:42:18.945] Build status: STARTED
[15:42:18.945] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:35:0) after 8m19s
[15:50:37.969] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:35:0)
[15:50:38.015] Build status: STARTED
[15:50:38.015] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:36:0) after 7m14s
[15:57:52.034] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:36:0)
[15:57:52.050] Build status: STARTED
[15:57:52.050] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:37:0) after 2m50s
[16:00:42.081] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:37:0)
[16:00:42.101] Build status: STARTED
[16:00:42.101] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:38:0) after 6m8s
[16:06:50.477] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:38:0)
[16:06:50.503] Build status: STARTED
[16:06:50.503] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:39:0) after 8m3s
[16:14:53.642] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:39:0)
[16:14:53.672] Build status: STARTED
[16:14:53.672] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:40:0) after 5m33s
[16:20:26.711] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:40:0)
[16:20:26.770] Build status: STARTED
[16:20:26.771] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:41:0) after 9m9s
[16:29:35.807] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:41:0)
[16:29:35.826] Build status: STARTED
[16:29:35.826] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:42:0) after 6m31s
[16:36:06.857] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:42:0)
[16:36:06.917] Build status: STARTED
[16:36:06.917] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:43:0) after 5m2s
[16:41:08.937] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:43:0)
[16:41:08.958] Build status: STARTED
[16:41:08.958] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:44:0) after 4m53s
[16:46:02.023] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:44:0)
[16:46:02.050] Build status: STARTED
[16:46:02.050] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:45:0) after 1m45s
[16:47:47.081] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:45:0)
[16:47:47.111] Build status: STARTED
[16:47:47.111] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:46:0) after 3m36s
[16:51:23.159] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:46:0)
[16:51:23.178] Build status: STARTED
[16:51:23.178] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:47:0) after 7m4s
[16:58:27.209] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:47:0)
[16:58:27.233] Build status: STARTED
[16:58:27.233] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:48:0) after 3m45s
[17:02:12.359] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:48:0)
[17:02:12.384] Build status: STARTED
[17:02:12.384] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:49:0) after 1m36s
[17:03:48.411] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:49:0)
[17:03:48.428] Build status: STARTED
[17:03:48.428] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:50:0) after 1m25s
[17:05:13.605] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:50:0)
[17:05:13.633] Build status: STARTED
[17:05:13.633] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:51:0) after 7m14s
[17:12:27.658] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:51:0)
[17:12:27.679] Build status: STARTED
[17:12:27.679] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:52:0) after 2m37s
[17:15:04.705] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:52:0)
[17:15:04.731] Build status: STARTED
[17:15:04.731] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:53:0) after 7m33s
[17:22:37.914] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:53:0)
[17:22:37.941] Build status: STARTED
[17:22:37.941] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:54:0) after 2m29s
[17:25:06.970] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:54:0)
[17:25:06.988] Build status: STARTED
[17:25:06.988] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:55:0) after 6m43s
[17:31:50.009] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:55:0)
[17:31:50.033] Build status: STARTED
[17:31:50.033] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:56:0) after 1m0s
[17:32:50.157] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:56:0)
[17:32:50.182] Build status: STARTED
[17:32:50.182] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:57:0) after 3m53s
[17:36:43.198] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:57:0)
[17:36:43.214] Build status: STARTED
[17:36:43.214] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:58:0) after 4m36s
[17:41:19.537] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:58:0)
[17:41:19.576] Build status: STARTED
[17:41:19.576] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:59:0) after 5m37s
[17:46:56.660] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:59:0)
[17:46:56.686] Build status: STARTED
[17:46:56.686] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:60:0) after 4m22s
[17:51:18.997] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:60:0)
[17:51:19.019] Build status: STARTED
[17:51:19.019] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:61:0) after 3m48s
[17:55:07.262] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:61:0)
[17:55:07.277] Build status: STARTED
[17:55:07.277] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:62:0) after 3m16s
[17:58:23.515] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:62:0)
[17:58:23.534] Build status: STARTED
[17:58:23.534] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:63:0) after 2m40s
[18:01:03.558] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:63:0)
[18:01:03.592] Build status: STARTED
[18:01:03.592] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:64:0) after 8m0s
[18:09:03.612] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:64:0)
[18:09:03.640] Build status: STARTED
[18:09:03.640] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:65:0) after 1m40s
[18:10:43.662] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:65:0)
[18:10:43.680] Build status: STARTED
[18:10:43.680] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:66:0) after 5m37s
[18:16:20.741] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:66:0)
[18:16:20.789] Build status: STARTED
[18:16:20.789] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:67:0) after 2m15s
[18:18:35.846] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:67:0)
[18:18:35.873] Build status: STARTED
[18:18:35.873] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:68:0) after 1m40s
[18:20:15.888] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:68:0)
[18:20:15.905] Build status: STARTED
[18:20:15.905] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:69:0) after 9m57s
[18:30:13.058] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:69:0)
[18:30:13.075] Build status: STARTED
[18:30:13.075] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:70:0) after 5m14s
[18:35:27.137] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:70:0)
[18:35:27.154] Build status: STARTED
[18:35:27.155] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:71:0) after 2m46s
[18:38:13.383] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:71:0)
[18:38:13.447] Build status: STARTED
[18:38:13.447] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:72:0) after 5m39s
[18:43:52.474] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:72:0)
[18:43:52.516] Build status: STARTED
[18:43:52.516] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:73:0) after 8m57s
[18:52:49.535] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:73:0)
[18:52:49.605] Build status: STARTED
[18:52:49.605] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:74:0) after 8m59s
[19:01:49.308] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:74:0)
[19:01:49.326] Build status: STARTED
[19:01:49.326] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:75:0) after 1m53s
[19:03:42.343] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:75:0)
[19:03:42.361] Build status: STARTED
[19:03:42.361] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:76:0) after 7m22s
[19:11:04.430] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:76:0)
[19:11:04.468] Build status: STARTED
[19:11:04.468] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:77:0) after 3m58s
[19:15:02.632] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:77:0)
[19:15:02.667] Build status: STARTED
[19:15:02.667] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:78:0) after 2m28s
[19:17:30.708] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:78:0)
[19:17:30.767] Build status: STARTED
[19:17:30.767] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:79:0) after 2m14s
[19:19:44.817] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:79:0)
[19:19:44.835] Build status: STARTED
[19:19:44.835] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:80:0) after 6m12s
[19:25:56.864] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:80:0)
[19:25:56.912] Build status: STARTED
[19:25:56.912] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:81:0) after 5m0s
[19:30:56.985] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:81:0)
[19:30:57.014] Build status: STARTED
[19:30:57.015] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:82:0) after 7m48s
[19:38:45.042] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:82:0)
[19:38:45.115] Build status: STARTED
[19:38:45.115] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:83:0) after 8m40s
[19:47:25.202] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:83:0)
[19:47:25.220] Build status: STARTED
[19:47:25.221] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:84:0) after 8m49s
[19:56:14.338] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:84:0)
[19:56:14.359] Build status: STARTED
[19:56:14.359] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:85:0) after 7m21s
[20:03:35.509] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:85:0)
[20:03:35.543] Build status: STARTED
[20:03:35.543] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:86:0) after 1m26s
[20:05:01.598] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:86:0)
[20:05:01.617] Build status: STARTED
[20:05:01.617] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:87:0) after 6m19s
[20:11:20.727] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:87:0)
[20:11:20.748] Build status: STARTED
[20:11:20.748] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:88:0) after 9m2s
[20:20:22.813] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:88:0)
[20:20:22.922] Build status: STARTED
[20:20:22.922] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:89:0) after 9m22s
[20:29:45.267] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:89:0)
[20:29:45.284] Build status: STARTED
[20:29:45.284] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:90:0) after 2m45s
[20:32:30.307] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:90:0)
[20:32:30.336] Build status: STARTED
[20:32:30.336] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:91:0) after 1m57s
[20:34:27.368] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:91:0)
[20:34:27.419] Build status: STARTED
[20:34:27.419] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:92:0) after 2m16s
[20:36:43.441] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:92:0)
[20:36:43.457] Build status: STARTED
[20:36:43.457] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:93:0) after 3m11s
[20:39:54.528] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:93:0)
[20:39:54.572] Build status: STARTED
[20:39:54.572] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:94:0) after 3m32s
[20:43:26.615] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:94:0)
[20:43:26.644] Build status: STARTED
[20:43:26.645] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:95:0) after 4m43s
[20:48:09.673] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:95:0)
[20:48:09.702] Build status: STARTED
[20:48:09.702] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:96:0) after 8m32s
[20:56:41.725] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:96:0)
[20:56:41.743] Build status: STARTED
[20:56:41.743] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:97:0) after 8m37s
[21:05:18.763] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:97:0)
[21:05:18.834] Build status: STARTED
[21:05:18.834] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:98:0) after 6m46s
[21:12:04.861] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:98:0)
[21:12:04.925] Build status: STARTED
[21:12:04.925] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:99:0) after 6m29s
[21:18:34.034] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:99:0)
[21:18:34.108] Build status: STARTED
[21:18:34.108] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:100:0) after 2m36s
[21:21:10.235] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:100:0)
[21:21:10.263] Build status: STARTED
[21:21:10.263] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:101:0) after 5m38s
[21:26:48.653] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:101:0)
[21:26:48.675] Build status: STARTED
[21:26:48.675] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:102:0) after 3m52s
[21:30:40.783] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:102:0)
[21:30:40.886] Build status: STARTED
[21:30:40.886] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:103:0) after 4m13s
[21:34:54.222] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:103:0)
[21:34:54.240] Build status: STARTED
[21:34:54.241] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:104:0) after 2m7s
[21:37:01.449] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:104:0)
[21:37:01.471] Build status: STARTED
[21:37:01.471] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:105:0) after 4m48s
[21:41:49.871] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:105:0)
[21:41:49.886] Build status: STARTED
[21:41:49.887] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:106:0) after 9m34s
[21:51:23.917] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:106:0)
[21:51:23.935] Build status: STARTED
[21:51:23.935] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:107:0) after 9m47s
[22:01:10.965] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:107:0)
[22:01:10.994] Build status: STARTED
[22:01:10.994] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:108:0) after 7m24s
[22:08:35.064] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:108:0)
[22:08:35.097] Build status: STARTED
[22:08:35.097] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:109:0) after 6m45s
[22:15:20.387] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:109:0)
[22:15:20.406] Build status: STARTED
[22:15:20.406] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:110:0) after 5m39s
[22:20:59.428] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:110:0)
[22:20:59.447] Build status: STARTED
[22:20:59.447] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:111:0) after 9m42s
[22:30:41.553] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:111:0)
[22:30:41.653] Build status: STARTED
[22:30:41.653] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:112:0) after 2m34s
[22:33:15.681] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:112:0)
[22:33:15.804] Build status: STARTED
[22:33:15.804] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:113:0) after 1m25s
[22:34:40.916] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:113:0)
[22:34:40.971] Build status: STARTED
[22:34:40.971] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:114:0) after 9m27s
[22:44:07.998] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:114:0)
[22:44:08.014] Build status: STARTED
[22:44:08.014] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:115:0) after 4m38s
[22:48:46.111] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:115:0)
[22:48:46.147] Build status: STARTED
[22:48:46.147] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:116:0) after 5m5s
[22:53:51.271] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:116:0)
[22:53:51.356] Build status: STARTED
[22:53:51.356] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:117:0) after 7m48s
[23:01:39.457] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:117:0)
[23:01:39.500] Build status: STARTED
[23:01:39.500] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:118:0) after 9m4s
[23:10:43.520] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:118:0)
[23:10:43.543] Build status: STARTED
[23:10:43.543] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:119:0) after 6m35s
[23:17:18.570] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:119:0)
[23:17:18.590] Build status: STARTED
[23:17:18.590] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:120:0) after 7m30s
[23:24:48.610] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:120:0)
[23:24:48.628] Build status: STARTED
[23:24:48.628] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:121:0) after 7m27s
[23:32:15.706] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:121:0)
[23:32:15.720] Build status: STARTED
[23:32:15.720] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:122:0) after 3m45s
[23:36:00.745] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:122:0)
[23:36:00.765] Build status: STARTED
[23:36:00.765] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:123:0) after 3m28s
[23:39:28.793] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:123:0)
[23:39:28.809] Build status: STARTED
[23:39:28.809] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:124:0) after 5m46s
[23:45:14.849] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:124:0)
[23:45:14.904] Build status: STARTED
[23:45:14.904] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8893278310061751200:125:0) after 4m25s
[23:49:06.780] Received PubSub notification, asking Buildbucket for the build status
[23:49:06.817] Build:
{
  "id": "8727848248176368465",
  "builder": {
    "project": "chromium",
    "bucket": "reclient",
    "builder": "Win x64 Cross Builder (reclient compare)"
  },
  "number": 2927,
  "createdBy": "project:chromium",
  "createTime": "2024-12-22T12:58:30.430501156Z",
  "startTime": "2024-12-22T12:58:41.602116775Z",
  "endTime": "2024-12-22T23:49:06.425724077Z",
  "updateTime": "2024-12-22T23:49:06.425724077Z",
  "status": "INFRA_FAILURE",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "f9fee809756c9975b9f7499a173ae8e0579444bb",
      "ref": "refs/heads/main"
    }
  }
}
[23:49:06.817] Invocation finished in 10h50m37.567929503s with status FAILED