LUCI Scheduler :: chromium :: Comparison Windows (8 cores) (reclient)

Status: FAILED

Triggered by: -

Duration: 14 hours

Actions:

Definition (rev 5f48f9b71d3376196ff86f4a92825b511702d8bc)

buildbucket: <
  server: "cr-buildbucket.appspot.com"
  bucket: "ci"
  builder: "Comparison Windows (8 cores) (reclient)"
>

Incoming triggers

93330e25bbf9e03835c5a1310c9e90283be5edc0 (2 months ago)
0102cc292018ccd16435cf6bb6f8dc081fcb9432 (2 months ago)
07305b8f1a54c9cb1cb6af1ff3292feff3bcf557 (2 months ago)
5246cb88668fae4844d41c0deaf348b9f6e647a0 (2 months ago)
6c1184706c2b26c41a53abda90e05aec12071da2 (2 months ago)
3032802a866523b4cc940d9b93d16a09138a0ca2 (2 months ago)
1618db2c2ea543038fcbe98e1c605cfa482f1944 (2 months ago)
82fda297b51c9c969a45a39646aeb3e66675f7db (2 months ago)
735e5acdfad6daac78b3d2ea4d8ce945aa456008 (2 months ago)
00286af3592f11a16ef120d0213b361c39a63720 (2 months ago)
87affcdb1c223fa63c8cd7ceb3144871823083d6 (2 months ago)
3d3c698548cfc9ddfecd370373d4ca4bd23f84ac (2 months ago)
6516328c57c50017e410e890774c362ef75d1002 (2 months ago)
1de0bb5d4018a95e7b885ecb439cbec2dae35ebf (2 months ago)
27d27a431acbfc7f77ae143cfb5f94a3fbe4be91 (2 months ago)

Incoming properties

{
  "branch": "refs/heads/main",
  "repository": "https://chromium.googlesource.com/chromium/src",
  "revision": "27d27a431acbfc7f77ae143cfb5f94a3fbe4be91"
}

Incoming tags

buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/27d27a431acbfc7f77ae143cfb5f94a3fbe4be91
gitiles_ref:refs/heads/main

Debug log (UTC)

[22:41:12.953] New invocation is queued and will start shortly
[22:41:14.092] Starting the invocation (attempt 1)
[22:41:14.125] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/27d27a431acbfc7f77ae143cfb5f94a3fbe4be91"
[22:41:14.125] Popped gitiles commit info from properties and tags
[22:41:14.125] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[22:41:14.126] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[22:41:14.126] Buildbucket request:
{
  "requestId": "8896956123666453056",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "Comparison Windows (8 cores) (reclient)"
  },
  "properties": {
    },
  "gitilesCommit": {
    "host": "chromium.googlesource.com",
    "project": "chromium/src",
    "id": "27d27a431acbfc7f77ae143cfb5f94a3fbe4be91",
    "ref": "refs/heads/main"
  },
  "tags": [
    {
      "key": "scheduler_invocation_id",
      "value": "8896956123666453056"
    },
    {
      "key": "scheduler_job_id",
      "value": "chromium/Comparison Windows (8 cores) (reclient)"
    },
    {
      "key": "user_agent",
      "value": "luci-scheduler"
    }
  ],
  "notify": {
    "pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
  }
}
[22:41:14.852] Scheduled build:
{
  "id": "8731526061641612881",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "Comparison Windows (8 cores) (reclient)"
  },
  "number": 4011,
  "createdBy": "project:chromium",
  "createTime": "2024-11-11T22:41:14.188460119Z",
  "updateTime": "2024-11-11T22:41:14.188460119Z",
  "status": "SCHEDULED",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "27d27a431acbfc7f77ae143cfb5f94a3fbe4be91",
      "ref": "refs/heads/main"
    }
  }
}
[22:41:14.852] Task URL: https://cr-buildbucket.appspot.com/build/8731526061641612881
[22:41:14.852] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:2:0) after 7m48s
[22:41:15.778] Received PubSub notification, asking Buildbucket for the build status
[22:41:15.832] Build status: SCHEDULED
[22:43:04.701] Received PubSub notification, asking Buildbucket for the build status
[22:43:04.804] Build status: STARTED
[22:49:02.900] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:2:0)
[22:49:02.917] Build status: STARTED
[22:49:02.917] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:5:0) after 1m14s
[22:50:16.981] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:5:0)
[22:50:17.020] Build status: STARTED
[22:50:17.020] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:6:0) after 3m25s
[22:53:42.042] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:6:0)
[22:53:42.060] Build status: STARTED
[22:53:42.061] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:7:0) after 8m24s
[23:02:06.119] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:7:0)
[23:02:06.144] Build status: STARTED
[23:02:06.144] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:8:0) after 5m36s
[23:07:42.168] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:8:0)
[23:07:42.186] Build status: STARTED
[23:07:42.186] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:9:0) after 9m37s
[23:17:19.200] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:9:0)
[23:17:19.219] Build status: STARTED
[23:17:19.219] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:10:0) after 7m4s
[23:24:23.281] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:10:0)
[23:24:23.300] Build status: STARTED
[23:24:23.300] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:11:0) after 9m0s
[23:33:23.317] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:11:0)
[23:33:23.343] Build status: STARTED
[23:33:23.343] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:12:0) after 5m31s
[23:38:54.989] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:12:0)
[23:38:55.012] Build status: STARTED
[23:38:55.012] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:13:0) after 5m20s
[23:44:15.029] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:13:0)
[23:44:15.054] Build status: STARTED
[23:44:15.054] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:14:0) after 1m56s
[23:46:11.099] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:14:0)
[23:46:11.121] Build status: STARTED
[23:46:11.121] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:15:0) after 7m43s
[23:53:54.236] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:15:0)
[23:53:54.253] Build status: STARTED
[23:53:54.253] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:16:0) after 7m31s
[00:01:25.321] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:16:0)
[00:01:25.338] Build status: STARTED
[00:01:25.338] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:17:0) after 3m7s
[00:04:32.398] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:17:0)
[00:04:32.415] Build status: STARTED
[00:04:32.415] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:18:0) after 2m34s
[00:07:06.479] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:18:0)
[00:07:06.513] Build status: STARTED
[00:07:06.513] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:19:0) after 6m48s
[00:13:54.491] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:19:0)
[00:13:54.514] Build status: STARTED
[00:13:54.514] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:20:0) after 5m1s
[00:18:55.509] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:20:0)
[00:18:55.527] Build status: STARTED
[00:18:55.527] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:21:0) after 3m20s
[00:22:15.553] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:21:0)
[00:22:15.573] Build status: STARTED
[00:22:15.573] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:22:0) after 1m41s
[00:23:56.591] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:22:0)
[00:23:56.622] Build status: STARTED
[00:23:56.622] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:23:0) after 6m0s
[00:29:56.688] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:23:0)
[00:29:56.710] Build status: STARTED
[00:29:56.710] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:24:0) after 8m52s
[00:38:48.745] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:24:0)
[00:38:48.769] Build status: STARTED
[00:38:48.769] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:25:0) after 8m8s
[00:46:56.831] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:25:0)
[00:46:56.851] Build status: STARTED
[00:46:56.851] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:26:0) after 3m3s
[00:49:59.919] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:26:0)
[00:49:59.945] Build status: STARTED
[00:49:59.945] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:27:0) after 4m31s
[00:54:30.913] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:27:0)
[00:54:30.932] Build status: STARTED
[00:54:30.932] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:28:0) after 6m26s
[01:00:57.026] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:28:0)
[01:00:57.045] Build status: STARTED
[01:00:57.045] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:29:0) after 1m38s
[01:02:35.065] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:29:0)
[01:02:35.098] Build status: STARTED
[01:02:35.098] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:30:0) after 4m18s
[01:06:53.115] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:30:0)
[01:06:53.137] Build status: STARTED
[01:06:53.138] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:31:0) after 6m12s
[01:13:05.108] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:31:0)
[01:13:05.124] Build status: STARTED
[01:13:05.124] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:32:0) after 6m0s
[01:19:05.143] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:32:0)
[01:19:05.162] Build status: STARTED
[01:19:05.162] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:33:0) after 1m50s
[01:20:55.262] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:33:0)
[01:20:55.318] Build status: STARTED
[01:20:55.318] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:34:0) after 4m49s
[01:25:44.384] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:34:0)
[01:25:44.438] Build status: STARTED
[01:25:44.438] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:35:0) after 8m7s
[01:33:51.532] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:35:0)
[01:33:51.557] Build status: STARTED
[01:33:51.557] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:36:0) after 5m7s
[01:38:58.607] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:36:0)
[01:38:58.649] Build status: STARTED
[01:38:58.649] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:37:0) after 4m14s
[01:43:12.667] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:37:0)
[01:43:12.699] Build status: STARTED
[01:43:12.699] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:38:0) after 1m25s
[01:44:37.716] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:38:0)
[01:44:37.744] Build status: STARTED
[01:44:37.744] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:39:0) after 7m53s
[01:52:30.762] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:39:0)
[01:52:30.783] Build status: STARTED
[01:52:30.784] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:40:0) after 3m7s
[01:55:37.855] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:40:0)
[01:55:37.873] Build status: STARTED
[01:55:37.873] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:41:0) after 7m52s
[02:03:30.004] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:41:0)
[02:03:30.021] Build status: STARTED
[02:03:30.021] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:42:0) after 6m21s
[02:09:51.042] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:42:0)
[02:09:51.061] Build status: STARTED
[02:09:51.061] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:43:0) after 3m55s
[02:13:46.080] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:43:0)
[02:13:46.099] Build status: STARTED
[02:13:46.099] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:44:0) after 5m45s
[02:19:31.202] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:44:0)
[02:19:31.233] Build status: STARTED
[02:19:31.233] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:45:0) after 2m18s
[02:21:49.255] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:45:0)
[02:21:49.279] Build status: STARTED
[02:21:49.279] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:46:0) after 3m11s
[02:25:00.303] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:46:0)
[02:25:00.345] Build status: STARTED
[02:25:00.345] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:47:0) after 8m43s
[02:33:43.413] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:47:0)
[02:33:43.430] Build status: STARTED
[02:33:43.430] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:48:0) after 2m19s
[02:36:02.517] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:48:0)
[02:36:02.535] Build status: STARTED
[02:36:02.535] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:49:0) after 7m30s
[02:43:32.647] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:49:0)
[02:43:32.668] Build status: STARTED
[02:43:32.668] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:50:0) after 7m0s
[02:50:33.555] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:50:0)
[02:50:33.573] Build status: STARTED
[02:50:33.573] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:51:0) after 6m16s
[02:56:49.804] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:51:0)
[02:56:49.887] Build status: STARTED
[02:56:49.887] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:52:0) after 7m13s
[03:04:02.904] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:52:0)
[03:04:02.926] Build status: STARTED
[03:04:02.926] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:53:0) after 3m39s
[03:07:41.952] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:53:0)
[03:07:41.975] Build status: STARTED
[03:07:41.975] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:54:0) after 4m25s
[03:12:06.996] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:54:0)
[03:12:07.094] Build status: STARTED
[03:12:07.094] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:55:0) after 3m10s
[03:15:17.417] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:55:0)
[03:15:17.469] Build status: STARTED
[03:15:17.469] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:56:0) after 8m38s
[03:23:55.496] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:56:0)
[03:23:55.512] Build status: STARTED
[03:23:55.512] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:57:0) after 9m12s
[03:33:07.543] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:57:0)
[03:33:07.565] Build status: STARTED
[03:33:07.565] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:58:0) after 5m2s
[03:38:09.611] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:58:0)
[03:38:09.637] Build status: STARTED
[03:38:09.637] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:59:0) after 8m37s
[03:46:46.862] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:59:0)
[03:46:46.884] Build status: STARTED
[03:46:46.884] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:60:0) after 1m41s
[03:48:28.128] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:60:0)
[03:48:28.144] Build status: STARTED
[03:48:28.144] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:61:0) after 8m10s
[03:56:38.162] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:61:0)
[03:56:38.183] Build status: STARTED
[03:56:38.183] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:62:0) after 7m11s
[04:03:49.386] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:62:0)
[04:03:49.411] Build status: STARTED
[04:03:49.411] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:63:0) after 1m41s
[04:05:30.515] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:63:0)
[04:05:30.534] Build status: STARTED
[04:05:30.534] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:64:0) after 9m15s
[04:14:45.659] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:64:0)
[04:14:45.691] Build status: STARTED
[04:14:45.691] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:65:0) after 5m43s
[04:20:28.786] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:65:0)
[04:20:28.806] Build status: STARTED
[04:20:28.806] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:66:0) after 6m57s
[04:27:26.322] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:66:0)
[04:27:26.339] Build status: STARTED
[04:27:26.339] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:67:0) after 2m33s
[04:29:59.360] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:67:0)
[04:29:59.379] Build status: STARTED
[04:29:59.379] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:68:0) after 9m57s
[04:39:56.401] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:68:0)
[04:39:56.424] Build status: STARTED
[04:39:56.424] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:69:0) after 3m28s
[04:43:24.442] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:69:0)
[04:43:24.458] Build status: STARTED
[04:43:24.458] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:70:0) after 4m28s
[04:47:52.469] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:70:0)
[04:47:52.488] Build status: STARTED
[04:47:52.488] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:71:0) after 7m22s
[04:55:14.859] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:71:0)
[04:55:14.909] Build status: STARTED
[04:55:14.909] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:72:0) after 7m28s
[05:02:42.941] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:72:0)
[05:02:42.960] Build status: STARTED
[05:02:42.960] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:73:0) after 5m30s
[05:08:13.059] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:73:0)
[05:08:13.086] Build status: STARTED
[05:08:13.086] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:74:0) after 3m41s
[05:11:54.204] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:74:0)
[05:11:54.223] Build status: STARTED
[05:11:54.223] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:75:0) after 1m26s
[05:13:20.240] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:75:0)
[05:13:20.262] Build status: STARTED
[05:13:20.262] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:76:0) after 4m21s
[05:17:41.332] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:76:0)
[05:17:41.413] Build status: STARTED
[05:17:41.414] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:77:0) after 1m13s
[05:18:54.432] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:77:0)
[05:18:54.452] Build status: STARTED
[05:18:54.452] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:78:0) after 2m13s
[05:21:07.568] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:78:0)
[05:21:07.588] Build status: STARTED
[05:21:07.588] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:79:0) after 6m18s
[05:27:26.515] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:79:0)
[05:27:26.532] Build status: STARTED
[05:27:26.533] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:80:0) after 6m41s
[05:34:07.776] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:80:0)
[05:34:07.826] Build status: STARTED
[05:34:07.826] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:81:0) after 9m19s
[05:43:26.845] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:81:0)
[05:43:26.863] Build status: STARTED
[05:43:26.864] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:82:0) after 6m0s
[05:49:26.933] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:82:0)
[05:49:26.956] Build status: STARTED
[05:49:26.956] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:83:0) after 6m19s
[05:55:46.259] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:83:0)
[05:55:46.326] Build status: STARTED
[05:55:46.326] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:84:0) after 8m20s
[06:04:06.444] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:84:0)
[06:04:06.463] Build status: STARTED
[06:04:06.463] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:85:0) after 2m6s
[06:06:12.482] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:85:0)
[06:06:12.499] Build status: STARTED
[06:06:12.499] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:86:0) after 6m35s
[06:12:47.522] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:86:0)
[06:12:47.540] Build status: STARTED
[06:12:47.540] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:87:0) after 3m49s
[06:16:36.557] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:87:0)
[06:16:36.622] Build status: STARTED
[06:16:36.622] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:88:0) after 3m0s
[06:19:36.740] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:88:0)
[06:19:36.759] Build status: STARTED
[06:19:36.759] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:89:0) after 3m48s
[06:23:24.908] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:89:0)
[06:23:24.954] Build status: STARTED
[06:23:24.954] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:90:0) after 8m3s
[06:31:27.966] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:90:0)
[06:31:28.019] Build status: STARTED
[06:31:28.019] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:91:0) after 6m52s
[06:38:20.245] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:91:0)
[06:38:20.282] Build status: STARTED
[06:38:20.282] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:92:0) after 1m59s
[06:40:19.300] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:92:0)
[06:40:19.320] Build status: STARTED
[06:40:19.320] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:93:0) after 3m39s
[06:43:58.492] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:93:0)
[06:43:58.519] Build status: STARTED
[06:43:58.519] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:94:0) after 8m38s
[06:52:36.998] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:94:0)
[06:52:37.020] Build status: STARTED
[06:52:37.020] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:95:0) after 4m21s
[06:56:58.039] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:95:0)
[06:56:58.056] Build status: STARTED
[06:56:58.056] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:96:0) after 6m8s
[07:03:06.081] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:96:0)
[07:03:06.096] Build status: STARTED
[07:03:06.096] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:97:0) after 9m1s
[07:12:07.113] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:97:0)
[07:12:07.148] Build status: STARTED
[07:12:07.148] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:98:0) after 6m2s
[07:18:09.382] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:98:0)
[07:18:09.401] Build status: STARTED
[07:18:09.401] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:99:0) after 5m56s
[07:24:05.906] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:99:0)
[07:24:05.947] Build status: STARTED
[07:24:05.947] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:100:0) after 6m44s
[07:30:49.965] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:100:0)
[07:30:49.982] Build status: STARTED
[07:30:49.982] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:101:0) after 4m28s
[07:35:18.545] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:101:0)
[07:35:18.568] Build status: STARTED
[07:35:18.568] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:102:0) after 9m11s
[07:44:29.589] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:102:0)
[07:44:29.614] Build status: STARTED
[07:44:29.614] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:103:0) after 1m19s
[07:45:48.704] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:103:0)
[07:45:48.730] Build status: STARTED
[07:45:48.730] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:104:0) after 6m21s
[07:52:09.875] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:104:0)
[07:52:09.896] Build status: STARTED
[07:52:09.896] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:105:0) after 3m34s
[07:55:44.122] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:105:0)
[07:55:44.142] Build status: STARTED
[07:55:44.142] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:106:0) after 7m0s
[08:02:44.195] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:106:0)
[08:02:44.223] Build status: STARTED
[08:02:44.223] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:107:0) after 4m43s
[08:07:27.283] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:107:0)
[08:07:27.300] Build status: STARTED
[08:07:27.300] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:108:0) after 3m58s
[08:11:25.275] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:108:0)
[08:11:25.297] Build status: STARTED
[08:11:25.297] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:109:0) after 2m50s
[08:14:15.315] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:109:0)
[08:14:15.334] Build status: STARTED
[08:14:15.334] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:110:0) after 6m38s
[08:20:53.633] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:110:0)
[08:20:53.651] Build status: STARTED
[08:20:53.651] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:111:0) after 5m53s
[08:26:46.671] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:111:0)
[08:26:46.691] Build status: STARTED
[08:26:46.691] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:112:0) after 1m4s
[08:27:50.726] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:112:0)
[08:27:50.747] Build status: STARTED
[08:27:50.747] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:113:0) after 3m50s
[08:31:40.769] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:113:0)
[08:31:40.794] Build status: STARTED
[08:31:40.794] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:114:0) after 2m35s
[08:34:15.929] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:114:0)
[08:34:15.971] Build status: STARTED
[08:34:15.971] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:115:0) after 5m27s
[08:39:43.040] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:115:0)
[08:39:43.058] Build status: STARTED
[08:39:43.058] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:116:0) after 2m10s
[08:41:53.087] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:116:0)
[08:41:53.105] Build status: STARTED
[08:41:53.105] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:117:0) after 5m0s
[08:46:54.486] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:117:0)
[08:46:54.535] Build status: STARTED
[08:46:54.535] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:118:0) after 7m1s
[08:53:55.561] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:118:0)
[08:53:55.578] Build status: STARTED
[08:53:55.578] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:119:0) after 3m4s
[08:56:59.596] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:119:0)
[08:56:59.614] Build status: STARTED
[08:56:59.614] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:120:0) after 8m15s
[09:05:14.633] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:120:0)
[09:05:14.651] Build status: STARTED
[09:05:14.651] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:121:0) after 7m57s
[09:13:11.771] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:121:0)
[09:13:11.789] Build status: STARTED
[09:13:11.789] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:122:0) after 8m49s
[09:22:00.865] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:122:0)
[09:22:00.892] Build status: STARTED
[09:22:00.893] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:123:0) after 4m41s
[09:26:42.012] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:123:0)
[09:26:42.039] Build status: STARTED
[09:26:42.039] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:124:0) after 8m14s
[09:34:56.340] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:124:0)
[09:34:56.363] Build status: STARTED
[09:34:56.363] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:125:0) after 9m16s
[09:44:12.381] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:125:0)
[09:44:12.400] Build status: STARTED
[09:44:12.400] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:126:0) after 5m45s
[09:49:57.467] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:126:0)
[09:49:57.485] Build status: STARTED
[09:49:57.485] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:127:0) after 3m10s
[09:53:07.505] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:127:0)
[09:53:07.526] Build status: STARTED
[09:53:07.526] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:128:0) after 9m26s
[10:02:33.675] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:128:0)
[10:02:33.698] Build status: STARTED
[10:02:33.698] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:129:0) after 8m5s
[10:10:38.764] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:129:0)
[10:10:38.910] Build status: STARTED
[10:10:38.910] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:130:0) after 7m31s
[10:18:10.026] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:130:0)
[10:18:10.045] Build status: STARTED
[10:18:10.045] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:131:0) after 7m20s
[10:25:30.120] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:131:0)
[10:25:30.143] Build status: STARTED
[10:25:30.143] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:132:0) after 4m52s
[10:30:22.294] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:132:0)
[10:30:22.311] Build status: STARTED
[10:30:22.311] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:133:0) after 7m51s
[10:38:13.334] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:133:0)
[10:38:13.357] Build status: STARTED
[10:38:13.357] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:134:0) after 9m52s
[10:48:05.645] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:134:0)
[10:48:05.663] Build status: STARTED
[10:48:05.663] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:135:0) after 8m42s
[10:56:47.859] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:135:0)
[10:56:47.896] Build status: STARTED
[10:56:47.896] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:136:0) after 2m26s
[10:59:14.069] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:136:0)
[10:59:14.099] Build status: STARTED
[10:59:14.099] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:137:0) after 5m20s
[11:04:34.121] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:137:0)
[11:04:34.144] Build status: STARTED
[11:04:34.144] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:138:0) after 7m4s
[11:11:38.197] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:138:0)
[11:11:38.218] Build status: STARTED
[11:11:38.218] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:139:0) after 4m36s
[11:16:14.415] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:139:0)
[11:16:14.493] Build status: STARTED
[11:16:14.493] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:140:0) after 4m50s
[11:21:04.542] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:140:0)
[11:21:04.607] Build status: STARTED
[11:21:04.607] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:141:0) after 2m29s
[11:23:33.672] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:141:0)
[11:23:33.698] Build status: STARTED
[11:23:33.698] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:142:0) after 2m10s
[11:25:43.777] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:142:0)
[11:25:43.839] Build status: STARTED
[11:25:43.839] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:143:0) after 8m40s
[11:34:24.188] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:143:0)
[11:34:24.206] Build status: STARTED
[11:34:24.206] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:144:0) after 6m44s
[11:41:08.334] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:144:0)
[11:41:08.358] Build status: STARTED
[11:41:08.358] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:145:0) after 2m35s
[11:43:43.380] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:145:0)
[11:43:43.397] Build status: STARTED
[11:43:43.397] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:146:0) after 4m2s
[11:47:45.418] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:146:0)
[11:47:45.434] Build status: STARTED
[11:47:45.435] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:147:0) after 3m14s
[11:50:59.938] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:147:0)
[11:50:59.966] Build status: STARTED
[11:50:59.966] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:148:0) after 6m32s
[11:57:32.112] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:148:0)
[11:57:32.129] Build status: STARTED
[11:57:32.129] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:149:0) after 2m20s
[11:59:52.150] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:149:0)
[11:59:52.170] Build status: STARTED
[11:59:52.170] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:150:0) after 3m23s
[12:03:15.339] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:150:0)
[12:03:15.369] Build status: STARTED
[12:03:15.369] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:151:0) after 7m45s
[12:11:00.428] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:151:0)
[12:11:00.448] Build status: STARTED
[12:11:00.448] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:152:0) after 8m36s
[12:19:36.796] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:152:0)
[12:19:36.817] Build status: STARTED
[12:19:36.817] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:153:0) after 4m41s
[12:24:17.838] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:153:0)
[12:24:17.862] Build status: STARTED
[12:24:17.862] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:154:0) after 4m51s
[12:29:08.915] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:154:0)
[12:29:08.932] Build status: STARTED
[12:29:08.932] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:155:0) after 6m46s
[12:35:54.971] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:155:0)
[12:35:54.993] Build status: STARTED
[12:35:54.993] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:156:0) after 4m30s
[12:40:25.015] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:156:0)
[12:40:25.047] Build status: STARTED
[12:40:25.047] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:157:0) after 4m40s
[12:45:05.274] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:157:0)
[12:45:05.302] Build status: STARTED
[12:45:05.302] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:158:0) after 5m7s
[12:50:12.746] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:158:0)
[12:50:12.762] Build status: STARTED
[12:50:12.762] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:159:0) after 1m18s
[12:51:30.789] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:159:0)
[12:51:30.811] Build status: STARTED
[12:51:30.811] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:160:0) after 3m35s
[12:55:06.149] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:160:0)
[12:55:06.168] Build status: STARTED
[12:55:06.168] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:161:0) after 6m25s
[13:01:31.677] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:161:0)
[13:01:31.696] Build status: STARTED
[13:01:31.696] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896956123666453056:162:0) after 6m33s
[13:04:33.124] Received PubSub notification, asking Buildbucket for the build status
[13:04:33.147] Build:
{
  "id": "8731526061641612881",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "Comparison Windows (8 cores) (reclient)"
  },
  "number": 4011,
  "createdBy": "project:chromium",
  "createTime": "2024-11-11T22:41:14.188460119Z",
  "startTime": "2024-11-11T22:42:55.773771715Z",
  "endTime": "2024-11-12T13:04:32.724488977Z",
  "updateTime": "2024-11-12T13:04:32.724488977Z",
  "status": "INFRA_FAILURE",
  "statusDetails": {
    "timeout": {

    }
  },
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "27d27a431acbfc7f77ae143cfb5f94a3fbe4be91",
      "ref": "refs/heads/main"
    }
  }
}
[13:04:33.147] Invocation finished in 14h23m20.273926917s with status FAILED