LUCI Scheduler :: chromium :: Comparison Windows (8 cores) (reclient)

Status: FAILED

Triggered by: -

Duration: 14 hours

Actions:

Definition (rev 5f48f9b71d3376196ff86f4a92825b511702d8bc)

buildbucket: <
  server: "cr-buildbucket.appspot.com"
  bucket: "ci"
  builder: "Comparison Windows (8 cores) (reclient)"
>

Incoming triggers

78eafaa0818630da875579ee775e6901bd3650f6 (2 months ago)
bd894f9f5045265973e469f3f1e3dc2b3ff5e631 (2 months ago)
f26fc4a732a1321e8bffb7e6288ad82782d3ec8e (2 months ago)
bbe57252bf6f474cfad3a901ee81cd825f60260f (2 months ago)
bd929bd5705870c62f16ee5c2b8ac2d7ec4b767c (2 months ago)
98e488e46407789fb4d293866b58b34ce8e6e915 (2 months ago)
1f8f2e9fdf715d28e86b479f310d1b3bc5a0a1f0 (2 months ago)
9f76e8e2e2c5db1ab5c9b331b20daebb31423b60 (2 months ago)
9ff602e508b65ebb6b7533f3dd6d4b64b3fd2c93 (2 months ago)
78cb1546e76016d9ee307ade24d90762a7f8cda4 (2 months ago)
e89abcc9a1a17441fb37c2ee821731a4a6a8bae4 (2 months ago)

Incoming properties

{
  "branch": "refs/heads/main",
  "repository": "https://chromium.googlesource.com/chromium/src",
  "revision": "e89abcc9a1a17441fb37c2ee821731a4a6a8bae4"
}

Incoming tags

buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/e89abcc9a1a17441fb37c2ee821731a4a6a8bae4
gitiles_ref:refs/heads/main

Debug log (UTC)

[23:37:20.900] New invocation is queued and will start shortly
[23:37:22.048] Starting the invocation (attempt 1)
[23:37:22.071] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/e89abcc9a1a17441fb37c2ee821731a4a6a8bae4"
[23:37:22.071] Popped gitiles commit info from properties and tags
[23:37:22.071] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[23:37:22.071] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[23:37:22.072] Buildbucket request:
{
  "requestId": "8898402143504317120",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "Comparison Windows (8 cores) (reclient)"
  },
  "properties": {
    },
  "gitilesCommit": {
    "host": "chromium.googlesource.com",
    "project": "chromium/src",
    "id": "e89abcc9a1a17441fb37c2ee821731a4a6a8bae4",
    "ref": "refs/heads/main"
  },
  "tags": [
    {
      "key": "scheduler_invocation_id",
      "value": "8898402143504317120"
    },
    {
      "key": "scheduler_job_id",
      "value": "chromium/Comparison Windows (8 cores) (reclient)"
    },
    {
      "key": "user_agent",
      "value": "luci-scheduler"
    }
  ],
  "notify": {
    "pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
  }
}
[23:37:22.511] Scheduled build:
{
  "id": "8732972081575790689",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "Comparison Windows (8 cores) (reclient)"
  },
  "number": 3950,
  "createdBy": "project:chromium",
  "createTime": "2024-10-26T23:37:22.116424662Z",
  "updateTime": "2024-10-26T23:37:22.116424662Z",
  "status": "SCHEDULED",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "e89abcc9a1a17441fb37c2ee821731a4a6a8bae4",
      "ref": "refs/heads/main"
    }
  }
}
[23:37:22.511] Task URL: https://cr-buildbucket.appspot.com/build/8732972081575790689
[23:37:22.511] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:2:0) after 9m40s
[23:37:26.334] Received PubSub notification, asking Buildbucket for the build status
[23:37:26.363] Build status: SCHEDULED
[23:37:32.417] Received PubSub notification, asking Buildbucket for the build status
[23:37:32.436] Build status: STARTED
[23:47:02.528] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:2:0)
[23:47:02.553] Build status: STARTED
[23:47:02.553] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:5:0) after 3m56s
[23:50:59.080] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:5:0)
[23:50:59.101] Build status: STARTED
[23:50:59.101] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:6:0) after 2m32s
[23:53:31.074] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:6:0)
[23:53:31.093] Build status: STARTED
[23:53:31.093] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:7:0) after 9m26s
[00:02:57.196] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:7:0)
[00:02:57.213] Build status: STARTED
[00:02:57.213] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:8:0) after 2m5s
[00:05:02.228] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:8:0)
[00:05:02.274] Build status: STARTED
[00:05:02.274] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:9:0) after 8m10s
[00:13:12.295] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:9:0)
[00:13:12.315] Build status: STARTED
[00:13:12.315] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:10:0) after 3m33s
[00:16:45.335] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:10:0)
[00:16:45.356] Build status: STARTED
[00:16:45.356] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:11:0) after 6m3s
[00:22:48.372] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:11:0)
[00:22:48.390] Build status: STARTED
[00:22:48.390] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:12:0) after 6m54s
[00:29:42.406] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:12:0)
[00:29:42.425] Build status: STARTED
[00:29:42.426] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:13:0) after 6m50s
[00:36:32.441] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:13:0)
[00:36:32.467] Build status: STARTED
[00:36:32.467] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:14:0) after 8m55s
[00:45:27.482] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:14:0)
[00:45:27.503] Build status: STARTED
[00:45:27.503] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:15:0) after 5m36s
[00:51:03.519] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:15:0)
[00:51:03.534] Build status: STARTED
[00:51:03.534] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:16:0) after 6m12s
[00:57:15.563] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:16:0)
[00:57:15.594] Build status: STARTED
[00:57:15.594] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:17:0) after 9m46s
[01:07:01.783] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:17:0)
[01:07:01.848] Build status: STARTED
[01:07:01.848] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:18:0) after 6m32s
[01:13:33.878] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:18:0)
[01:13:33.894] Build status: STARTED
[01:13:33.894] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:19:0) after 4m56s
[01:18:29.915] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:19:0)
[01:18:30.064] Build status: STARTED
[01:18:30.064] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:20:0) after 1m51s
[01:20:21.115] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:20:0)
[01:20:21.141] Build status: STARTED
[01:20:21.142] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:21:0) after 8m31s
[01:28:52.519] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:21:0)
[01:28:52.537] Build status: STARTED
[01:28:52.537] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:22:0) after 9m58s
[01:38:50.553] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:22:0)
[01:38:50.570] Build status: STARTED
[01:38:50.570] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:23:0) after 6m25s
[01:45:16.137] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:23:0)
[01:45:16.241] Build status: STARTED
[01:45:16.241] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:24:0) after 3m49s
[01:49:05.372] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:24:0)
[01:49:05.392] Build status: STARTED
[01:49:05.392] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:25:0) after 6m19s
[01:55:24.742] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:25:0)
[01:55:24.760] Build status: STARTED
[01:55:24.760] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:26:0) after 7m10s
[02:02:34.810] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:26:0)
[02:02:34.828] Build status: STARTED
[02:02:34.828] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:27:0) after 6m58s
[02:09:33.006] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:27:0)
[02:09:33.029] Build status: STARTED
[02:09:33.029] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:28:0) after 3m32s
[02:13:05.358] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:28:0)
[02:13:05.371] Build status: STARTED
[02:13:05.371] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:29:0) after 8m20s
[02:21:25.909] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:29:0)
[02:21:25.975] Build status: STARTED
[02:21:25.975] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:30:0) after 7m39s
[02:29:05.041] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:30:0)
[02:29:05.059] Build status: STARTED
[02:29:05.059] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:31:0) after 2m9s
[02:31:14.351] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:31:0)
[02:31:14.369] Build status: STARTED
[02:31:14.369] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:32:0) after 6m18s
[02:37:32.429] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:32:0)
[02:37:32.458] Build status: STARTED
[02:37:32.458] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:33:0) after 3m14s
[02:40:46.540] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:33:0)
[02:40:46.558] Build status: STARTED
[02:40:46.558] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:34:0) after 3m13s
[02:43:59.659] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:34:0)
[02:43:59.674] Build status: STARTED
[02:43:59.675] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:35:0) after 4m37s
[02:48:37.234] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:35:0)
[02:48:37.253] Build status: STARTED
[02:48:37.253] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:36:0) after 6m48s
[02:55:25.296] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:36:0)
[02:55:25.459] Build status: STARTED
[02:55:25.459] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:37:0) after 5m29s
[03:00:54.529] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:37:0)
[03:00:54.545] Build status: STARTED
[03:00:54.545] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:38:0) after 4m30s
[03:05:25.042] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:38:0)
[03:05:25.060] Build status: STARTED
[03:05:25.060] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:39:0) after 1m27s
[03:06:52.079] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:39:0)
[03:06:52.099] Build status: STARTED
[03:06:52.099] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:40:0) after 7m10s
[03:14:02.203] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:40:0)
[03:14:02.221] Build status: STARTED
[03:14:02.221] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:41:0) after 8m53s
[03:22:55.318] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:41:0)
[03:22:55.344] Build status: STARTED
[03:22:55.344] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:42:0) after 2m17s
[03:25:12.465] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:42:0)
[03:25:12.501] Build status: STARTED
[03:25:12.501] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:43:0) after 5m15s
[03:30:27.592] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:43:0)
[03:30:27.613] Build status: STARTED
[03:30:27.613] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:44:0) after 1m23s
[03:31:50.728] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:44:0)
[03:31:50.747] Build status: STARTED
[03:31:50.747] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:45:0) after 2m30s
[03:34:20.925] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:45:0)
[03:34:20.940] Build status: STARTED
[03:34:20.940] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:46:0) after 3m34s
[03:37:55.061] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:46:0)
[03:37:55.077] Build status: STARTED
[03:37:55.077] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:47:0) after 7m15s
[03:45:10.244] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:47:0)
[03:45:10.294] Build status: STARTED
[03:45:10.294] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:48:0) after 6m45s
[03:51:55.312] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:48:0)
[03:51:55.329] Build status: STARTED
[03:51:55.329] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:49:0) after 8m27s
[04:00:22.576] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:49:0)
[04:00:22.601] Build status: STARTED
[04:00:22.601] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:50:0) after 5m21s
[04:05:43.721] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:50:0)
[04:05:43.797] Build status: STARTED
[04:05:43.798] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:51:0) after 1m49s
[04:07:32.851] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:51:0)
[04:07:32.940] Build status: STARTED
[04:07:32.940] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:52:0) after 6m16s
[04:13:49.013] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:52:0)
[04:13:49.032] Build status: STARTED
[04:13:49.032] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:53:0) after 3m30s
[04:17:19.064] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:53:0)
[04:17:19.083] Build status: STARTED
[04:17:19.083] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:54:0) after 1m15s
[04:18:34.103] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:54:0)
[04:18:34.118] Build status: STARTED
[04:18:34.119] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:55:0) after 3m55s
[04:22:29.277] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:55:0)
[04:22:29.300] Build status: STARTED
[04:22:29.300] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:56:0) after 5m58s
[04:28:27.331] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:56:0)
[04:28:27.417] Build status: STARTED
[04:28:27.417] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:57:0) after 2m25s
[04:30:52.550] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:57:0)
[04:30:52.574] Build status: STARTED
[04:30:52.574] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:58:0) after 4m59s
[04:35:51.559] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:58:0)
[04:35:51.580] Build status: STARTED
[04:35:51.580] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:59:0) after 3m23s
[04:39:14.597] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:59:0)
[04:39:14.620] Build status: STARTED
[04:39:14.620] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:60:0) after 5m37s
[04:44:52.400] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:60:0)
[04:44:52.414] Build status: STARTED
[04:44:52.415] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:61:0) after 1m38s
[04:46:30.868] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:61:0)
[04:46:30.891] Build status: STARTED
[04:46:30.891] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:62:0) after 7m31s
[04:54:02.054] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:62:0)
[04:54:02.086] Build status: STARTED
[04:54:02.086] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:63:0) after 2m49s
[04:56:51.246] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:63:0)
[04:56:51.271] Build status: STARTED
[04:56:51.271] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:64:0) after 6m32s
[05:03:23.367] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:64:0)
[05:03:23.386] Build status: STARTED
[05:03:23.386] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:65:0) after 4m44s
[05:08:07.557] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:65:0)
[05:08:07.574] Build status: STARTED
[05:08:07.574] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:66:0) after 6m0s
[05:14:07.878] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:66:0)
[05:14:07.935] Build status: STARTED
[05:14:07.936] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:67:0) after 7m49s
[05:21:56.953] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:67:0)
[05:21:56.969] Build status: STARTED
[05:21:56.969] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:68:0) after 3m59s
[05:25:55.986] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:68:0)
[05:25:56.006] Build status: STARTED
[05:25:56.006] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:69:0) after 7m56s
[05:33:52.206] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:69:0)
[05:33:52.225] Build status: STARTED
[05:33:52.225] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:70:0) after 7m45s
[05:41:37.208] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:70:0)
[05:41:37.224] Build status: STARTED
[05:41:37.224] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:71:0) after 8m50s
[05:50:27.250] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:71:0)
[05:50:27.275] Build status: STARTED
[05:50:27.275] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:72:0) after 3m24s
[05:53:51.291] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:72:0)
[05:53:51.307] Build status: STARTED
[05:53:51.308] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:73:0) after 4m54s
[05:58:45.324] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:73:0)
[05:58:45.345] Build status: STARTED
[05:58:45.346] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:74:0) after 6m53s
[06:05:38.360] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:74:0)
[06:05:38.383] Build status: STARTED
[06:05:38.383] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:75:0) after 9m43s
[06:15:21.436] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:75:0)
[06:15:21.507] Build status: STARTED
[06:15:21.507] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:76:0) after 6m1s
[06:21:22.524] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:76:0)
[06:21:22.568] Build status: STARTED
[06:21:22.568] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:77:0) after 6m2s
[06:27:24.585] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:77:0)
[06:27:24.604] Build status: STARTED
[06:27:24.604] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:78:0) after 2m19s
[06:29:44.022] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:78:0)
[06:29:44.040] Build status: STARTED
[06:29:44.040] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:79:0) after 7m31s
[06:37:15.063] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:79:0)
[06:37:15.080] Build status: STARTED
[06:37:15.080] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:80:0) after 2m21s
[06:39:36.103] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:80:0)
[06:39:36.118] Build status: STARTED
[06:39:36.118] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:81:0) after 1m0s
[06:40:36.233] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:81:0)
[06:40:36.248] Build status: STARTED
[06:40:36.248] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:82:0) after 4m3s
[06:44:39.262] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:82:0)
[06:44:39.278] Build status: STARTED
[06:44:39.278] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:83:0) after 7m21s
[06:52:00.472] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:83:0)
[06:52:00.488] Build status: STARTED
[06:52:00.489] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:84:0) after 8m35s
[07:00:35.632] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:84:0)
[07:00:35.655] Build status: STARTED
[07:00:35.655] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:85:0) after 5m14s
[07:05:49.679] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:85:0)
[07:05:49.712] Build status: STARTED
[07:05:49.712] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:86:0) after 8m3s
[07:13:52.731] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:86:0)
[07:13:52.780] Build status: STARTED
[07:13:52.780] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:87:0) after 1m20s
[07:15:12.869] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:87:0)
[07:15:12.883] Build status: STARTED
[07:15:12.883] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:88:0) after 1m50s
[07:17:02.900] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:88:0)
[07:17:02.931] Build status: STARTED
[07:17:02.931] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:89:0) after 2m30s
[07:19:32.957] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:89:0)
[07:19:32.985] Build status: STARTED
[07:19:32.985] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:90:0) after 6m42s
[07:26:15.001] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:90:0)
[07:26:15.024] Build status: STARTED
[07:26:15.024] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:91:0) after 1m50s
[07:28:05.041] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:91:0)
[07:28:05.059] Build status: STARTED
[07:28:05.059] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:92:0) after 3m30s
[07:31:35.085] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:92:0)
[07:31:35.106] Build status: STARTED
[07:31:35.106] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:93:0) after 3m34s
[07:35:09.127] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:93:0)
[07:35:09.144] Build status: STARTED
[07:35:09.144] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:94:0) after 6m18s
[07:41:27.171] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:94:0)
[07:41:27.191] Build status: STARTED
[07:41:27.191] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:95:0) after 4m57s
[07:46:24.305] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:95:0)
[07:46:24.333] Build status: STARTED
[07:46:24.333] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:96:0) after 2m41s
[07:49:05.342] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:96:0)
[07:49:05.360] Build status: STARTED
[07:49:05.360] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:97:0) after 2m17s
[07:51:22.638] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:97:0)
[07:51:22.657] Build status: STARTED
[07:51:22.657] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:98:0) after 6m38s
[07:58:00.820] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:98:0)
[07:58:00.840] Build status: STARTED
[07:58:00.840] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:99:0) after 7m29s
[08:05:29.918] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:99:0)
[08:05:29.935] Build status: STARTED
[08:05:29.935] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:100:0) after 8m52s
[08:14:22.059] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:100:0)
[08:14:22.087] Build status: STARTED
[08:14:22.087] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:101:0) after 9m27s
[08:23:49.108] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:101:0)
[08:23:49.146] Build status: STARTED
[08:23:49.146] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:102:0) after 6m15s
[08:30:04.163] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:102:0)
[08:30:04.180] Build status: STARTED
[08:30:04.180] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:103:0) after 2m33s
[08:32:37.245] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:103:0)
[08:32:37.272] Build status: STARTED
[08:32:37.272] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:104:0) after 3m45s
[08:36:22.375] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:104:0)
[08:36:22.428] Build status: STARTED
[08:36:22.428] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:105:0) after 7m53s
[08:44:15.508] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:105:0)
[08:44:15.533] Build status: STARTED
[08:44:15.533] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:106:0) after 8m32s
[08:52:47.555] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:106:0)
[08:52:47.577] Build status: STARTED
[08:52:47.577] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:107:0) after 9m13s
[09:02:00.742] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:107:0)
[09:02:00.761] Build status: STARTED
[09:02:00.761] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:108:0) after 5m36s
[09:07:36.843] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:108:0)
[09:07:36.859] Build status: STARTED
[09:07:36.859] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:109:0) after 6m21s
[09:13:57.972] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:109:0)
[09:13:57.992] Build status: STARTED
[09:13:57.992] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:110:0) after 6m13s
[09:20:11.008] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:110:0)
[09:20:11.031] Build status: STARTED
[09:20:11.031] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:111:0) after 2m10s
[09:22:21.055] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:111:0)
[09:22:21.075] Build status: STARTED
[09:22:21.075] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:112:0) after 5m5s
[09:27:26.071] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:112:0)
[09:27:26.090] Build status: STARTED
[09:27:26.091] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:113:0) after 9m21s
[09:36:47.110] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:113:0)
[09:36:47.139] Build status: STARTED
[09:36:47.139] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:114:0) after 9m42s
[09:46:29.165] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:114:0)
[09:46:29.333] Build status: STARTED
[09:46:29.333] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:115:0) after 7m37s
[09:54:06.608] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:115:0)
[09:54:06.626] Build status: STARTED
[09:54:06.626] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:116:0) after 4m51s
[09:58:57.662] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:116:0)
[09:58:57.678] Build status: STARTED
[09:58:57.679] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:117:0) after 1m56s
[10:00:53.698] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:117:0)
[10:00:53.716] Build status: STARTED
[10:00:53.716] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:118:0) after 1m29s
[10:02:22.735] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:118:0)
[10:02:22.753] Build status: STARTED
[10:02:22.753] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:119:0) after 9m22s
[10:11:44.744] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:119:0)
[10:11:44.760] Build status: STARTED
[10:11:44.760] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:120:0) after 7m12s
[10:18:56.871] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:120:0)
[10:18:56.893] Build status: STARTED
[10:18:56.893] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:121:0) after 2m57s
[10:21:54.013] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:121:0)
[10:21:54.045] Build status: STARTED
[10:21:54.045] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:122:0) after 4m33s
[10:26:27.070] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:122:0)
[10:26:27.087] Build status: STARTED
[10:26:27.087] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:123:0) after 5m39s
[10:32:06.110] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:123:0)
[10:32:06.130] Build status: STARTED
[10:32:06.130] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:124:0) after 5m23s
[10:37:29.159] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:124:0)
[10:37:29.176] Build status: STARTED
[10:37:29.176] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:125:0) after 6m43s
[10:44:12.196] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:125:0)
[10:44:12.215] Build status: STARTED
[10:44:12.215] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:126:0) after 5m37s
[10:49:49.268] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:126:0)
[10:49:49.347] Build status: STARTED
[10:49:49.347] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:127:0) after 4m38s
[10:54:27.422] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:127:0)
[10:54:27.437] Build status: STARTED
[10:54:27.437] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:128:0) after 7m20s
[11:01:47.461] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:128:0)
[11:01:47.476] Build status: STARTED
[11:01:47.476] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:129:0) after 3m40s
[11:05:27.630] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:129:0)
[11:05:27.662] Build status: STARTED
[11:05:27.662] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:130:0) after 6m9s
[11:11:36.688] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:130:0)
[11:11:36.706] Build status: STARTED
[11:11:36.706] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:131:0) after 4m6s
[11:15:42.728] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:131:0)
[11:15:42.743] Build status: STARTED
[11:15:42.743] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:132:0) after 1m27s
[11:17:09.774] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:132:0)
[11:17:09.792] Build status: STARTED
[11:17:09.792] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:133:0) after 8m57s
[11:26:07.129] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:133:0)
[11:26:07.155] Build status: STARTED
[11:26:07.155] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:134:0) after 2m8s
[11:28:15.186] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:134:0)
[11:28:15.202] Build status: STARTED
[11:28:15.202] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:135:0) after 6m9s
[11:34:24.226] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:135:0)
[11:34:24.344] Build status: STARTED
[11:34:24.344] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:136:0) after 9m11s
[11:43:35.384] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:136:0)
[11:43:35.402] Build status: STARTED
[11:43:35.402] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:137:0) after 5m54s
[11:49:29.423] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:137:0)
[11:49:29.471] Build status: STARTED
[11:49:29.471] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:138:0) after 9m18s
[11:58:47.457] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:138:0)
[11:58:47.497] Build status: STARTED
[11:58:47.497] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:139:0) after 5m39s
[12:04:26.519] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:139:0)
[12:04:26.537] Build status: STARTED
[12:04:26.537] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:140:0) after 1m2s
[12:05:28.558] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:140:0)
[12:05:28.661] Build status: STARTED
[12:05:28.661] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:141:0) after 2m7s
[12:07:35.785] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:141:0)
[12:07:35.808] Build status: STARTED
[12:07:35.808] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:142:0) after 3m38s
[12:11:13.830] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:142:0)
[12:11:13.854] Build status: STARTED
[12:11:13.854] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:143:0) after 6m23s
[12:17:37.279] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:143:0)
[12:17:37.314] Build status: STARTED
[12:17:37.314] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:144:0) after 3m54s
[12:21:31.846] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:144:0)
[12:21:31.862] Build status: STARTED
[12:21:31.862] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:145:0) after 3m47s
[12:25:19.303] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:145:0)
[12:25:19.322] Build status: STARTED
[12:25:19.322] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:146:0) after 8m16s
[12:33:35.343] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:146:0)
[12:33:35.365] Build status: STARTED
[12:33:35.366] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:147:0) after 8m59s
[12:42:34.484] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:147:0)
[12:42:34.517] Build status: STARTED
[12:42:34.517] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:148:0) after 7m6s
[12:49:40.544] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:148:0)
[12:49:40.558] Build status: STARTED
[12:49:40.559] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:149:0) after 3m27s
[12:53:07.589] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:149:0)
[12:53:07.607] Build status: STARTED
[12:53:07.607] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:150:0) after 6m57s
[13:00:04.639] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:150:0)
[13:00:04.658] Build status: STARTED
[13:00:04.658] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:151:0) after 2m10s
[13:02:14.679] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:151:0)
[13:02:14.698] Build status: STARTED
[13:02:14.698] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:152:0) after 4m44s
[13:06:58.823] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:152:0)
[13:06:58.843] Build status: STARTED
[13:06:58.843] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:153:0) after 7m9s
[13:14:07.872] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:153:0)
[13:14:07.890] Build status: STARTED
[13:14:07.890] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:154:0) after 7m3s
[13:21:11.025] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:154:0)
[13:21:11.042] Build status: STARTED
[13:21:11.042] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:155:0) after 3m53s
[13:25:04.118] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:155:0)
[13:25:04.141] Build status: STARTED
[13:25:04.141] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:156:0) after 1m27s
[13:26:31.170] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:156:0)
[13:26:31.188] Build status: STARTED
[13:26:31.188] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:157:0) after 2m41s
[13:29:12.211] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:157:0)
[13:29:12.265] Build status: STARTED
[13:29:12.265] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:158:0) after 1m16s
[13:30:28.279] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:158:0)
[13:30:28.294] Build status: STARTED
[13:30:28.295] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:159:0) after 6m17s
[13:36:45.311] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:159:0)
[13:36:45.328] Build status: STARTED
[13:36:45.328] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:160:0) after 2m58s
[13:39:43.388] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:160:0)
[13:39:43.434] Build status: STARTED
[13:39:43.434] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:161:0) after 8m35s
[13:48:18.510] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:161:0)
[13:48:18.535] Build status: STARTED
[13:48:18.535] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:162:0) after 3m46s
[13:52:04.625] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:162:0)
[13:52:04.642] Build status: STARTED
[13:52:04.642] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:163:0) after 9m44s
[14:01:48.676] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:163:0)
[14:01:48.700] Build status: STARTED
[14:01:48.700] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:164:0) after 1m33s
[14:03:21.721] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:164:0)
[14:03:21.738] Build status: STARTED
[14:03:21.738] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8898402143504317120:165:0) after 7m1s
[14:05:01.938] Received PubSub notification, asking Buildbucket for the build status
[14:05:01.960] Build:
{
  "id": "8732972081575790689",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "Comparison Windows (8 cores) (reclient)"
  },
  "number": 3950,
  "createdBy": "project:chromium",
  "createTime": "2024-10-26T23:37:22.116424662Z",
  "startTime": "2024-10-26T23:37:32.266754459Z",
  "endTime": "2024-10-27T14:05:01.625426049Z",
  "updateTime": "2024-10-27T14:05:01.625426049Z",
  "status": "INFRA_FAILURE",
  "statusDetails": {
    "timeout": {

    }
  },
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "e89abcc9a1a17441fb37c2ee821731a4a6a8bae4",
      "ref": "refs/heads/main"
    }
  }
}
[14:05:01.960] Invocation finished in 14h27m41.066798139s with status FAILED