LUCI Scheduler :: chromium :: Windows Cross deterministic

Status: FAILED

Triggered by: -

Duration: 10 hours

Actions:

Definition (rev 7e7ca5cd047c45b3be7281cd6c03a9eb5b0edf34)

buildbucket: <
  server: "cr-buildbucket.appspot.com"
  bucket: "reclient"
  builder: "Windows Cross deterministic"
>

Incoming triggers

ef63a1bbb1fd1e7236477de8b5c3517938f8fcce (2 years ago)
24ad538d593777a0cf8a77f8343d846d4c18b5b3 (2 years ago)
8ff3324e4147952541a20c402dba7bb0f729b1d5 (2 years ago)
24583e1d1667da10e9036b507adb3c2472cb722a (2 years ago)
46b73dca15175a59dba268e260c48063068b9610 (2 years ago)
5783005df9d809c37c56132e6337ea254b942452 (2 years ago)
2ae4b7c6500f5b0b5480cb2db823fd3d1d80387b (2 years ago)
4b0fbb631479fa8fe765d252556f8ff768d599ec (2 years ago)
ff1c80aa972e52c0cc015b056f59803cce7afca1 (2 years ago)
b2d7707facf8dd89a1f2a5330ef29e01c0266e73 (2 years ago)
016b83bcc4b3ff0fd6465c1ad224ef99dcc4e89f (2 years ago)
016f60df490f55c01390bb864a1f2dc605f9c7b0 (2 years ago)
45ad9d02472d5949a17407282499996280325227 (2 years ago)

Incoming properties

{
  "branch": "refs/heads/main",
  "repository": "https://chromium.googlesource.com/chromium/src",
  "revision": "45ad9d02472d5949a17407282499996280325227"
}

Incoming tags

buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/45ad9d02472d5949a17407282499996280325227
gitiles_ref:refs/heads/main

Debug log (UTC)

[12:42:59.146] New invocation is queued and will start shortly
[12:43:00.338] Starting the invocation (attempt 1)
[12:43:00.372] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/45ad9d02472d5949a17407282499996280325227"
[12:43:00.372] Popped gitiles commit info from properties and tags
[12:43:00.372] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[12:43:00.372] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[12:43:00.372] Buildbucket request:
{
  "requestId": "8952982686217131216",
  "builder": {
    "project": "chromium",
    "bucket": "reclient",
    "builder": "Windows Cross deterministic"
  },
  "properties": {
    },
  "gitilesCommit": {
    "host": "chromium.googlesource.com",
    "project": "chromium/src",
    "id": "45ad9d02472d5949a17407282499996280325227",
    "ref": "refs/heads/main"
  },
  "tags": [
    {
      "key": "scheduler_invocation_id",
      "value": "8952982686217131216"
    },
    {
      "key": "scheduler_job_id",
      "value": "chromium/Windows Cross deterministic"
    },
    {
      "key": "user_agent",
      "value": "luci-scheduler"
    }
  ],
  "notify": {
    "pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
  }
}
[12:43:00.872] Scheduled build:
{
  "id": "8787552624128824849",
  "builder": {
    "project": "chromium",
    "bucket": "reclient",
    "builder": "Windows Cross deterministic"
  },
  "number": 1251,
  "createdBy": "project:chromium",
  "createTime": "2023-03-04T12:43:00.507926530Z",
  "updateTime": "2023-03-04T12:43:00.507926530Z",
  "status": "SCHEDULED",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "45ad9d02472d5949a17407282499996280325227",
      "ref": "refs/heads/main"
    }
  }
}
[12:43:00.872] Task URL: https://cr-buildbucket.appspot.com/build/8787552624128824849
[12:43:00.872] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:2:0) after 9m21s
[12:43:16.183] Received PubSub notification, asking Buildbucket for the build status
[12:43:16.207] Build status: STARTED
[12:52:21.890] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:2:0)
[12:52:21.922] Build status: STARTED
[12:52:21.922] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:4:0) after 7m45s
[13:00:06.993] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:4:0)
[13:00:07.027] Build status: STARTED
[13:00:07.027] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:5:0) after 5m4s
[13:05:11.141] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:5:0)
[13:05:11.205] Build status: STARTED
[13:05:11.205] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:6:0) after 7m11s
[13:12:22.265] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:6:0)
[13:12:22.300] Build status: STARTED
[13:12:22.300] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:7:0) after 1m50s
[13:14:12.346] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:7:0)
[13:14:12.372] Build status: STARTED
[13:14:12.372] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:8:0) after 9m49s
[13:24:01.400] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:8:0)
[13:24:01.547] Build status: STARTED
[13:24:01.547] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:9:0) after 5m7s
[13:29:08.567] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:9:0)
[13:29:08.590] Build status: STARTED
[13:29:08.590] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:10:0) after 1m26s
[13:30:34.609] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:10:0)
[13:30:34.692] Build status: STARTED
[13:30:34.692] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:11:0) after 3m1s
[13:33:35.707] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:11:0)
[13:33:35.726] Build status: STARTED
[13:33:35.726] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:12:0) after 5m53s
[13:39:28.744] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:12:0)
[13:39:28.768] Build status: STARTED
[13:39:28.768] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:13:0) after 5m23s
[13:44:51.785] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:13:0)
[13:44:51.805] Build status: STARTED
[13:44:51.805] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:14:0) after 5m6s
[13:49:57.820] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:14:0)
[13:49:57.840] Build status: STARTED
[13:49:57.840] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:15:0) after 9m45s
[13:59:42.865] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:15:0)
[13:59:42.929] Build status: STARTED
[13:59:42.929] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:16:0) after 1m35s
[14:01:17.947] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:16:0)
[14:01:17.984] Build status: STARTED
[14:01:17.984] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:17:0) after 1m34s
[14:02:52.009] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:17:0)
[14:02:52.032] Build status: STARTED
[14:02:52.032] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:18:0) after 1m24s
[14:04:16.249] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:18:0)
[14:04:16.285] Build status: STARTED
[14:04:16.285] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:19:0) after 4m19s
[14:08:35.300] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:19:0)
[14:08:35.319] Build status: STARTED
[14:08:35.319] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:20:0) after 1m55s
[14:10:30.396] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:20:0)
[14:10:30.419] Build status: STARTED
[14:10:30.419] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:21:0) after 8m14s
[14:18:44.851] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:21:0)
[14:18:44.871] Build status: STARTED
[14:18:44.871] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:22:0) after 4m31s
[14:23:15.908] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:22:0)
[14:23:15.933] Build status: STARTED
[14:23:15.933] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:23:0) after 6m57s
[14:30:13.102] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:23:0)
[14:30:13.194] Build status: STARTED
[14:30:13.194] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:24:0) after 7m2s
[14:37:15.277] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:24:0)
[14:37:15.299] Build status: STARTED
[14:37:15.299] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:25:0) after 5m40s
[14:42:55.434] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:25:0)
[14:42:55.457] Build status: STARTED
[14:42:55.457] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:26:0) after 7m4s
[14:49:59.478] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:26:0)
[14:49:59.512] Build status: STARTED
[14:49:59.512] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:27:0) after 6m37s
[14:56:36.537] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:27:0)
[14:56:36.568] Build status: STARTED
[14:56:36.568] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:28:0) after 6m15s
[15:02:52.351] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:28:0)
[15:02:52.383] Build status: STARTED
[15:02:52.383] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:29:0) after 2m16s
[15:05:08.617] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:29:0)
[15:05:08.656] Build status: STARTED
[15:05:08.656] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:30:0) after 7m43s
[15:12:51.700] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:30:0)
[15:12:51.751] Build status: STARTED
[15:12:51.751] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:31:0) after 1m27s
[15:14:18.889] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:31:0)
[15:14:18.941] Build status: STARTED
[15:14:18.941] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:32:0) after 8m20s
[15:22:38.958] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:32:0)
[15:22:38.994] Build status: STARTED
[15:22:38.994] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:33:0) after 8m36s
[15:31:15.193] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:33:0)
[15:31:15.221] Build status: STARTED
[15:31:15.221] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:34:0) after 6m22s
[15:37:37.238] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:34:0)
[15:37:37.261] Build status: STARTED
[15:37:37.261] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:35:0) after 8m0s
[15:45:37.380] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:35:0)
[15:45:37.414] Build status: STARTED
[15:45:37.414] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:36:0) after 4m56s
[15:50:33.630] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:36:0)
[15:50:33.666] Build status: STARTED
[15:50:33.666] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:37:0) after 7m39s
[15:58:12.728] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:37:0)
[15:58:12.777] Build status: STARTED
[15:58:12.777] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:38:0) after 6m30s
[16:04:43.278] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:38:0)
[16:04:43.299] Build status: STARTED
[16:04:43.299] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:39:0) after 7m39s
[16:12:22.876] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:39:0)
[16:12:22.910] Build status: STARTED
[16:12:22.910] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:40:0) after 3m22s
[16:15:45.524] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:40:0)
[16:15:45.547] Build status: STARTED
[16:15:45.547] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:41:0) after 9m52s
[16:25:37.727] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:41:0)
[16:25:37.750] Build status: STARTED
[16:25:37.750] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:42:0) after 1m49s
[16:27:26.790] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:42:0)
[16:27:26.814] Build status: STARTED
[16:27:26.814] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:43:0) after 7m35s
[16:35:01.789] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:43:0)
[16:35:01.820] Build status: STARTED
[16:35:01.820] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:44:0) after 7m2s
[16:42:03.910] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:44:0)
[16:42:03.931] Build status: STARTED
[16:42:03.931] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:45:0) after 9m8s
[16:51:11.966] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:45:0)
[16:51:11.998] Build status: STARTED
[16:51:11.998] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:46:0) after 1m27s
[16:52:39.015] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:46:0)
[16:52:39.048] Build status: STARTED
[16:52:39.048] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:47:0) after 8m48s
[17:01:27.072] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:47:0)
[17:01:27.097] Build status: STARTED
[17:01:27.097] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:48:0) after 5m5s
[17:06:32.124] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:48:0)
[17:06:32.151] Build status: STARTED
[17:06:32.151] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:49:0) after 5m14s
[17:11:46.170] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:49:0)
[17:11:46.201] Build status: STARTED
[17:11:46.201] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:50:0) after 8m34s
[17:20:20.313] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:50:0)
[17:20:20.381] Build status: STARTED
[17:20:20.381] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:51:0) after 7m33s
[17:27:53.406] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:51:0)
[17:27:53.426] Build status: STARTED
[17:27:53.426] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:52:0) after 2m29s
[17:30:22.935] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:52:0)
[17:30:23.205] Build status: STARTED
[17:30:23.205] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:53:0) after 7m59s
[17:38:22.475] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:53:0)
[17:38:22.497] Build status: STARTED
[17:38:22.497] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:54:0) after 7m50s
[17:46:12.912] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:54:0)
[17:46:12.950] Build status: STARTED
[17:46:12.950] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:55:0) after 7m0s
[17:53:13.157] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:55:0)
[17:53:13.182] Build status: STARTED
[17:53:13.182] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:56:0) after 8m5s
[18:01:18.585] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:56:0)
[18:01:18.625] Build status: STARTED
[18:01:18.625] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:57:0) after 7m43s
[18:09:02.015] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:57:0)
[18:09:02.047] Build status: STARTED
[18:09:02.047] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:58:0) after 5m19s
[18:14:21.069] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:58:0)
[18:14:21.111] Build status: STARTED
[18:14:21.111] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:59:0) after 2m43s
[18:17:04.551] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:59:0)
[18:17:04.597] Build status: STARTED
[18:17:04.597] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:60:0) after 1m49s
[18:18:53.615] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:60:0)
[18:18:53.638] Build status: STARTED
[18:18:53.639] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:61:0) after 1m51s
[18:20:44.984] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:61:0)
[18:20:45.021] Build status: STARTED
[18:20:45.021] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:62:0) after 4m57s
[18:25:42.049] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:62:0)
[18:25:42.080] Build status: STARTED
[18:25:42.080] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:63:0) after 1m32s
[18:27:14.367] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:63:0)
[18:27:14.412] Build status: STARTED
[18:27:14.412] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:64:0) after 1m6s
[18:28:20.429] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:64:0)
[18:28:20.449] Build status: STARTED
[18:28:20.449] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:65:0) after 4m28s
[18:32:48.466] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:65:0)
[18:32:48.490] Build status: STARTED
[18:32:48.490] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:66:0) after 1m53s
[18:34:41.710] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:66:0)
[18:34:41.739] Build status: STARTED
[18:34:41.740] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:67:0) after 9m24s
[18:44:05.760] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:67:0)
[18:44:05.797] Build status: STARTED
[18:44:05.797] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:68:0) after 8m5s
[18:52:11.221] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:68:0)
[18:52:11.246] Build status: STARTED
[18:52:11.246] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:69:0) after 8m10s
[19:00:21.298] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:69:0)
[19:00:21.338] Build status: STARTED
[19:00:21.338] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:70:0) after 7m45s
[19:08:06.377] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:70:0)
[19:08:06.401] Build status: STARTED
[19:08:06.401] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:71:0) after 1m55s
[19:10:01.614] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:71:0)
[19:10:01.660] Build status: STARTED
[19:10:01.660] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:72:0) after 5m35s
[19:15:36.679] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:72:0)
[19:15:36.711] Build status: STARTED
[19:15:36.711] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:73:0) after 6m52s
[19:22:28.731] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:73:0)
[19:22:28.752] Build status: STARTED
[19:22:28.752] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:74:0) after 7m6s
[19:29:34.778] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:74:0)
[19:29:34.833] Build status: STARTED
[19:29:34.833] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:75:0) after 5m39s
[19:35:14.122] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:75:0)
[19:35:14.157] Build status: STARTED
[19:35:14.157] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:76:0) after 8m8s
[19:43:22.242] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:76:0)
[19:43:22.262] Build status: STARTED
[19:43:22.262] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:77:0) after 3m42s
[19:47:04.289] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:77:0)
[19:47:04.346] Build status: STARTED
[19:47:04.346] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:78:0) after 8m53s
[19:55:57.370] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:78:0)
[19:55:57.410] Build status: STARTED
[19:55:57.410] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:79:0) after 7m19s
[20:03:16.800] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:79:0)
[20:03:16.823] Build status: STARTED
[20:03:16.823] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:80:0) after 2m22s
[20:05:39.029] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:80:0)
[20:05:39.076] Build status: STARTED
[20:05:39.076] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:81:0) after 6m47s
[20:12:26.079] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:81:0)
[20:12:26.137] Build status: STARTED
[20:12:26.137] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:82:0) after 7m15s
[20:19:41.162] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:82:0)
[20:19:41.209] Build status: STARTED
[20:19:41.209] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:83:0) after 9m48s
[20:29:29.567] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:83:0)
[20:29:29.634] Build status: STARTED
[20:29:29.635] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:84:0) after 2m16s
[20:31:45.712] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:84:0)
[20:31:45.734] Build status: STARTED
[20:31:45.734] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:85:0) after 7m47s
[20:39:32.850] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:85:0)
[20:39:32.882] Build status: STARTED
[20:39:32.882] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:86:0) after 9m40s
[20:49:13.270] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:86:0)
[20:49:13.301] Build status: STARTED
[20:49:13.301] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:87:0) after 4m47s
[20:54:00.614] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:87:0)
[20:54:00.643] Build status: STARTED
[20:54:00.643] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:88:0) after 3m24s
[20:57:24.881] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:88:0)
[20:57:24.942] Build status: STARTED
[20:57:24.942] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:89:0) after 3m2s
[21:00:27.025] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:89:0)
[21:00:27.066] Build status: STARTED
[21:00:27.066] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:90:0) after 5m23s
[21:05:50.822] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:90:0)
[21:05:50.860] Build status: STARTED
[21:05:50.860] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:91:0) after 7m31s
[21:13:21.906] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:91:0)
[21:13:21.925] Build status: STARTED
[21:13:21.925] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:92:0) after 6m7s
[21:19:29.399] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:92:0)
[21:19:29.433] Build status: STARTED
[21:19:29.433] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:93:0) after 6m20s
[21:25:49.838] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:93:0)
[21:25:49.884] Build status: STARTED
[21:25:49.884] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:94:0) after 1m53s
[21:27:42.902] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:94:0)
[21:27:42.921] Build status: STARTED
[21:27:42.921] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:95:0) after 8m13s
[21:35:55.939] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:95:0)
[21:35:55.973] Build status: STARTED
[21:35:55.973] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:96:0) after 3m37s
[21:39:33.477] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:96:0)
[21:39:33.498] Build status: STARTED
[21:39:33.498] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:97:0) after 6m10s
[21:45:43.529] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:97:0)
[21:45:43.561] Build status: STARTED
[21:45:43.561] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:98:0) after 1m14s
[21:46:57.559] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:98:0)
[21:46:57.595] Build status: STARTED
[21:46:57.595] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:99:0) after 2m46s
[21:49:43.669] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:99:0)
[21:49:43.689] Build status: STARTED
[21:49:43.689] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:100:0) after 3m17s
[21:53:00.925] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:100:0)
[21:53:01.084] Build status: STARTED
[21:53:01.084] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:101:0) after 9m59s
[22:03:00.214] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:101:0)
[22:03:00.255] Build status: STARTED
[22:03:00.255] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:102:0) after 6m11s
[22:09:11.566] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:102:0)
[22:09:11.646] Build status: STARTED
[22:09:11.646] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:103:0) after 7m21s
[22:16:32.721] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:103:0)
[22:16:32.765] Build status: STARTED
[22:16:32.765] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:104:0) after 5m38s
[22:22:10.815] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:104:0)
[22:22:10.847] Build status: STARTED
[22:22:10.847] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:105:0) after 2m45s
[22:24:56.259] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:105:0)
[22:24:56.289] Build status: STARTED
[22:24:56.289] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:106:0) after 8m28s
[22:33:24.315] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:106:0)
[22:33:24.345] Build status: STARTED
[22:33:24.345] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:107:0) after 1m49s
[22:35:13.371] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:107:0)
[22:35:13.403] Build status: STARTED
[22:35:13.403] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:108:0) after 3m41s
[22:38:54.440] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:108:0)
[22:38:54.466] Build status: STARTED
[22:38:54.466] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:109:0) after 4m20s
[22:43:14.640] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:109:0)
[22:43:14.662] Build status: STARTED
[22:43:14.662] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:110:0) after 5m18s
[22:48:32.660] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:110:0)
[22:48:32.685] Build status: STARTED
[22:48:32.685] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:111:0) after 7m44s
[22:56:16.866] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:111:0)
[22:56:16.909] Build status: STARTED
[22:56:16.909] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:112:0) after 2m47s
[22:59:04.044] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:112:0)
[22:59:04.068] Build status: STARTED
[22:59:04.068] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8952982686217131216:113:0) after 9m16s
[23:02:53.922] Received PubSub notification, asking Buildbucket for the build status
[23:02:53.945] Build:
{
  "id": "8787552624128824849",
  "builder": {
    "project": "chromium",
    "bucket": "reclient",
    "builder": "Windows Cross deterministic"
  },
  "number": 1251,
  "createdBy": "project:chromium",
  "createTime": "2023-03-04T12:43:00.507926530Z",
  "startTime": "2023-03-04T12:43:15.160048Z",
  "endTime": "2023-03-04T23:02:53.477174267Z",
  "updateTime": "2023-03-04T23:02:53.477174267Z",
  "status": "INFRA_FAILURE",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "45ad9d02472d5949a17407282499996280325227",
      "ref": "refs/heads/main"
    }
  }
}
[23:02:53.945] Invocation finished in 10h19m54.813558332s with status FAILED