LUCI Scheduler :: chromium :: mac-code-coverage

Status: FAILED

Triggered by: -

Duration: 11 hours

Actions:

Definition (rev 835dd06986af6863f902c628becb4df908d0fc20)

buildbucket: <
  server: "cr-buildbucket.appspot.com"
  bucket: "luci.chromium.ci"
  builder: "mac-code-coverage"
>

Incoming triggers

f11fb0e889e48e8a06a1e1ee1e55f1de9802474b (3 years ago)
113e7c6b71d380d772fdf4fcfd2541446d790bd2 (3 years ago)
248422165435b43fc81d745a71e6a5bd558564a5 (3 years ago)
4c17363f15647ed4fbdaf5f280c9427dca37e1d4 (3 years ago)
40fe441c5234377b3b14baba6937382a383201d5 (3 years ago)
2fa3322015332845c72e404432a07e3e635791ef (3 years ago)
12e497a6ef469a49330d0b928d8324c27b5ca06f (3 years ago)
2f0d3dc22994d3f0174574a17c38782181960b00 (3 years ago)
b142c457ab47ce96b526c5d8e9fda61e5aaa5102 (3 years ago)
9109c6a424d252d428e8d3b2769fe8776b3e2648 (3 years ago)
207e5e3c9d12aae8fbbba71862243f94848c0538 (3 years ago)
0192d166059248d0564420b96441e1ccd6b0d7d5 (3 years ago)
c747ab238b2eab97102ad558127232e3e863975a (3 years ago)
736b212ab544cf14325db5ae7f73bd5d7f74e906 (3 years ago)
ca5460ad28121618e05785cc53e48d7c520af3c6 (3 years ago)
4c3cef306d954e1c7205a5538e4b6910767f1449 (3 years ago)
533475a800f883df7b13fe47820886a5826f1676 (3 years ago)

Incoming properties

{
  "branch": "refs/heads/main",
  "repository": "https://chromium.googlesource.com/chromium/src",
  "revision": "533475a800f883df7b13fe47820886a5826f1676"
}

Incoming tags

buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/533475a800f883df7b13fe47820886a5826f1676
gitiles_ref:refs/heads/main

Debug log (UTC)

[22:37:58.499] New invocation is queued and will start shortly
[22:37:59.683] Starting the invocation (attempt 1)
[22:37:59.717] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/533475a800f883df7b13fe47820886a5826f1676"
[22:37:59.717] Popped gitiles commit info from properties and tags
[22:37:59.717] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[22:37:59.717] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[22:37:59.717] Buildbucket request:
{
  "requestId": "9001686420658434000",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "mac-code-coverage"
  },
  "properties": {
    },
  "gitilesCommit": {
    "host": "chromium.googlesource.com",
    "project": "chromium/src",
    "id": "533475a800f883df7b13fe47820886a5826f1676",
    "ref": "refs/heads/main"
  },
  "tags": [
    {
      "key": "scheduler_invocation_id",
      "value": "9001686420658434000"
    },
    {
      "key": "scheduler_job_id",
      "value": "chromium/mac-code-coverage"
    },
    {
      "key": "user_agent",
      "value": "luci-scheduler"
    }
  ],
  "notify": {
    "pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
  }
}
[22:38:00.627] Scheduled build:
{
  "id": "8836256358663776401",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "mac-code-coverage"
  },
  "number": 6753,
  "createdBy": "project:chromium",
  "createTime": "2021-09-12T22:37:59.768536419Z",
  "updateTime": "2021-09-12T22:38:00.009253258Z",
  "status": "SCHEDULED",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "533475a800f883df7b13fe47820886a5826f1676",
      "ref": "refs/heads/main"
    }
  }
}
[22:38:00.627] Task URL: https://cr-buildbucket.appspot.com/build/8836256358663776401
[22:38:00.627] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:2:0) after 5m30s
[22:38:06.752] Received PubSub notification, asking Buildbucket for the build status
[22:38:06.781] Build status: STARTED
[22:43:31.306] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:2:0)
[22:43:31.345] Build status: STARTED
[22:43:31.345] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:4:0) after 2m36s
[22:46:07.410] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:4:0)
[22:46:07.439] Build status: STARTED
[22:46:07.439] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:5:0) after 6m23s
[22:52:30.599] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:5:0)
[22:52:30.627] Build status: STARTED
[22:52:30.627] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:6:0) after 1m19s
[22:53:49.646] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:6:0)
[22:53:49.719] Build status: STARTED
[22:53:49.719] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:7:0) after 3m52s
[22:57:41.943] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:7:0)
[22:57:41.990] Build status: STARTED
[22:57:41.991] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:8:0) after 4m44s
[23:02:26.194] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:8:0)
[23:02:26.222] Build status: STARTED
[23:02:26.222] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:9:0) after 7m1s
[23:09:27.504] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:9:0)
[23:09:27.543] Build status: STARTED
[23:09:27.543] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:10:0) after 2m22s
[23:11:49.704] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:10:0)
[23:11:49.735] Build status: STARTED
[23:11:49.735] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:11:0) after 6m32s
[23:18:21.946] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:11:0)
[23:18:21.979] Build status: STARTED
[23:18:21.979] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:12:0) after 6m25s
[23:24:46.995] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:12:0)
[23:24:47.025] Build status: STARTED
[23:24:47.025] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:13:0) after 2m23s
[23:27:10.024] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:13:0)
[23:27:10.085] Build status: STARTED
[23:27:10.085] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:14:0) after 2m21s
[23:29:31.106] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:14:0)
[23:29:31.139] Build status: STARTED
[23:29:31.139] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:15:0) after 2m20s
[23:31:51.162] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:15:0)
[23:31:51.582] Build status: STARTED
[23:31:51.582] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:16:0) after 1m35s
[23:33:27.050] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:16:0)
[23:33:27.086] Build status: STARTED
[23:33:27.086] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:17:0) after 1m20s
[23:34:47.276] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:17:0)
[23:34:47.310] Build status: STARTED
[23:34:47.310] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:18:0) after 7m52s
[23:42:39.328] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:18:0)
[23:42:39.356] Build status: STARTED
[23:42:39.356] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:19:0) after 6m28s
[23:49:07.384] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:19:0)
[23:49:07.503] Build status: STARTED
[23:49:07.503] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:20:0) after 6m7s
[23:55:14.521] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:20:0)
[23:55:14.556] Build status: STARTED
[23:55:14.556] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:21:0) after 1m11s
[23:56:25.697] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:21:0)
[23:56:25.735] Build status: STARTED
[23:56:25.735] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:22:0) after 2m17s
[23:58:43.029] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:22:0)
[23:58:43.062] Build status: STARTED
[23:58:43.062] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:23:0) after 6m25s
[00:05:08.087] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:23:0)
[00:05:08.168] Build status: STARTED
[00:05:08.168] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:24:0) after 6m40s
[00:11:48.442] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:24:0)
[00:11:48.473] Build status: STARTED
[00:11:48.473] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:25:0) after 8m32s
[00:20:20.548] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:25:0)
[00:20:20.590] Build status: STARTED
[00:20:20.590] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:26:0) after 2m30s
[00:22:50.616] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:26:0)
[00:22:50.645] Build status: STARTED
[00:22:50.645] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:27:0) after 4m53s
[00:27:44.195] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:27:0)
[00:27:44.235] Build status: STARTED
[00:27:44.235] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:28:0) after 2m0s
[00:29:44.318] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:28:0)
[00:29:44.347] Build status: STARTED
[00:29:44.347] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:29:0) after 7m40s
[00:37:24.493] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:29:0)
[00:37:24.519] Build status: STARTED
[00:37:24.519] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:30:0) after 3m13s
[00:40:37.538] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:30:0)
[00:40:37.565] Build status: STARTED
[00:40:37.565] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:31:0) after 8m36s
[00:49:13.911] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:31:0)
[00:49:13.950] Build status: STARTED
[00:49:13.950] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:32:0) after 1m1s
[00:50:15.038] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:32:0)
[00:50:15.086] Build status: STARTED
[00:50:15.086] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:33:0) after 5m44s
[00:55:59.213] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:33:0)
[00:55:59.249] Build status: STARTED
[00:55:59.249] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:34:0) after 6m54s
[01:02:53.326] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:34:0)
[01:02:53.394] Build status: STARTED
[01:02:53.394] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:35:0) after 4m18s
[01:07:11.414] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:35:0)
[01:07:11.453] Build status: STARTED
[01:07:11.453] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:36:0) after 5m40s
[01:12:51.521] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:36:0)
[01:12:51.595] Build status: STARTED
[01:12:51.595] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:37:0) after 9m16s
[01:22:07.769] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:37:0)
[01:22:07.812] Build status: STARTED
[01:22:07.812] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:38:0) after 8m15s
[01:30:22.980] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:38:0)
[01:30:23.063] Build status: STARTED
[01:30:23.063] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:39:0) after 7m48s
[01:38:11.088] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:39:0)
[01:38:11.122] Build status: STARTED
[01:38:11.122] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:40:0) after 7m35s
[01:45:46.244] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:40:0)
[01:45:46.347] Build status: STARTED
[01:45:46.347] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:41:0) after 5m12s
[01:50:58.365] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:41:0)
[01:50:58.397] Build status: STARTED
[01:50:58.397] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:42:0) after 5m56s
[01:56:54.418] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:42:0)
[01:56:54.476] Build status: STARTED
[01:56:54.476] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:43:0) after 6m54s
[02:03:48.494] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:43:0)
[02:03:48.526] Build status: STARTED
[02:03:48.526] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:44:0) after 9m22s
[02:13:10.576] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:44:0)
[02:13:10.626] Build status: STARTED
[02:13:10.626] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:45:0) after 4m28s
[02:17:38.973] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:45:0)
[02:17:39.001] Build status: STARTED
[02:17:39.001] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:46:0) after 9m17s
[02:26:56.018] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:46:0)
[02:26:56.045] Build status: STARTED
[02:26:56.045] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:47:0) after 7m51s
[02:34:47.175] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:47:0)
[02:34:47.292] Build status: STARTED
[02:34:47.292] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:48:0) after 7m44s
[02:42:31.307] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:48:0)
[02:42:31.336] Build status: STARTED
[02:42:31.336] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:49:0) after 7m49s
[02:50:20.403] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:49:0)
[02:50:20.434] Build status: STARTED
[02:50:20.434] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:50:0) after 5m26s
[02:55:46.597] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:50:0)
[02:55:46.644] Build status: STARTED
[02:55:46.644] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:51:0) after 9m43s
[03:05:29.668] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:51:0)
[03:05:29.709] Build status: STARTED
[03:05:29.709] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:52:0) after 9m56s
[03:15:25.769] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:52:0)
[03:15:25.816] Build status: STARTED
[03:15:25.816] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:53:0) after 8m7s
[03:23:32.934] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:53:0)
[03:23:32.971] Build status: STARTED
[03:23:32.971] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:54:0) after 4m28s
[03:28:00.991] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:54:0)
[03:28:01.021] Build status: STARTED
[03:28:01.021] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:55:0) after 4m19s
[03:32:20.045] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:55:0)
[03:32:20.146] Build status: STARTED
[03:32:20.146] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:56:0) after 2m23s
[03:34:43.253] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:56:0)
[03:34:43.283] Build status: STARTED
[03:34:43.283] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:57:0) after 2m31s
[03:37:14.664] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:57:0)
[03:37:14.767] Build status: STARTED
[03:37:14.767] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:58:0) after 7m11s
[03:44:25.790] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:58:0)
[03:44:25.824] Build status: STARTED
[03:44:25.824] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:59:0) after 4m15s
[03:48:40.845] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:59:0)
[03:48:40.879] Build status: STARTED
[03:48:40.879] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:60:0) after 2m24s
[03:51:04.899] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:60:0)
[03:51:04.965] Build status: STARTED
[03:51:04.965] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:61:0) after 8m23s
[03:59:28.083] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:61:0)
[03:59:28.115] Build status: STARTED
[03:59:28.115] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:62:0) after 9m56s
[04:09:24.138] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:62:0)
[04:09:24.169] Build status: STARTED
[04:09:24.170] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:63:0) after 1m19s
[04:10:43.191] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:63:0)
[04:10:43.282] Build status: STARTED
[04:10:43.282] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:64:0) after 6m27s
[04:17:10.366] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:64:0)
[04:17:10.398] Build status: STARTED
[04:17:10.398] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:65:0) after 9m43s
[04:26:53.420] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:65:0)
[04:26:53.455] Build status: STARTED
[04:26:53.455] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:66:0) after 1m40s
[04:28:33.477] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:66:0)
[04:28:33.509] Build status: STARTED
[04:28:33.509] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:67:0) after 9m53s
[04:38:26.513] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:67:0)
[04:38:26.539] Build status: STARTED
[04:38:26.539] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:68:0) after 8m36s
[04:47:02.675] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:68:0)
[04:47:02.704] Build status: STARTED
[04:47:02.704] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:69:0) after 3m23s
[04:50:25.810] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:69:0)
[04:50:25.838] Build status: STARTED
[04:50:25.838] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:70:0) after 7m26s
[04:57:51.835] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:70:0)
[04:57:51.879] Build status: STARTED
[04:57:51.879] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:71:0) after 4m51s
[05:02:42.900] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:71:0)
[05:02:42.926] Build status: STARTED
[05:02:42.926] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:72:0) after 7m23s
[05:10:06.146] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:72:0)
[05:10:06.178] Build status: STARTED
[05:10:06.178] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:73:0) after 4m0s
[05:14:06.466] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:73:0)
[05:14:06.500] Build status: STARTED
[05:14:06.500] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:74:0) after 3m4s
[05:17:10.623] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:74:0)
[05:17:10.802] Build status: STARTED
[05:17:10.802] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:75:0) after 1m58s
[05:19:08.894] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:75:0)
[05:19:08.961] Build status: STARTED
[05:19:08.961] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:76:0) after 7m56s
[05:27:05.077] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:76:0)
[05:27:05.108] Build status: STARTED
[05:27:05.108] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:77:0) after 3m15s
[05:30:20.136] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:77:0)
[05:30:20.169] Build status: STARTED
[05:30:20.169] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:78:0) after 2m32s
[05:32:52.249] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:78:0)
[05:32:52.285] Build status: STARTED
[05:32:52.285] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:79:0) after 4m8s
[05:37:00.312] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:79:0)
[05:37:00.355] Build status: STARTED
[05:37:00.355] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:80:0) after 5m8s
[05:42:08.378] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:80:0)
[05:42:08.408] Build status: STARTED
[05:42:08.408] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:81:0) after 5m53s
[05:48:01.428] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:81:0)
[05:48:01.467] Build status: STARTED
[05:48:01.467] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:82:0) after 6m4s
[05:54:05.492] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:82:0)
[05:54:05.558] Build status: STARTED
[05:54:05.558] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:83:0) after 7m54s
[06:01:59.618] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:83:0)
[06:01:59.758] Build status: STARTED
[06:01:59.758] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:84:0) after 2m19s
[06:04:18.865] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:84:0)
[06:04:18.907] Build status: STARTED
[06:04:18.907] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:85:0) after 9m12s
[06:13:30.952] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:85:0)
[06:13:30.993] Build status: STARTED
[06:13:30.993] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:86:0) after 6m14s
[06:19:45.017] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:86:0)
[06:19:45.158] Build status: STARTED
[06:19:45.158] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:87:0) after 8m2s
[06:27:47.207] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:87:0)
[06:27:47.266] Build status: STARTED
[06:27:47.266] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:88:0) after 3m37s
[06:31:24.290] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:88:0)
[06:31:24.323] Build status: STARTED
[06:31:24.323] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:89:0) after 6m57s
[06:38:21.303] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:89:0)
[06:38:21.394] Build status: STARTED
[06:38:21.394] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:90:0) after 2m24s
[06:40:45.519] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:90:0)
[06:40:45.678] Build status: STARTED
[06:40:45.678] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:91:0) after 2m17s
[06:43:02.721] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:91:0)
[06:43:02.889] Build status: STARTED
[06:43:02.889] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:92:0) after 6m2s
[06:49:05.082] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:92:0)
[06:49:05.172] Build status: STARTED
[06:49:05.172] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:93:0) after 8m54s
[06:57:59.210] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:93:0)
[06:57:59.250] Build status: STARTED
[06:57:59.250] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:94:0) after 1m5s
[06:59:04.275] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:94:0)
[06:59:04.383] Build status: STARTED
[06:59:04.383] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:95:0) after 6m59s
[07:06:03.459] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:95:0)
[07:06:03.501] Build status: STARTED
[07:06:03.501] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:96:0) after 3m42s
[07:09:45.521] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:96:0)
[07:09:45.556] Build status: STARTED
[07:09:45.556] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:97:0) after 8m36s
[07:18:21.935] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:97:0)
[07:18:21.996] Build status: STARTED
[07:18:21.996] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:98:0) after 7m51s
[07:26:13.088] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:98:0)
[07:26:13.127] Build status: STARTED
[07:26:13.127] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:99:0) after 3m52s
[07:30:05.158] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:99:0)
[07:30:05.202] Build status: STARTED
[07:30:05.203] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:100:0) after 5m21s
[07:35:26.224] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:100:0)
[07:35:26.268] Build status: STARTED
[07:35:26.268] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:101:0) after 3m49s
[07:39:15.390] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:101:0)
[07:39:15.420] Build status: STARTED
[07:39:15.420] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:102:0) after 7m47s
[07:47:02.445] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:102:0)
[07:47:02.476] Build status: STARTED
[07:47:02.476] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:103:0) after 3m22s
[07:50:24.500] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:103:0)
[07:50:24.537] Build status: STARTED
[07:50:24.537] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:104:0) after 1m18s
[07:51:42.569] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:104:0)
[07:51:42.600] Build status: STARTED
[07:51:42.600] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:105:0) after 2m9s
[07:53:51.669] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:105:0)
[07:53:51.703] Build status: STARTED
[07:53:51.703] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:106:0) after 2m24s
[07:56:15.732] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:106:0)
[07:56:15.767] Build status: STARTED
[07:56:15.767] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:107:0) after 3m5s
[07:59:20.788] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:107:0)
[07:59:20.821] Build status: STARTED
[07:59:20.821] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:108:0) after 5m43s
[08:05:03.975] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:108:0)
[08:05:04.017] Build status: STARTED
[08:05:04.017] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:109:0) after 6m48s
[08:11:52.063] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:109:0)
[08:11:52.114] Build status: STARTED
[08:11:52.114] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:110:0) after 6m33s
[08:18:25.369] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:110:0)
[08:18:25.399] Build status: STARTED
[08:18:25.399] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:111:0) after 5m1s
[08:23:26.418] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:111:0)
[08:23:26.451] Build status: STARTED
[08:23:26.451] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:112:0) after 5m0s
[08:28:26.534] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:112:0)
[08:28:27.428] Build status: STARTED
[08:28:27.428] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:113:0) after 2m44s
[08:31:11.576] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:113:0)
[08:31:11.612] Build status: STARTED
[08:31:11.612] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:114:0) after 2m28s
[08:33:39.866] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:114:0)
[08:33:39.897] Build status: STARTED
[08:33:39.897] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:115:0) after 5m6s
[08:38:45.919] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:115:0)
[08:38:45.971] Build status: STARTED
[08:38:45.971] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:116:0) after 3m34s
[08:42:20.136] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:116:0)
[08:42:20.168] Build status: STARTED
[08:42:20.168] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:117:0) after 4m7s
[08:46:27.203] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:117:0)
[08:46:27.234] Build status: STARTED
[08:46:27.234] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:118:0) after 9m27s
[08:55:54.393] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:118:0)
[08:55:54.517] Build status: STARTED
[08:55:54.517] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:119:0) after 5m53s
[09:01:47.556] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:119:0)
[09:01:47.589] Build status: STARTED
[09:01:47.589] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:120:0) after 2m0s
[09:03:47.613] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:120:0)
[09:03:47.685] Build status: STARTED
[09:03:47.685] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:121:0) after 8m17s
[09:12:04.716] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:121:0)
[09:12:04.752] Build status: STARTED
[09:12:04.752] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:122:0) after 2m2s
[09:14:06.790] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:122:0)
[09:14:06.826] Build status: STARTED
[09:14:06.826] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:123:0) after 6m35s
[09:20:41.922] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:123:0)
[09:20:41.961] Build status: STARTED
[09:20:41.961] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:124:0) after 8m6s
[09:28:47.982] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:124:0)
[09:28:48.020] Build status: STARTED
[09:28:48.020] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:125:0) after 6m48s
[09:35:36.071] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:125:0)
[09:35:36.108] Build status: STARTED
[09:35:36.108] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001686420658434000:126:0) after 8m50s
[09:44:16.180] Received PubSub notification, asking Buildbucket for the build status
[09:44:16.274] Build:
{
  "id": "8836256358663776401",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "mac-code-coverage"
  },
  "number": 6753,
  "createdBy": "project:chromium",
  "createTime": "2021-09-12T22:37:59.768536419Z",
  "startTime": "2021-09-12T22:38:02.571688Z",
  "endTime": "2021-09-13T09:44:15.701368510Z",
  "updateTime": "2021-09-13T09:44:15.701695911Z",
  "status": "FAILURE",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "533475a800f883df7b13fe47820886a5826f1676",
      "ref": "refs/heads/main"
    }
  }
}
[09:44:16.274] Invocation finished in 11h6m17.790941048s with status FAILED