LUCI Scheduler :: chromium :: mac-code-coverage

Status: FAILED

Triggered by: -

Duration: 3 hours

Actions:

Definition (rev 8d683712b694a839151e242babb9cab749cff6c1)

buildbucket: <
  server: "cr-buildbucket.appspot.com"
  bucket: "luci.chromium.ci"
  builder: "mac-code-coverage"
>

Incoming triggers

2d5b04276de8ac85bb7df1b424ce952ab0ca5cc7 (6 years ago)
602d681e8ddaa838c6d1ef8515bfeea449e16434 (6 years ago)
aa7983327909d5f9eeee015e16a5da4f351900af (6 years ago)
f1955dfe4750a3b39e12f0b1b8d272c4ea9a8a5f (6 years ago)
83c23dde26679da862e0382b32236fe441944adf (6 years ago)
2e6246682ba9052a8a3c5de6b08e439d748cd7cd (6 years ago)
d1c11ecaf0e49329e63d47f57bced8c7cb644633 (6 years ago)
dd5a309f661043ea39469b3b4bb08ca5ee6d4c9e (6 years ago)
556c657dade824fd17dbb30bedbe002bc11ee9f9 (6 years ago)
d3fb2e9931226a17e9f0bf28879bcbe356624735 (6 years ago)
19e4d784049ee738b78b120ed34212f353fe3ad0 (6 years ago)
ebca95043587218ee379cc007adb3c8c9dfa1f23 (6 years ago)
29197e2a4fd97625b9b8d14f76dadcff8328d83c (6 years ago)
29f70218616752ddc07a4131071a3be78d0be4b0 (6 years ago)
ab1303e4e35a2df7e01e4410eb48bc5e89cef980 (6 years ago)
29d25ea28def9a2e3f88488efd46043503ad849a (6 years ago)
f1d0e60a703333541f1ea3889d4c430cb1fa145c (6 years ago)
d330a8b0af6787024d445f5e686e85f54e53d658 (6 years ago)
94c8ccce3f7f1bef2dabf455800a6c48f30d4c57 (6 years ago)
93e8d40951de898457528d855010b880a80c454a (6 years ago)
7f46fc26df6eac75d5c5d6a87702b1fd3672a74c (6 years ago)
bf928ee4c7c83fd208c63405a4119aeecb6e5820 (6 years ago)
dee8087259a271edcb0bac5d6bd5195f47fcbe55 (6 years ago)
0a64a7ba79ca8205b3fafd31750fd0b4b4a9fac6 (6 years ago)
2e6955cc4803f818ddbb06d3510deae75d1ff1fb (6 years ago)
26ae1fd0d1d52345b3b95bcba95637f41d1dd187 (6 years ago)
3e781947ab30816a03e7bf5cbd5a41cdc58b35e4 (6 years ago)
b7fceb80a5a0182b6de3dc7b0c4fa11e03590bfa (6 years ago)
a67b71c115c54e34541988a693674fc5732d1b18 (6 years ago)
8b4ed17d3dd013c05c0e50a53b8894e42a21d4f7 (6 years ago)
770e2a61acacf4e1bc5eda6b0b165a3ae6bf1935 (6 years ago)
5e462030e4b6c96c073cc6faa7de3bb997b978b9 (6 years ago)
97fe18147647ab74751d0607a2583dcafb7f561f (6 years ago)
813c6b429a13a01f284dbc5f46ab13e3e491cbd8 (6 years ago)
29dcab768876e31289cbc3666660ef6dcca2fdea (6 years ago)
0f2b18ed93379febea1ed631c94cbf6010471e7d (6 years ago)
1a7be35fa3114e2f1cc36fe3f7edec931122d146 (6 years ago)
352a82ac28c1fd5cba50bde955e6a079f6145251 (6 years ago)
77d0cf6c0d8b82763bd8f86f21ae19d3ad2773f9 (6 years ago)
f7c7a71cf474f59278abe16b4d4a6780464ecb14 (6 years ago)
be092a46ef779d98ecdaea1477583a8d4cefce5f (6 years ago)
caab07560eef5c2d69a7f6a6dcc04d2f52020700 (6 years ago)
758b4796f4e0e7b131535fa4a289eb95d97ee5cd (6 years ago)
23947828cf81cb9fb335ca6c80beed044e64dbd4 (6 years ago)
d5fdc8c204cb6d5f2f01c21265d94c13ce2d1b6b (6 years ago)
b756c98d2220dd0fcf1245f18cdb041aff06280d (6 years ago)
d330c6eb493434a1290d408456533eb26d601ef8 (6 years ago)
c5e2eaf13f2096f7e3f3227752a15f8c0fee299e (6 years ago)
74853d8d13a89431bd0ea7e843279f0bcee2ac7f (6 years ago)
d1e87aab3002078c22b2feba7bdc68996121179e (6 years ago)
f106a4c81bc4796ea0ec9e014004e1cfad24e930 (6 years ago)
823b1302f70b4efbea61899a2674f424202d1008 (6 years ago)
8d5836203ab0d8d9528c0bb4a1eb8c66a36e529f (6 years ago)
57cd92bc11e8a3979db3fe50aaa81230e783d28d (6 years ago)
dee82c9a2386bab5a642e4aa3d692ea4ac736807 (6 years ago)
86c5c295f5b5b3fce698e1ecb20abc1472662a16 (6 years ago)
9a358448f80cb9ef2ec609d9698eeac859812746 (6 years ago)
e441cd0cebb53a0fc9c6693701b502ae8de32c8a (6 years ago)
a1e126111211f4dfaf3b54d7d8572664fdd7f7f9 (6 years ago)
298a4038816103e78429d66f3e12b24d06a5090c (6 years ago)
391a9bcdf8166fd302f71f12c25f88e3ec906e5b (6 years ago)
a6005f02d694ba46d59efa3066d3f28becef0bee (6 years ago)
0b76c5a074187cd6865daf08e9bb9d65439b802a (6 years ago)
944e94a725471186a09e1beb4ddd1bdf3dbc2d73 (6 years ago)
4af5925518b216de312262af952281847fc4b137 (6 years ago)
31bff13f48fa6ebf23cd1460d21d17f1e984793b (6 years ago)
62f8d5f096b174d05cd7f716585983df483024d7 (6 years ago)
2dc0b52c5d1da0fd92b99b2c1d6eca0c845fd34c (6 years ago)
28e9f654c814336afeac5d07216a5ff8bb70ae41 (6 years ago)
f707f1d6d428f84cf14b64bc2ca74372e25c6ce7 (6 years ago)

Incoming properties

{
  "branch": "refs/heads/master",
  "repository": "https://chromium.googlesource.com/chromium/src",
  "revision": "f707f1d6d428f84cf14b64bc2ca74372e25c6ce7"
}

Incoming tags

buildset:commit/git/f707f1d6d428f84cf14b64bc2ca74372e25c6ce7
buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/f707f1d6d428f84cf14b64bc2ca74372e25c6ce7
gitiles_ref:refs/heads/master

Debug log (UTC)

[23:18:46.864] New invocation is queued and will start shortly
[23:18:48.333] Starting the invocation (attempt 1)
[23:18:48.491] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[23:18:48.491] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[23:18:48.491] Buildbucket request:
{
  "bucket": "luci.chromium.ci",
  "client_operation_id": "9056495018033059568",
  "parameters_json": "{\"builder_name\":\"mac-code-coverage\",\"properties\":{\"branch\":\"refs/heads/master\",\"repository\":\"https://chromium.googlesource.com/chromium/src\",\"revision\":\"f707f1d6d428f84cf14b64bc2ca74372e25c6ce7\"}}",
  "pubsub_callback": {
    "auth_token": "...",
    "topic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
  },
  "tags": [
    "builder:mac-code-coverage",
    "scheduler_invocation_id:9056495018033059568",
    "scheduler_job_id:chromium/mac-code-coverage",
    "user_agent:luci-scheduler",
    "buildset:commit/git/f707f1d6d428f84cf14b64bc2ca74372e25c6ce7",
    "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/f707f1d6d428f84cf14b64bc2ca74372e25c6ce7",
    "gitiles_ref:refs/heads/master"
  ]
}
[23:18:50.707] Buildbucket response:
{
  "build": {
    "bucket": "luci.chromium.ci",
    "canary_preference": "PROD",
    "created_by": "project:chromium",
    "created_ts": "1579216729053274",
    "id": "8891064955074398928",
    "parameters_json": "{\"builder_name\": \"mac-code-coverage\", \"properties\": {\"branch\": \"refs/heads/master\", \"repository\": \"https://chromium.googlesource.com/chromium/src\", \"revision\": \"f707f1d6d428f84cf14b64bc2ca74372e25c6ce7\"}}",
    "project": "chromium",
    "result_details_json": "{\"properties\": {}}",
    "service_account": "chromium-ci-builder@chops-service-accounts.iam.gserviceaccount.com",
    "status": "SCHEDULED",
    "status_changed_ts": "1579216730229168",
    "tags": [
      "build_address:luci.chromium.ci/mac-code-coverage/660",
      "builder:mac-code-coverage",
      "buildset:commit/git/f707f1d6d428f84cf14b64bc2ca74372e25c6ce7",
      "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/f707f1d6d428f84cf14b64bc2ca74372e25c6ce7",
      "gitiles_ref:refs/heads/master",
      "scheduler_invocation_id:9056495018033059568",
      "scheduler_job_id:chromium/mac-code-coverage",
      "swarming_hostname:chromium-swarm.appspot.com",
      "swarming_tag:log_location:logdog://logs.chromium.org/chromium/buildbucket/cr-buildbucket.appspot.com/8891064955074398928/+/annotations",
      "swarming_tag:luci_project:chromium",
      "swarming_tag:recipe_name:chromium",
      "swarming_tag:recipe_package:infra/recipe_bundles/chromium.googlesource.com/chromium/tools/build",
      "swarming_task_id:",
      "user_agent:luci-scheduler"
    ],
    "updated_ts": "1579216730229477",
    "url": "https://ci.chromium.org/b/8891064955074398928",
    "utcnow_ts": "1579216730653720"
  }
}
[23:18:50.707] Task URL: https://ci.chromium.org/b/8891064955074398928
[23:18:50.707] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:2:0) after 1m0s
[23:19:50.968] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:2:0)
[23:19:50.968] Timer tick, asking Buildbucket for the build status
[23:19:51.175] Build 8891064955074398928: status "SCHEDULED", result "", failure_reason "", cancelation_reason ""
[23:19:51.175] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:3:0) after 1m0s
[23:20:38.574] Received PubSub notification, asking Buildbucket for the build status
[23:20:39.008] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[23:20:51.271] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:3:0)
[23:20:51.271] Timer tick, asking Buildbucket for the build status
[23:20:53.043] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[23:20:53.043] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:5:0) after 1m0s
[23:21:53.106] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:5:0)
[23:21:53.106] Timer tick, asking Buildbucket for the build status
[23:21:53.892] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[23:21:53.892] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:6:0) after 1m0s
[23:22:53.953] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:6:0)
[23:22:53.953] Timer tick, asking Buildbucket for the build status
[23:22:54.133] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[23:22:54.133] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:7:0) after 1m0s
[23:23:54.163] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:7:0)
[23:23:54.163] Timer tick, asking Buildbucket for the build status
[23:23:54.317] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[23:23:54.317] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:8:0) after 1m0s
[23:24:54.348] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:8:0)
[23:24:54.348] Timer tick, asking Buildbucket for the build status
[23:24:54.547] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[23:24:54.547] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:9:0) after 1m0s
[23:25:54.654] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:9:0)
[23:25:54.654] Timer tick, asking Buildbucket for the build status
[23:25:54.874] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[23:25:54.874] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:10:0) after 1m0s
[23:26:54.902] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:10:0)
[23:26:54.902] Timer tick, asking Buildbucket for the build status
[23:26:55.401] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[23:26:55.401] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:11:0) after 1m0s
[23:27:55.524] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:11:0)
[23:27:55.524] Timer tick, asking Buildbucket for the build status
[23:27:56.505] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[23:27:56.505] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:12:0) after 1m0s
[23:28:56.582] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:12:0)
[23:28:56.582] Timer tick, asking Buildbucket for the build status
[23:28:56.892] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[23:28:56.892] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:13:0) after 1m0s
[23:29:56.926] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:13:0)
[23:29:56.926] Timer tick, asking Buildbucket for the build status
[23:29:57.421] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[23:29:57.421] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:14:0) after 1m0s
[23:30:57.510] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:14:0)
[23:30:57.510] Timer tick, asking Buildbucket for the build status
[23:30:57.721] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[23:30:57.721] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:15:0) after 1m0s
[23:31:57.839] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:15:0)
[23:31:57.839] Timer tick, asking Buildbucket for the build status
[23:31:58.280] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[23:31:58.280] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:16:0) after 1m0s
[23:32:58.318] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:16:0)
[23:32:58.318] Timer tick, asking Buildbucket for the build status
[23:33:00.136] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[23:33:00.136] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:17:0) after 1m0s
[23:34:00.194] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:17:0)
[23:34:00.194] Timer tick, asking Buildbucket for the build status
[23:34:00.343] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[23:34:00.343] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:18:0) after 1m0s
[23:35:00.373] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:18:0)
[23:35:00.373] Timer tick, asking Buildbucket for the build status
[23:35:01.115] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[23:35:01.115] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:19:0) after 1m0s
[23:36:01.388] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:19:0)
[23:36:01.388] Timer tick, asking Buildbucket for the build status
[23:36:01.603] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[23:36:01.603] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:20:0) after 1m0s
[23:37:01.734] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:20:0)
[23:37:01.734] Timer tick, asking Buildbucket for the build status
[23:37:02.300] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[23:37:02.300] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:21:0) after 1m0s
[23:38:02.296] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:21:0)
[23:38:02.296] Timer tick, asking Buildbucket for the build status
[23:38:02.547] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[23:38:02.547] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:22:0) after 1m0s
[23:39:02.583] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:22:0)
[23:39:02.583] Timer tick, asking Buildbucket for the build status
[23:39:02.887] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[23:39:02.887] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:23:0) after 1m0s
[23:40:03.055] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:23:0)
[23:40:03.055] Timer tick, asking Buildbucket for the build status
[23:40:04.253] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[23:40:04.253] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:24:0) after 1m0s
[23:41:04.271] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:24:0)
[23:41:04.271] Timer tick, asking Buildbucket for the build status
[23:41:04.654] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[23:41:04.654] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:25:0) after 1m0s
[23:42:04.692] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:25:0)
[23:42:04.692] Timer tick, asking Buildbucket for the build status
[23:42:05.112] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[23:42:05.112] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:26:0) after 1m0s
[23:43:05.204] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:26:0)
[23:43:05.204] Timer tick, asking Buildbucket for the build status
[23:43:06.271] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[23:43:06.271] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:27:0) after 1m0s
[23:44:06.332] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:27:0)
[23:44:06.332] Timer tick, asking Buildbucket for the build status
[23:44:06.476] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[23:44:06.476] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:28:0) after 1m0s
[23:45:06.548] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:28:0)
[23:45:06.548] Timer tick, asking Buildbucket for the build status
[23:45:06.760] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[23:45:06.760] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:29:0) after 1m0s
[23:46:06.791] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:29:0)
[23:46:06.791] Timer tick, asking Buildbucket for the build status
[23:46:06.958] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[23:46:06.959] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:30:0) after 1m0s
[23:47:07.045] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:30:0)
[23:47:07.045] Timer tick, asking Buildbucket for the build status
[23:47:07.791] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[23:47:07.791] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:31:0) after 1m0s
[23:48:07.930] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:31:0)
[23:48:07.930] Timer tick, asking Buildbucket for the build status
[23:48:08.263] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[23:48:08.263] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:32:0) after 1m0s
[23:49:08.351] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:32:0)
[23:49:08.351] Timer tick, asking Buildbucket for the build status
[23:49:08.721] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[23:49:08.721] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:33:0) after 1m0s
[23:50:08.787] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:33:0)
[23:50:08.787] Timer tick, asking Buildbucket for the build status
[23:50:09.188] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[23:50:09.188] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:34:0) after 1m0s
[23:51:09.282] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:34:0)
[23:51:09.282] Timer tick, asking Buildbucket for the build status
[23:51:10.549] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[23:51:10.549] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:35:0) after 1m0s
[23:52:10.669] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:35:0)
[23:52:10.669] Timer tick, asking Buildbucket for the build status
[23:52:10.842] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[23:52:10.842] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:36:0) after 1m0s
[23:53:10.899] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:36:0)
[23:53:10.899] Timer tick, asking Buildbucket for the build status
[23:53:11.058] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[23:53:11.058] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:37:0) after 1m0s
[23:54:11.116] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:37:0)
[23:54:11.116] Timer tick, asking Buildbucket for the build status
[23:54:11.946] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[23:54:11.946] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:38:0) after 1m0s
[23:55:12.126] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:38:0)
[23:55:12.126] Timer tick, asking Buildbucket for the build status
[23:55:13.555] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[23:55:13.555] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:39:0) after 1m0s
[23:56:13.622] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:39:0)
[23:56:13.622] Timer tick, asking Buildbucket for the build status
[23:56:14.456] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[23:56:14.456] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:40:0) after 1m0s
[23:57:14.513] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:40:0)
[23:57:14.513] Timer tick, asking Buildbucket for the build status
[23:57:15.382] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[23:57:15.382] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:41:0) after 1m0s
[23:58:15.392] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:41:0)
[23:58:15.392] Timer tick, asking Buildbucket for the build status
[23:58:15.614] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[23:58:15.614] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:42:0) after 1m0s
[23:59:15.725] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:42:0)
[23:59:15.725] Timer tick, asking Buildbucket for the build status
[23:59:15.881] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[23:59:15.881] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:43:0) after 1m0s
[00:00:15.876] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:43:0)
[00:00:15.876] Timer tick, asking Buildbucket for the build status
[00:00:16.139] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[00:00:16.139] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:44:0) after 1m0s
[00:01:16.196] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:44:0)
[00:01:16.196] Timer tick, asking Buildbucket for the build status
[00:01:16.420] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[00:01:16.420] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:45:0) after 1m0s
[00:02:16.470] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:45:0)
[00:02:16.470] Timer tick, asking Buildbucket for the build status
[00:02:16.740] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[00:02:16.740] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:46:0) after 1m0s
[00:03:16.813] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:46:0)
[00:03:16.813] Timer tick, asking Buildbucket for the build status
[00:03:17.022] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[00:03:17.022] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:47:0) after 1m0s
[00:04:17.160] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:47:0)
[00:04:17.161] Timer tick, asking Buildbucket for the build status
[00:04:17.415] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[00:04:17.415] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:48:0) after 1m0s
[00:05:17.417] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:48:0)
[00:05:17.417] Timer tick, asking Buildbucket for the build status
[00:05:18.137] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[00:05:18.137] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:49:0) after 1m0s
[00:06:18.168] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:49:0)
[00:06:18.168] Timer tick, asking Buildbucket for the build status
[00:06:18.320] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[00:06:18.320] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:50:0) after 1m0s
[00:07:18.425] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:50:0)
[00:07:18.425] Timer tick, asking Buildbucket for the build status
[00:07:20.807] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[00:07:20.807] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:51:0) after 1m0s
[00:08:20.796] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:51:0)
[00:08:20.796] Timer tick, asking Buildbucket for the build status
[00:08:21.015] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[00:08:21.015] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:52:0) after 1m0s
[00:09:21.117] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:52:0)
[00:09:21.117] Timer tick, asking Buildbucket for the build status
[00:09:21.765] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[00:09:21.765] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:53:0) after 1m0s
[00:10:21.853] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:53:0)
[00:10:21.853] Timer tick, asking Buildbucket for the build status
[00:10:22.445] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[00:10:22.445] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:54:0) after 1m0s
[00:11:22.516] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:54:0)
[00:11:22.516] Timer tick, asking Buildbucket for the build status
[00:11:23.353] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[00:11:23.353] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:55:0) after 1m0s
[00:12:23.381] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:55:0)
[00:12:23.381] Timer tick, asking Buildbucket for the build status
[00:12:25.429] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[00:12:25.429] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:56:0) after 1m0s
[00:13:25.544] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:56:0)
[00:13:25.544] Timer tick, asking Buildbucket for the build status
[00:13:25.894] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[00:13:25.894] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:57:0) after 1m0s
[00:14:25.930] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:57:0)
[00:14:25.930] Timer tick, asking Buildbucket for the build status
[00:14:26.539] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[00:14:26.539] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:58:0) after 1m0s
[00:15:26.637] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:58:0)
[00:15:26.637] Timer tick, asking Buildbucket for the build status
[00:15:26.893] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[00:15:26.893] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:59:0) after 1m0s
[00:16:26.930] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:59:0)
[00:16:26.930] Timer tick, asking Buildbucket for the build status
[00:16:27.328] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[00:16:27.328] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:60:0) after 1m0s
[00:17:27.491] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:60:0)
[00:17:27.491] Timer tick, asking Buildbucket for the build status
[00:17:27.683] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[00:17:27.684] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:61:0) after 1m0s
[00:18:27.711] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:61:0)
[00:18:27.711] Timer tick, asking Buildbucket for the build status
[00:18:28.204] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[00:18:28.204] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:62:0) after 1m0s
[00:19:28.256] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:62:0)
[00:19:28.256] Timer tick, asking Buildbucket for the build status
[00:19:28.526] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[00:19:28.526] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:63:0) after 1m0s
[00:20:28.559] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:63:0)
[00:20:28.559] Timer tick, asking Buildbucket for the build status
[00:20:28.793] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[00:20:28.793] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:64:0) after 1m0s
[00:21:28.854] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:64:0)
[00:21:28.854] Timer tick, asking Buildbucket for the build status
[00:21:33.707] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[00:21:33.707] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:65:0) after 1m0s
[00:22:33.957] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:65:0)
[00:22:33.957] Timer tick, asking Buildbucket for the build status
[00:22:34.867] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[00:22:34.867] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:66:0) after 1m0s
[00:23:34.970] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:66:0)
[00:23:34.970] Timer tick, asking Buildbucket for the build status
[00:23:35.708] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[00:23:35.708] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:67:0) after 1m0s
[00:24:35.836] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:67:0)
[00:24:35.836] Timer tick, asking Buildbucket for the build status
[00:24:36.069] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[00:24:36.069] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:68:0) after 1m0s
[00:25:36.132] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:68:0)
[00:25:36.132] Timer tick, asking Buildbucket for the build status
[00:25:36.303] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[00:25:36.303] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:69:0) after 1m0s
[00:26:36.586] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:69:0)
[00:26:36.586] Timer tick, asking Buildbucket for the build status
[00:26:37.481] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[00:26:37.481] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:70:0) after 1m0s
[00:27:37.622] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:70:0)
[00:27:37.622] Timer tick, asking Buildbucket for the build status
[00:27:37.886] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[00:27:37.886] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:71:0) after 1m0s
[00:28:37.901] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:71:0)
[00:28:37.901] Timer tick, asking Buildbucket for the build status
[00:28:38.156] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[00:28:38.156] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:72:0) after 1m0s
[00:29:38.480] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:72:0)
[00:29:38.480] Timer tick, asking Buildbucket for the build status
[00:29:38.754] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[00:29:38.754] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:73:0) after 1m0s
[00:30:38.840] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:73:0)
[00:30:38.840] Timer tick, asking Buildbucket for the build status
[00:30:39.067] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[00:30:39.067] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:74:0) after 1m0s
[00:31:39.317] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:74:0)
[00:31:39.317] Timer tick, asking Buildbucket for the build status
[00:31:40.028] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[00:31:40.028] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:75:0) after 1m0s
[00:32:40.254] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:75:0)
[00:32:40.254] Timer tick, asking Buildbucket for the build status
[00:32:41.236] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[00:32:41.236] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:76:0) after 1m0s
[00:33:41.366] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:76:0)
[00:33:41.366] Timer tick, asking Buildbucket for the build status
[00:33:42.014] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[00:33:42.014] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:77:0) after 1m0s
[00:34:42.109] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:77:0)
[00:34:42.109] Timer tick, asking Buildbucket for the build status
[00:34:42.671] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[00:34:42.671] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:78:0) after 1m0s
[00:35:42.786] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:78:0)
[00:35:42.786] Timer tick, asking Buildbucket for the build status
[00:35:43.013] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[00:35:43.013] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:79:0) after 1m0s
[00:36:43.353] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:79:0)
[00:36:43.353] Timer tick, asking Buildbucket for the build status
[00:36:43.636] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[00:36:43.636] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:80:0) after 1m0s
[00:37:43.841] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:80:0)
[00:37:43.841] Timer tick, asking Buildbucket for the build status
[00:37:44.095] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[00:37:44.095] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:81:0) after 1m0s
[00:38:44.146] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:81:0)
[00:38:44.146] Timer tick, asking Buildbucket for the build status
[00:38:44.655] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[00:38:44.655] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:82:0) after 1m0s
[00:39:44.739] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:82:0)
[00:39:44.739] Timer tick, asking Buildbucket for the build status
[00:39:45.337] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[00:39:45.337] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:83:0) after 1m0s
[00:40:45.393] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:83:0)
[00:40:45.394] Timer tick, asking Buildbucket for the build status
[00:40:46.578] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[00:40:46.578] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:84:0) after 1m0s
[00:41:46.647] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:84:0)
[00:41:46.647] Timer tick, asking Buildbucket for the build status
[00:41:47.093] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[00:41:47.093] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:85:0) after 1m0s
[00:42:47.127] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:85:0)
[00:42:47.127] Timer tick, asking Buildbucket for the build status
[00:42:47.361] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[00:42:47.361] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:86:0) after 1m0s
[00:43:47.377] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:86:0)
[00:43:47.377] Timer tick, asking Buildbucket for the build status
[00:43:49.511] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[00:43:49.511] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:87:0) after 1m0s
[00:44:49.534] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:87:0)
[00:44:49.534] Timer tick, asking Buildbucket for the build status
[00:44:49.953] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[00:44:49.953] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:88:0) after 1m0s
[00:45:49.982] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:88:0)
[00:45:49.982] Timer tick, asking Buildbucket for the build status
[00:45:50.214] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[00:45:50.214] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:89:0) after 1m0s
[00:46:50.357] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:89:0)
[00:46:50.357] Timer tick, asking Buildbucket for the build status
[00:46:50.662] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[00:46:50.662] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:90:0) after 1m0s
[00:47:50.774] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:90:0)
[00:47:50.774] Timer tick, asking Buildbucket for the build status
[00:47:50.945] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[00:47:50.945] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:91:0) after 1m0s
[00:48:51.113] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:91:0)
[00:48:51.113] Timer tick, asking Buildbucket for the build status
[00:48:51.371] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[00:48:51.371] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:92:0) after 1m0s
[00:49:51.451] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:92:0)
[00:49:51.451] Timer tick, asking Buildbucket for the build status
[00:49:51.709] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[00:49:51.709] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:93:0) after 1m0s
[00:50:51.829] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:93:0)
[00:50:51.829] Timer tick, asking Buildbucket for the build status
[00:50:52.011] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[00:50:52.011] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:94:0) after 1m0s
[00:51:52.268] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:94:0)
[00:51:52.268] Timer tick, asking Buildbucket for the build status
[00:51:52.513] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[00:51:52.513] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:95:0) after 1m0s
[00:52:52.696] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:95:0)
[00:52:52.696] Timer tick, asking Buildbucket for the build status
[00:52:52.881] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[00:52:52.881] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:96:0) after 1m0s
[00:53:53.079] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:96:0)
[00:53:53.079] Timer tick, asking Buildbucket for the build status
[00:53:53.594] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[00:53:53.595] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:97:0) after 1m0s
[00:54:53.686] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:97:0)
[00:54:53.686] Timer tick, asking Buildbucket for the build status
[00:54:54.301] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[00:54:54.301] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:98:0) after 1m0s
[00:55:54.406] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:98:0)
[00:55:54.406] Timer tick, asking Buildbucket for the build status
[00:55:54.907] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[00:55:54.907] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:99:0) after 1m0s
[00:56:55.166] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:99:0)
[00:56:55.166] Timer tick, asking Buildbucket for the build status
[00:56:56.206] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[00:56:56.206] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:100:0) after 1m0s
[00:57:56.494] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:100:0)
[00:57:56.494] Timer tick, asking Buildbucket for the build status
[00:57:57.139] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[00:57:57.139] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:101:0) after 1m0s
[00:58:57.185] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:101:0)
[00:58:57.185] Timer tick, asking Buildbucket for the build status
[00:58:57.363] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[00:58:57.363] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:102:0) after 1m0s
[00:59:57.426] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:102:0)
[00:59:57.426] Timer tick, asking Buildbucket for the build status
[00:59:57.792] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[00:59:57.792] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:103:0) after 1m0s
[01:00:57.910] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:103:0)
[01:00:57.910] Timer tick, asking Buildbucket for the build status
[01:00:58.135] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[01:00:58.135] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:104:0) after 1m0s
[01:01:58.277] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:104:0)
[01:01:58.277] Timer tick, asking Buildbucket for the build status
[01:01:58.503] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[01:01:58.503] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:105:0) after 1m0s
[01:02:58.648] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:105:0)
[01:02:58.648] Timer tick, asking Buildbucket for the build status
[01:02:58.891] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[01:02:58.891] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:106:0) after 1m0s
[01:03:58.954] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:106:0)
[01:03:58.954] Timer tick, asking Buildbucket for the build status
[01:03:59.401] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[01:03:59.401] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:107:0) after 1m0s
[01:04:59.669] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:107:0)
[01:04:59.669] Timer tick, asking Buildbucket for the build status
[01:04:59.857] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[01:04:59.857] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:108:0) after 1m0s
[01:06:00.036] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:108:0)
[01:06:00.036] Timer tick, asking Buildbucket for the build status
[01:06:00.666] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[01:06:00.666] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:109:0) after 1m0s
[01:07:00.692] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:109:0)
[01:07:00.692] Timer tick, asking Buildbucket for the build status
[01:07:00.871] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[01:07:00.871] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:110:0) after 1m0s
[01:08:00.922] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:110:0)
[01:08:00.922] Timer tick, asking Buildbucket for the build status
[01:08:01.811] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[01:08:01.811] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:111:0) after 1m0s
[01:09:01.954] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:111:0)
[01:09:01.954] Timer tick, asking Buildbucket for the build status
[01:09:02.198] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[01:09:02.198] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:112:0) after 1m0s
[01:10:02.227] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:112:0)
[01:10:02.227] Timer tick, asking Buildbucket for the build status
[01:10:02.796] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[01:10:02.796] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:113:0) after 1m0s
[01:11:02.907] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:113:0)
[01:11:02.907] Timer tick, asking Buildbucket for the build status
[01:11:03.077] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[01:11:03.077] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:114:0) after 1m0s
[01:12:03.146] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:114:0)
[01:12:03.146] Timer tick, asking Buildbucket for the build status
[01:12:03.418] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[01:12:03.418] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:115:0) after 1m0s
[01:13:03.431] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:115:0)
[01:13:03.431] Timer tick, asking Buildbucket for the build status
[01:13:03.853] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[01:13:03.853] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:116:0) after 1m0s
[01:14:03.948] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:116:0)
[01:14:03.948] Timer tick, asking Buildbucket for the build status
[01:14:04.462] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[01:14:04.462] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:117:0) after 1m0s
[01:15:04.537] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:117:0)
[01:15:04.537] Timer tick, asking Buildbucket for the build status
[01:15:05.067] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[01:15:05.067] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:118:0) after 1m0s
[01:16:05.185] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:118:0)
[01:16:05.185] Timer tick, asking Buildbucket for the build status
[01:16:06.302] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[01:16:06.302] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:119:0) after 1m0s
[01:17:06.456] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:119:0)
[01:17:06.456] Timer tick, asking Buildbucket for the build status
[01:17:06.617] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[01:17:06.617] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:120:0) after 1m0s
[01:18:06.693] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:120:0)
[01:18:06.693] Timer tick, asking Buildbucket for the build status
[01:18:07.957] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[01:18:07.957] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:121:0) after 1m0s
[01:19:08.084] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:121:0)
[01:19:08.084] Timer tick, asking Buildbucket for the build status
[01:19:08.863] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[01:19:08.863] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:122:0) after 1m0s
[01:20:08.953] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:122:0)
[01:20:08.953] Timer tick, asking Buildbucket for the build status
[01:20:09.763] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[01:20:09.763] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:123:0) after 1m0s
[01:21:10.148] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:123:0)
[01:21:10.148] Timer tick, asking Buildbucket for the build status
[01:21:10.445] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[01:21:10.445] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:124:0) after 1m0s
[01:22:10.491] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:124:0)
[01:22:10.491] Timer tick, asking Buildbucket for the build status
[01:22:11.283] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[01:22:11.283] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:125:0) after 1m0s
[01:23:11.332] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:125:0)
[01:23:11.332] Timer tick, asking Buildbucket for the build status
[01:23:11.588] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[01:23:11.588] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:126:0) after 1m0s
[01:24:11.693] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:126:0)
[01:24:11.693] Timer tick, asking Buildbucket for the build status
[01:24:12.281] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[01:24:12.281] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:127:0) after 1m0s
[01:25:12.508] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:127:0)
[01:25:12.508] Timer tick, asking Buildbucket for the build status
[01:25:12.707] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[01:25:12.707] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:128:0) after 1m0s
[01:26:12.873] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:128:0)
[01:26:12.873] Timer tick, asking Buildbucket for the build status
[01:26:13.257] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[01:26:13.257] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:129:0) after 1m0s
[01:27:13.310] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:129:0)
[01:27:13.310] Timer tick, asking Buildbucket for the build status
[01:27:14.322] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[01:27:14.322] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:130:0) after 1m0s
[01:28:14.433] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:130:0)
[01:28:14.433] Timer tick, asking Buildbucket for the build status
[01:28:16.957] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[01:28:16.957] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:131:0) after 1m0s
[01:29:17.068] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:131:0)
[01:29:17.068] Timer tick, asking Buildbucket for the build status
[01:29:17.314] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[01:29:17.314] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:132:0) after 1m0s
[01:30:17.524] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:132:0)
[01:30:17.524] Timer tick, asking Buildbucket for the build status
[01:30:18.226] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[01:30:18.227] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:133:0) after 1m0s
[01:31:18.332] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:133:0)
[01:31:18.332] Timer tick, asking Buildbucket for the build status
[01:31:18.828] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[01:31:18.828] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:134:0) after 1m0s
[01:32:18.920] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:134:0)
[01:32:18.920] Timer tick, asking Buildbucket for the build status
[01:32:19.547] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[01:32:19.547] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:135:0) after 1m0s
[01:33:19.702] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:135:0)
[01:33:19.702] Timer tick, asking Buildbucket for the build status
[01:33:20.069] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[01:33:20.069] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:136:0) after 1m0s
[01:34:20.121] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:136:0)
[01:34:20.121] Timer tick, asking Buildbucket for the build status
[01:34:20.823] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[01:34:20.823] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:137:0) after 1m0s
[01:35:21.066] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:137:0)
[01:35:21.066] Timer tick, asking Buildbucket for the build status
[01:35:21.293] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[01:35:21.293] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:138:0) after 1m0s
[01:36:21.294] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:138:0)
[01:36:21.294] Timer tick, asking Buildbucket for the build status
[01:36:21.535] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[01:36:21.535] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:139:0) after 1m0s
[01:37:21.563] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:139:0)
[01:37:21.563] Timer tick, asking Buildbucket for the build status
[01:37:23.359] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[01:37:23.359] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:140:0) after 1m0s
[01:38:23.468] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:140:0)
[01:38:23.468] Timer tick, asking Buildbucket for the build status
[01:38:24.249] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[01:38:24.249] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:141:0) after 1m0s
[01:39:24.446] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:141:0)
[01:39:24.446] Timer tick, asking Buildbucket for the build status
[01:39:24.679] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[01:39:24.679] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:142:0) after 1m0s
[01:40:24.772] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:142:0)
[01:40:24.772] Timer tick, asking Buildbucket for the build status
[01:40:26.603] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[01:40:26.603] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:143:0) after 1m0s
[01:41:26.798] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:143:0)
[01:41:26.798] Timer tick, asking Buildbucket for the build status
[01:41:26.992] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[01:41:26.992] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:144:0) after 1m0s
[01:42:27.125] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:144:0)
[01:42:27.125] Timer tick, asking Buildbucket for the build status
[01:42:27.335] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[01:42:27.335] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:145:0) after 1m0s
[01:43:27.415] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:145:0)
[01:43:27.415] Timer tick, asking Buildbucket for the build status
[01:43:28.459] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[01:43:28.459] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:146:0) after 1m0s
[01:44:28.628] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:146:0)
[01:44:28.628] Timer tick, asking Buildbucket for the build status
[01:44:28.856] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[01:44:28.856] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:147:0) after 1m0s
[01:45:29.059] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:147:0)
[01:45:29.059] Timer tick, asking Buildbucket for the build status
[01:45:29.286] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[01:45:29.286] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:148:0) after 1m0s
[01:46:29.409] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:148:0)
[01:46:29.410] Timer tick, asking Buildbucket for the build status
[01:46:29.805] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[01:46:29.805] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:149:0) after 1m0s
[01:47:29.881] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:149:0)
[01:47:29.881] Timer tick, asking Buildbucket for the build status
[01:47:30.973] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[01:47:30.973] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:150:0) after 1m0s
[01:48:31.021] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:150:0)
[01:48:31.021] Timer tick, asking Buildbucket for the build status
[01:48:32.116] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[01:48:32.116] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:151:0) after 1m0s
[01:49:32.160] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:151:0)
[01:49:32.160] Timer tick, asking Buildbucket for the build status
[01:49:32.415] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[01:49:32.415] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:152:0) after 1m0s
[01:50:32.591] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:152:0)
[01:50:32.591] Timer tick, asking Buildbucket for the build status
[01:50:33.209] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[01:50:33.209] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:153:0) after 1m0s
[01:51:33.513] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:153:0)
[01:51:33.513] Timer tick, asking Buildbucket for the build status
[01:51:34.206] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[01:51:34.206] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:154:0) after 1m0s
[01:52:34.418] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:154:0)
[01:52:34.418] Timer tick, asking Buildbucket for the build status
[01:52:35.141] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[01:52:35.141] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:155:0) after 1m0s
[01:53:35.398] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:155:0)
[01:53:35.398] Timer tick, asking Buildbucket for the build status
[01:53:35.891] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[01:53:35.891] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:156:0) after 1m0s
[01:54:35.972] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:156:0)
[01:54:35.972] Timer tick, asking Buildbucket for the build status
[01:54:36.185] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[01:54:36.185] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:157:0) after 1m0s
[01:55:36.354] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:157:0)
[01:55:36.354] Timer tick, asking Buildbucket for the build status
[01:55:36.994] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[01:55:36.994] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:158:0) after 1m0s
[01:56:37.068] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:158:0)
[01:56:37.068] Timer tick, asking Buildbucket for the build status
[01:56:37.256] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[01:56:37.256] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:159:0) after 1m0s
[01:57:37.448] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:159:0)
[01:57:37.448] Timer tick, asking Buildbucket for the build status
[01:57:37.592] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[01:57:37.592] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:160:0) after 1m0s
[01:58:37.689] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:160:0)
[01:58:37.689] Timer tick, asking Buildbucket for the build status
[01:58:37.877] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[01:58:37.877] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:161:0) after 1m0s
[01:59:38.003] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:161:0)
[01:59:38.003] Timer tick, asking Buildbucket for the build status
[01:59:38.179] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[01:59:38.179] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:162:0) after 1m0s
[02:00:38.302] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:162:0)
[02:00:38.302] Timer tick, asking Buildbucket for the build status
[02:00:38.524] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[02:00:38.524] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:163:0) after 1m0s
[02:01:38.895] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:163:0)
[02:01:38.895] Timer tick, asking Buildbucket for the build status
[02:01:39.068] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[02:01:39.068] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:164:0) after 1m0s
[02:02:39.482] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:164:0)
[02:02:39.482] Timer tick, asking Buildbucket for the build status
[02:02:39.706] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[02:02:39.706] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:165:0) after 1m0s
[02:03:40.124] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:165:0)
[02:03:40.124] Timer tick, asking Buildbucket for the build status
[02:03:43.106] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[02:03:43.106] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:166:0) after 1m0s
[02:04:43.163] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:166:0)
[02:04:43.163] Timer tick, asking Buildbucket for the build status
[02:04:43.368] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[02:04:43.368] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:167:0) after 1m0s
[02:05:43.434] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:167:0)
[02:05:43.434] Timer tick, asking Buildbucket for the build status
[02:05:43.826] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[02:05:43.826] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:168:0) after 1m0s
[02:06:43.866] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:168:0)
[02:06:43.866] Timer tick, asking Buildbucket for the build status
[02:06:44.064] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[02:06:44.064] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:169:0) after 1m0s
[02:07:44.192] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:169:0)
[02:07:44.192] Timer tick, asking Buildbucket for the build status
[02:07:44.966] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[02:07:44.966] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:170:0) after 1m0s
[02:08:45.028] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:170:0)
[02:08:45.028] Timer tick, asking Buildbucket for the build status
[02:08:46.178] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[02:08:46.178] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:171:0) after 1m0s
[02:09:46.316] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:171:0)
[02:09:46.316] Timer tick, asking Buildbucket for the build status
[02:09:48.646] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[02:09:48.646] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:172:0) after 1m0s
[02:10:48.868] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:172:0)
[02:10:48.868] Timer tick, asking Buildbucket for the build status
[02:10:49.077] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[02:10:49.077] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:173:0) after 1m0s
[02:11:49.251] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:173:0)
[02:11:49.251] Timer tick, asking Buildbucket for the build status
[02:11:49.503] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[02:11:49.503] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:174:0) after 1m0s
[02:12:49.738] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:174:0)
[02:12:49.738] Timer tick, asking Buildbucket for the build status
[02:12:49.995] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[02:12:49.995] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:175:0) after 1m0s
[02:13:50.110] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:175:0)
[02:13:50.110] Timer tick, asking Buildbucket for the build status
[02:13:50.342] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[02:13:50.342] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:176:0) after 1m0s
[02:14:50.552] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:176:0)
[02:14:50.552] Timer tick, asking Buildbucket for the build status
[02:14:50.703] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[02:14:50.703] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:177:0) after 1m0s
[02:15:50.904] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:177:0)
[02:15:50.904] Timer tick, asking Buildbucket for the build status
[02:15:51.091] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[02:15:51.091] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:178:0) after 1m0s
[02:16:51.182] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:178:0)
[02:16:51.182] Timer tick, asking Buildbucket for the build status
[02:16:51.343] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[02:16:51.343] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:179:0) after 1m0s
[02:17:51.528] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:179:0)
[02:17:51.528] Timer tick, asking Buildbucket for the build status
[02:17:52.349] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[02:17:52.349] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:180:0) after 1m0s
[02:18:52.601] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:180:0)
[02:18:52.601] Timer tick, asking Buildbucket for the build status
[02:18:52.819] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[02:18:52.819] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:181:0) after 1m0s
[02:19:52.929] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:181:0)
[02:19:52.929] Timer tick, asking Buildbucket for the build status
[02:19:53.157] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[02:19:53.157] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:182:0) after 1m0s
[02:20:53.205] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:182:0)
[02:20:53.205] Timer tick, asking Buildbucket for the build status
[02:20:54.239] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[02:20:54.239] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:183:0) after 1m0s
[02:21:54.360] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:183:0)
[02:21:54.360] Timer tick, asking Buildbucket for the build status
[02:21:54.909] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[02:21:54.909] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:184:0) after 1m0s
[02:22:54.991] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:184:0)
[02:22:54.991] Timer tick, asking Buildbucket for the build status
[02:22:56.162] Build 8891064955074398928: status "STARTED", result "", failure_reason "", cancelation_reason ""
[02:22:56.162] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9056495018033059568:185:0) after 1m0s
[02:23:41.353] Received PubSub notification, asking Buildbucket for the build status
[02:23:41.688] Build 8891064955074398928: status "COMPLETED", result "FAILURE", failure_reason "BUILD_FAILURE", cancelation_reason ""
[02:23:41.688] Buildbucket build:
{
  "build": {
    "bucket": "luci.chromium.ci",
    "canary_preference": "PROD",
    "completed_ts": "1579227819374599",
    "created_by": "project:chromium",
    "created_ts": "1579216729053274",
    "failure_reason": "BUILD_FAILURE",
    "id": "8891064955074398928",
    "parameters_json": "{\"builder_name\": \"mac-code-coverage\", \"properties\": {\"branch\": \"refs/heads/master\", \"repository\": \"https://chromium.googlesource.com/chromium/src\", \"revision\": \"f707f1d6d428f84cf14b64bc2ca74372e25c6ce7\"}}",
    "project": "chromium",
    "result": "FAILURE",
    "result_details_json": "{\"error\": {\"message\": \"79 Test Suite(s) failed.\\n\\n**gpu_unittests on (none) GPU on Mac** failed.\\n\\n**browser_tests on (none) GPU on Mac** failed.\\n\\n**webkit_unit_tests on (none) GPU on Mac** failed.\\n\\n**message_center_unittests on (none) GPU on Mac** failed.\\n\\n**gcm_unit_tests on (none) GPU on Mac** failed.\\n\\n**net_unittests on (none) GPU on Mac** failed.\\n\\n**blink_fuzzer_unittests on (none) GPU on Mac** failed.\\n\\n**boringssl_ssl_tests on (none) GPU on Mac** failed.\\n\\n**accessibility_unittests on (none) GPU on Mac** failed.\\n\\n**url_unittests on (none) GPU on Mac** failed.\\n\\n**components_browsertests on (none) GPU on Mac** failed.\\n\\n**cacheinvalidation_unittests on (none) GPU on Mac** failed.\\n\\n**boringssl_crypto_tests on (none) GPU on Mac** failed.\\n\\n#### ...66 more test(s)...\"}, \"properties\": {\"$build/code_coverage\": {\"use_clang_coverage\": true}, \"$build/goma\": {\"rpc_extra_params\": \"?prod\", \"server_host\": \"goma.chromium.org\"}, \"$recipe_engine/path\": {\"cache_dir\": \"/b/s/w/ir/cache\", \"temp_dir\": \"/b/s/w/ir/tmp/rt\"}, \"$recipe_engine/runtime\": {\"is_experimental\": false, \"is_luci\": true}, \"bot_id\": \"build227-m9\", \"branch\": \"refs/heads/master\", \"buildername\": \"mac-code-coverage\", \"buildnumber\": 660, \"got_angle_revision\": \"bdb0f8a524147f183f84c6013860384fb12934a3\", \"got_clang_revision\": \"n332890-c2443155-1\", \"got_dawn_revision\": \"f70786126c8b8c84af8dbf828b98567a8101c9c2\", \"got_nacl_revision\": \"3651f6c52037c96e034cc422746768d59182bff3\", \"got_revision\": \"f707f1d6d428f84cf14b64bc2ca74372e25c6ce7\", \"got_revision_cp\": \"refs/heads/master@{#732595}\", \"got_swarming_client_revision\": \"885b3febcc170a60f25795304e60927b77d1e92d\", \"got_swiftshader_revision\": \"5c6a3c247590d8057a1cc03e67e7d0576a970941\", \"got_v8_revision\": \"c06633ee438bee8a915a30fdc4f9778417ccfd0f\", \"got_v8_revision_cp\": \"refs/heads/8.1.197@{#1}\", \"got_webrtc_revision\": \"4c1086a36adea880087aa22b0a4439611e0e3f73\", \"got_webrtc_revision_cp\": \"refs/heads/master@{#30282}\", \"isolate_server\": \"https://isolateserver.appspot.com\", \"mastername\": \"chromium.fyi\", \"path_config\": \"generic\", \"recipe\": \"chromium\", \"repository\": \"https://chromium.googlesource.com/chromium/src\", \"revision\": \"f707f1d6d428f84cf14b64bc2ca74372e25c6ce7\", \"swarm_hashes\": {\"accessibility_unittests\": \"66253fe4fd36ea4c1404c0c81801962f4baa91e4\", \"angle_unittests\": \"9a51ce48263dd186d9aa44a4f2fb119d1e6a8087\", \"app_shell_unittests\": \"90f53bee0e0095823416e618440e95ff2a060199\", \"base_unittests\": \"16eb613487d33f91eb8bb9ea02a936b7084ef919\", \"base_util_unittests\": \"10764dfb2ad0128787db21c73aa56cfe1aafef5e\", \"blink_common_unittests\": \"ff46069375e40807223bdbd4302b5f2b706e79df\", \"blink_fuzzer_unittests\": \"18e8e10cc58a99641cfc107568d915dd9691e952\", \"blink_heap_unittests\": \"f0808eaa3c9defd69ddd893e255746b3f498f44d\", \"blink_platform_unittests\": \"48377a67be4a6f77125d10d1d0ae62102ac4b5bb\", \"blink_unittests\": \"d671798888df78c5aaeddc608da59319ae79e7c3\", \"boringssl_crypto_tests\": \"069d62345ab92e2515293c50dd3f1e7d80d106f9\", \"boringssl_ssl_tests\": \"48c695577f813904cf00017e89cee732d0fd4a8b\", \"browser_tests\": \"7ee2cf622928a92cac6ea242b54ea48326dd0895\", \"cacheinvalidation_unittests\": \"5ed0d0850c0be733217592a76dca170723ca72b1\", \"capture_unittests\": \"d007e5df4a6fc604febabab34b4afda53b0d54e0\", \"cast_unittests\": \"5159fe7f5a080336e0564497bbd55f71e905caed\", \"cc_unittests\": \"fd85de9251a01a587a551658d5a0f7978d96ae8e\", \"chrome_app_unittests\": \"70abe6f6f94b23492291673924eb070efb00249b\", \"chromedriver_unittests\": \"6bf521fe9f1dff0f03e945c93309b5219506d263\", \"components_browsertests\": \"7ba548c0e29d0e033016bda6b609f4686caf340b\", \"components_unittests\": \"0ef67ee70b3f3664c7d34515ecad02edf7f18f62\", \"content_browsertests\": \"36e1ba3e1619158974b74f64151565368b49e876\", \"content_nocompile_tests\": \"be6c29577c6417489bf8bf779e42d23e632cc0ce\", \"content_unittests\": \"ef21f4202ea6bf182acc1711bddfeb4acbd786dd\", \"crashpad_tests\": \"32852066089af47e407eee9250069ab38fd754ba\", \"cronet_tests\": \"18d35a85b269f3583a28951d0882a28e5a1a6ad2\", \"cronet_unittests\": \"67f81d6741e3de978b1ce7ee978732fdc424555a\", \"crypto_unittests\": \"860ef1e34e4285f34c635f1d4827cfaba0a6ab10\", \"device_unittests\": \"c8aee79071572c2e60058d40cec01e8373b5c21a\", \"display_unittests\": \"37f91c485967c1b662fea2160fd8780a09bef029\", \"events_unittests\": \"64ecdda63f8ec0df49a27218adef52b61cb23af9\", \"extensions_browsertests\": \"ff694e7fe1aa601add093609e17719b9d5248981\", \"extensions_unittests\": \"3ff77526036a7996c38ae920bfe965699e909ba2\", \"filesystem_service_unittests\": \"9b816ddd4f66530a299ef7bd8a57cd0ead003741\", \"gcm_unit_tests\": \"4f48ea4028b15aae4d71ba9949f4e99ddf8167bc\", \"gfx_unittests\": \"47c5ab3d5a0a0ac113d662bb8058c130e6cde458\", \"gin_unittests\": \"bb1b896164bb7fbcde6bfd582407a8c3c278585e\", \"google_apis_unittests\": \"81e8e22be58773f1427a25b2431b1daeb1688d8d\", \"gpu_unittests\": \"e83a751621ab3b19dbc796c36fae0eedf2abfc17\", \"gwp_asan_unittests\": \"06c4a42814399dec1527f95d839b4e270181a3c7\", \"headless_browsertests\": \"42241229e8df1eb6ea7182a008fe478cb60b8c33\", \"headless_unittests\": \"57559c188759507008094cecf4d6c040786706c3\", \"interactive_ui_tests\": \"512fd16c43ee46952876361adcd808560c183ee6\", \"ipc_tests\": \"4a6617850c6282fa87e725eb9ba01294d784e3fc\", \"jingle_unittests\": \"1f618f69fccd73381df7ce9fc23dbf37dd8f359c\", \"latency_unittests\": \"3c0ff034fd11998fe3543202996193abd96ad8b3\", \"libjingle_xmpp_unittests\": \"e51ca7540e534652675f717eac3be447c34f26fe\", \"media_blink_unittests\": \"f5a6b2facdc0637dc89deb6738b0f61cb865e345\", \"media_service_unittests\": \"a7c4287dd810adc50c9cf39d6467edb32aa1cc91\", \"media_unittests\": \"8d23670ed7de2314d3f930071f37de94bf8aca52\", \"message_center_unittests\": \"98771ea84b88b76ff8a9e6e85b309cd1e71f3120\", \"midi_unittests\": \"39d722b15283075fe2247f4be2fc611baaa27c23\", \"mojo_unittests\": \"79300065ca7889000eb783ee3472e36667f825d4\", \"nacl_loader_unittests\": \"5aa60e999888931564cbc801d170994eaa607f3d\", \"native_theme_unittests\": \"4aa45df50e810cb6fd18dddd8ab4c7c670bddc45\", \"net_unittests\": \"c7cc7fa2a7ff744193f17585686d896a15ed2ec3\", \"pdf_unittests\": \"6a666cb97ded106a5b9de4bf5c9df8e0063858f5\", \"perfetto_unittests\": \"f176113a263bd467393b937b963e1326882e37bb\", \"ppapi_unittests\": \"86e1c2758797fc0d5f4546b0020bcb5411dc5be7\", \"printing_unittests\": \"d9b54433e74ae8b8c540abfed297c3b1588174d7\", \"remoting_unittests\": \"8cc30c7c5884e6577dd4f43828c72bb598b0685f\", \"sandbox_mac_unittests\": \"c697b77337a08e86e7d200085eb31872cc68483a\", \"service_manager_unittests\": \"1efc4d711ff76e60c75adda95c08ba7f606164d3\", \"services_unittests\": \"45301d75c4ad3253dcbd9cabc7dc7655aedfeb7b\", \"shell_dialogs_unittests\": \"777d45d5164dd1ccd8cdb367122361bf048c6686\", \"skia_unittests\": \"392a77a3631382901f8297f5503230d16754039e\", \"snapshot_unittests\": \"84f90f0e25e2aea5a133b7bdbd082921ea1492b6\", \"sql_unittests\": \"dc702280b0b5109369f77c4253a9aa6f73bdb35c\", \"storage_unittests\": \"c51ad515f796add4b486b7a13b12269678907788\", \"sync_integration_tests\": \"abcf565e707762914838bf93dacf6292c6530f31\", \"ui_base_unittests\": \"c7923649e4067f2d0d2ef142390f746635e914f4\", \"ui_touch_selection_unittests\": \"50a6629d905bf68421ed0054d4711c5385467099\", \"unit_tests\": \"d54d095dc86053c29287d0958d1c5bd6a0683978\", \"updater_tests\": \"6214840f5978acfed72b54bd607766cef1f42127\", \"url_unittests\": \"36f895842971c1711064c650ba364ea00d294e1a\", \"views_unittests\": \"7c27fa77374f3babcd71285e352b6ffbab7318c4\", \"viz_unittests\": \"8faa6beac720a0addf43d59d6983c11f3ef157a0\", \"wtf_unittests\": \"c1f75ccbdf448cbdd8c999b8e737953f6a6d77a0\", \"xr_browser_tests\": \"3ad32bc8e7e2e5cb749a26f9b5fdd908c1ff781b\"}, \"swarm_hashes_refs/heads/master(at){#732595}_without_patch\": {\"accessibility_unittests\": \"66253fe4fd36ea4c1404c0c81801962f4baa91e4\", \"angle_unittests\": \"9a51ce48263dd186d9aa44a4f2fb119d1e6a8087\", \"app_shell_unittests\": \"90f53bee0e0095823416e618440e95ff2a060199\", \"base_unittests\": \"16eb613487d33f91eb8bb9ea02a936b7084ef919\", \"base_util_unittests\": \"10764dfb2ad0128787db21c73aa56cfe1aafef5e\", \"blink_common_unittests\": \"ff46069375e40807223bdbd4302b5f2b706e79df\", \"blink_fuzzer_unittests\": \"18e8e10cc58a99641cfc107568d915dd9691e952\", \"blink_heap_unittests\": \"f0808eaa3c9defd69ddd893e255746b3f498f44d\", \"blink_platform_unittests\": \"48377a67be4a6f77125d10d1d0ae62102ac4b5bb\", \"blink_unittests\": \"d671798888df78c5aaeddc608da59319ae79e7c3\", \"boringssl_crypto_tests\": \"069d62345ab92e2515293c50dd3f1e7d80d106f9\", \"boringssl_ssl_tests\": \"48c695577f813904cf00017e89cee732d0fd4a8b\", \"browser_tests\": \"7ee2cf622928a92cac6ea242b54ea48326dd0895\", \"cacheinvalidation_unittests\": \"5ed0d0850c0be733217592a76dca170723ca72b1\", \"capture_unittests\": \"d007e5df4a6fc604febabab34b4afda53b0d54e0\", \"cast_unittests\": \"5159fe7f5a080336e0564497bbd55f71e905caed\", \"cc_unittests\": \"fd85de9251a01a587a551658d5a0f7978d96ae8e\", \"chrome_app_unittests\": \"70abe6f6f94b23492291673924eb070efb00249b\", \"chromedriver_unittests\": \"6bf521fe9f1dff0f03e945c93309b5219506d263\", \"components_browsertests\": \"7ba548c0e29d0e033016bda6b609f4686caf340b\", \"components_unittests\": \"0ef67ee70b3f3664c7d34515ecad02edf7f18f62\", \"content_browsertests\": \"36e1ba3e1619158974b74f64151565368b49e876\", \"content_nocompile_tests\": \"be6c29577c6417489bf8bf779e42d23e632cc0ce\", \"content_unittests\": \"ef21f4202ea6bf182acc1711bddfeb4acbd786dd\", \"crashpad_tests\": \"32852066089af47e407eee9250069ab38fd754ba\", \"cronet_tests\": \"18d35a85b269f3583a28951d0882a28e5a1a6ad2\", \"cronet_unittests\": \"67f81d6741e3de978b1ce7ee978732fdc424555a\", \"crypto_unittests\": \"860ef1e34e4285f34c635f1d4827cfaba0a6ab10\", \"device_unittests\": \"c8aee79071572c2e60058d40cec01e8373b5c21a\", \"display_unittests\": \"37f91c485967c1b662fea2160fd8780a09bef029\", \"events_unittests\": \"64ecdda63f8ec0df49a27218adef52b61cb23af9\", \"extensions_browsertests\": \"ff694e7fe1aa601add093609e17719b9d5248981\", \"extensions_unittests\": \"3ff77526036a7996c38ae920bfe965699e909ba2\", \"filesystem_service_unittests\": \"9b816ddd4f66530a299ef7bd8a57cd0ead003741\", \"gcm_unit_tests\": \"4f48ea4028b15aae4d71ba9949f4e99ddf8167bc\", \"gfx_unittests\": \"47c5ab3d5a0a0ac113d662bb8058c130e6cde458\", \"gin_unittests\": \"bb1b896164bb7fbcde6bfd582407a8c3c278585e\", \"google_apis_unittests\": \"81e8e22be58773f1427a25b2431b1daeb1688d8d\", \"gpu_unittests\": \"e83a751621ab3b19dbc796c36fae0eedf2abfc17\", \"gwp_asan_unittests\": \"06c4a42814399dec1527f95d839b4e270181a3c7\", \"headless_browsertests\": \"42241229e8df1eb6ea7182a008fe478cb60b8c33\", \"headless_unittests\": \"57559c188759507008094cecf4d6c040786706c3\", \"interactive_ui_tests\": \"512fd16c43ee46952876361adcd808560c183ee6\", \"ipc_tests\": \"4a6617850c6282fa87e725eb9ba01294d784e3fc\", \"jingle_unittests\": \"1f618f69fccd73381df7ce9fc23dbf37dd8f359c\", \"latency_unittests\": \"3c0ff034fd11998fe3543202996193abd96ad8b3\", \"libjingle_xmpp_unittests\": \"e51ca7540e534652675f717eac3be447c34f26fe\", \"media_blink_unittests\": \"f5a6b2facdc0637dc89deb6738b0f61cb865e345\", \"media_service_unittests\": \"a7c4287dd810adc50c9cf39d6467edb32aa1cc91\", \"media_unittests\": \"8d23670ed7de2314d3f930071f37de94bf8aca52\", \"message_center_unittests\": \"98771ea84b88b76ff8a9e6e85b309cd1e71f3120\", \"midi_unittests\": \"39d722b15283075fe2247f4be2fc611baaa27c23\", \"mojo_unittests\": \"79300065ca7889000eb783ee3472e36667f825d4\", \"nacl_loader_unittests\": \"5aa60e999888931564cbc801d170994eaa607f3d\", \"native_theme_unittests\": \"4aa45df50e810cb6fd18dddd8ab4c7c670bddc45\", \"net_unittests\": \"c7cc7fa2a7ff744193f17585686d896a15ed2ec3\", \"pdf_unittests\": \"6a666cb97ded106a5b9de4bf5c9df8e0063858f5\", \"perfetto_unittests\": \"f176113a263bd467393b937b963e1326882e37bb\", \"ppapi_unittests\": \"86e1c2758797fc0d5f4546b0020bcb5411dc5be7\", \"printing_unittests\": \"d9b54433e74ae8b8c540abfed297c3b1588174d7\", \"remoting_unittests\": \"8cc30c7c5884e6577dd4f43828c72bb598b0685f\", \"sandbox_mac_unittests\": \"c697b77337a08e86e7d200085eb31872cc68483a\", \"service_manager_unittests\": \"1efc4d711ff76e60c75adda95c08ba7f606164d3\", \"services_unittests\": \"45301d75c4ad3253dcbd9cabc7dc7655aedfeb7b\", \"shell_dialogs_unittests\": \"777d45d5164dd1ccd8cdb367122361bf048c6686\", \"skia_unittests\": \"392a77a3631382901f8297f5503230d16754039e\", \"snapshot_unittests\": \"84f90f0e25e2aea5a133b7bdbd082921ea1492b6\", \"sql_unittests\": \"dc702280b0b5109369f77c4253a9aa6f73bdb35c\", \"storage_unittests\": \"c51ad515f796add4b486b7a13b12269678907788\", \"sync_integration_tests\": \"abcf565e707762914838bf93dacf6292c6530f31\", \"ui_base_unittests\": \"c7923649e4067f2d0d2ef142390f746635e914f4\", \"ui_touch_selection_unittests\": \"50a6629d905bf68421ed0054d4711c5385467099\", \"unit_tests\": \"d54d095dc86053c29287d0958d1c5bd6a0683978\", \"updater_tests\": \"6214840f5978acfed72b54bd607766cef1f42127\", \"url_unittests\": \"36f895842971c1711064c650ba364ea00d294e1a\", \"views_unittests\": \"7c27fa77374f3babcd71285e352b6ffbab7318c4\", \"viz_unittests\": \"8faa6beac720a0addf43d59d6983c11f3ef157a0\", \"wtf_unittests\": \"c1f75ccbdf448cbdd8c999b8e737953f6a6d77a0\", \"xr_browser_tests\": \"3ad32bc8e7e2e5cb749a26f9b5fdd908c1ff781b\"}}, \"swarming\": {\"bot_dimensions\": {\"builderless\": [\"1\"], \"caches\": [\"builder_a165fbc5f77948fe8465d1f67a1e4a103f195e4f29767b5fac0876e41f78e10e_v2\", \"git\", \"goma_v2\", \"vpython\"], \"cores\": [\"24\"], \"cpu\": [\"x86\", \"x86-64\", \"x86-64-E5-2697_v2\"], \"gce\": [\"0\"], \"gpu\": [\"1002\", \"1002:679e\", \"1002:679e-4.0.11-3.2.8\"], \"hidpi\": [\"0\"], \"id\": [\"build227-m9\"], \"mac_model\": [\"MacPro6,1\"], \"machine_type\": [\"n1-standard-16\"], \"os\": [\"Mac\", \"Mac-10.13\", \"Mac-10.13.6\"], \"pool\": [\"luci.chromium.ci\"], \"python\": [\"2.7.10\"], \"server_version\": [\"4760-d9a0e6d\"], \"ssd\": [\"1\"], \"zone\": [\"us\", \"us-atl\", \"us-atl-golo\", \"us-atl-golo-m9\"]}}, \"ui\": {\"info\": \"79 Test Suite(s) failed.\\n\\n**gpu_unittests on (none) GPU on Mac** failed.\\n\\n**browser_tests on (none) GPU on Mac** failed.\\n\\n**webkit_unit_tests on (none) GPU on Mac** failed.\\n\\n**message_center_unittests on (none) GPU on Mac** failed.\\n\\n**gcm_unit_tests on (none) GPU on Mac** failed.\\n\\n**net_unittests on (none) GPU on Mac** failed.\\n\\n**blink_fuzzer_unittests on (none) GPU on Mac** failed.\\n\\n**boringssl_ssl_tests on (none) GPU on Mac** failed.\\n\\n**accessibility_unittests on (none) GPU on Mac** failed.\\n\\n**url_unittests on (none) GPU on Mac** failed.\\n\\n**components_browsertests on (none) GPU on Mac** failed.\\n\\n**cacheinvalidation_unittests on (none) GPU on Mac** failed.\\n\\n**boringssl_crypto_tests on (none) GPU on Mac** failed.\\n\\n#### ...66 more test(s)...\"}}",
    "service_account": "chromium-ci-builder@chops-service-accounts.iam.gserviceaccount.com",
    "started_ts": "1579216837943536",
    "status": "COMPLETED",
    "status_changed_ts": "1579216838324637",
    "tags": [
      "build_address:luci.chromium.ci/mac-code-coverage/660",
      "builder:mac-code-coverage",
      "buildset:commit/git/f707f1d6d428f84cf14b64bc2ca74372e25c6ce7",
      "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/f707f1d6d428f84cf14b64bc2ca74372e25c6ce7",
      "gitiles_ref:refs/heads/master",
      "scheduler_invocation_id:9056495018033059568",
      "scheduler_job_id:chromium/mac-code-coverage",
      "swarming_hostname:chromium-swarm.appspot.com",
      "swarming_tag:log_location:logdog://logs.chromium.org/chromium/buildbucket/cr-buildbucket.appspot.com/8891064955074398928/+/annotations",
      "swarming_tag:luci_project:chromium",
      "swarming_tag:os:Mac",
      "swarming_tag:recipe_name:chromium",
      "swarming_tag:recipe_package:infra/recipe_bundles/chromium.googlesource.com/chromium/tools/build",
      "swarming_task_id:49c97883e7b43b10",
      "user_agent:luci-scheduler"
    ],
    "updated_ts": "1579227820843395",
    "url": "https://ci.chromium.org/b/8891064955074398928",
    "utcnow_ts": "1579227821665876"
  }
}
[02:23:41.688] Invocation finished in 3h4m54.840261171s with status FAILED