Status: FAILED
Triggered by: -
Duration: 1 hour
Actions:

Definition (rev ead1c24e5b0e6b883f7d7e816b15c81777fef6bb)

buildbucket: <
  server: "cr-buildbucket.appspot.com"
  bucket: "luci.chromium.ci"
  builder: "ToTiOSDevice"
>

Incoming triggers

Incoming properties

{
  "branch": "refs/heads/master",
  "repository": "https://chromium.googlesource.com/chromium/src",
  "revision": "fa583a883d0b97b1d2503e4e7dd294c04930cb2d"
}

Incoming tags

  • buildset:commit/git/fa583a883d0b97b1d2503e4e7dd294c04930cb2d
  • buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/fa583a883d0b97b1d2503e4e7dd294c04930cb2d
  • gitiles_ref:refs/heads/master

Debug log (UTC)

[08:30:24.171] New invocation is queued and will start shortly
[08:30:25.241] Starting the invocation (attempt 1)
[08:30:25.275] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[08:30:25.275] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[08:30:25.275] Buildbucket request:
{
  "bucket": "luci.chromium.ci",
  "client_operation_id": "9055463746362498336",
  "parameters_json": "{\"builder_name\":\"ToTiOSDevice\",\"properties\":{\"branch\":\"refs/heads/master\",\"repository\":\"https://chromium.googlesource.com/chromium/src\",\"revision\":\"fa583a883d0b97b1d2503e4e7dd294c04930cb2d\"}}",
  "pubsub_callback": {
    "auth_token": "...",
    "topic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
  },
  "tags": [
    "builder:ToTiOSDevice",
    "scheduler_invocation_id:9055463746362498336",
    "scheduler_job_id:chromium/ToTiOSDevice",
    "user_agent:luci-scheduler",
    "buildset:commit/git/fa583a883d0b97b1d2503e4e7dd294c04930cb2d",
    "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/fa583a883d0b97b1d2503e4e7dd294c04930cb2d",
    "gitiles_ref:refs/heads/master"
  ]
}
[08:30:26.301] Buildbucket response:
{
  "build": {
    "bucket": "luci.chromium.ci",
    "canary_preference": "PROD",
    "created_by": "project:chromium",
    "created_ts": "1580200225533760",
    "id": "8890033684269914560",
    "parameters_json": "{\"builder_name\": \"ToTiOSDevice\", \"properties\": {\"branch\": \"refs/heads/master\", \"repository\": \"https://chromium.googlesource.com/chromium/src\", \"revision\": \"fa583a883d0b97b1d2503e4e7dd294c04930cb2d\"}}",
    "project": "chromium",
    "result_details_json": "{\"properties\": {}}",
    "service_account": "chromium-ci-builder@chops-service-accounts.iam.gserviceaccount.com",
    "status": "SCHEDULED",
    "status_changed_ts": "1580200226124902",
    "tags": [
      "build_address:luci.chromium.ci/ToTiOSDevice/16191",
      "builder:ToTiOSDevice",
      "buildset:commit/git/fa583a883d0b97b1d2503e4e7dd294c04930cb2d",
      "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/fa583a883d0b97b1d2503e4e7dd294c04930cb2d",
      "gitiles_ref:refs/heads/master",
      "scheduler_invocation_id:9055463746362498336",
      "scheduler_job_id:chromium/ToTiOSDevice",
      "swarming_hostname:chromium-swarm.appspot.com",
      "swarming_tag:log_location:logdog://logs.chromium.org/chromium/buildbucket/cr-buildbucket.appspot.com/8890033684269914560/+/annotations",
      "swarming_tag:luci_project:chromium",
      "swarming_tag:recipe_name:ios/unified_builder_tester",
      "swarming_tag:recipe_package:infra/recipe_bundles/chromium.googlesource.com/chromium/tools/build",
      "swarming_task_id:",
      "user_agent:luci-scheduler"
    ],
    "updated_ts": "1580200226125105",
    "url": "https://ci.chromium.org/b/8890033684269914560",
    "utcnow_ts": "1580200226291830"
  }
}
[08:30:26.301] Task URL: https://ci.chromium.org/b/8890033684269914560
[08:30:26.301] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:2:0) after 1m0s
[08:31:26.322] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:2:0)
[08:31:26.322] Timer tick, asking Buildbucket for the build status
[08:31:26.582] Build 8890033684269914560: status "SCHEDULED", result "", failure_reason "", cancelation_reason ""
[08:31:26.582] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:3:0) after 1m0s
[08:32:26.637] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:3:0)
[08:32:26.637] Timer tick, asking Buildbucket for the build status
[08:32:26.856] Build 8890033684269914560: status "SCHEDULED", result "", failure_reason "", cancelation_reason ""
[08:32:26.856] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:4:0) after 1m0s
[08:33:14.615] Received PubSub notification, asking Buildbucket for the build status
[08:33:16.111] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[08:33:26.917] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:4:0)
[08:33:26.917] Timer tick, asking Buildbucket for the build status
[08:33:27.093] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[08:33:27.093] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:6:0) after 1m0s
[08:34:27.114] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:6:0)
[08:34:27.114] Timer tick, asking Buildbucket for the build status
[08:34:27.806] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[08:34:27.806] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:7:0) after 1m0s
[08:35:27.784] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:7:0)
[08:35:27.784] Timer tick, asking Buildbucket for the build status
[08:35:28.697] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[08:35:28.697] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:8:0) after 1m0s
[08:36:28.718] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:8:0)
[08:36:28.718] Timer tick, asking Buildbucket for the build status
[08:36:29.722] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[08:36:29.722] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:9:0) after 1m0s
[08:37:29.831] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:9:0)
[08:37:29.831] Timer tick, asking Buildbucket for the build status
[08:37:30.959] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[08:37:30.959] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:10:0) after 1m0s
[08:38:30.939] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:10:0)
[08:38:30.939] Timer tick, asking Buildbucket for the build status
[08:38:31.801] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[08:38:31.801] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:11:0) after 1m0s
[08:39:31.863] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:11:0)
[08:39:31.863] Timer tick, asking Buildbucket for the build status
[08:39:32.142] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[08:39:32.142] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:12:0) after 1m0s
[08:40:32.319] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:12:0)
[08:40:32.319] Timer tick, asking Buildbucket for the build status
[08:40:32.931] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[08:40:32.931] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:13:0) after 1m0s
[08:41:32.961] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:13:0)
[08:41:32.961] Timer tick, asking Buildbucket for the build status
[08:41:33.212] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[08:41:33.212] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:14:0) after 1m0s
[08:42:33.276] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:14:0)
[08:42:33.276] Timer tick, asking Buildbucket for the build status
[08:42:34.042] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[08:42:34.042] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:15:0) after 1m0s
[08:43:34.074] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:15:0)
[08:43:34.074] Timer tick, asking Buildbucket for the build status
[08:43:35.509] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[08:43:35.509] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:16:0) after 1m0s
[08:44:35.659] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:16:0)
[08:44:35.659] Timer tick, asking Buildbucket for the build status
[08:44:35.931] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[08:44:35.931] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:17:0) after 1m0s
[08:45:35.948] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:17:0)
[08:45:35.948] Timer tick, asking Buildbucket for the build status
[08:45:36.340] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[08:45:36.340] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:18:0) after 1m0s
[08:46:36.432] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:18:0)
[08:46:36.432] Timer tick, asking Buildbucket for the build status
[08:46:37.169] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[08:46:37.169] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:19:0) after 1m0s
[08:47:37.196] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:19:0)
[08:47:37.196] Timer tick, asking Buildbucket for the build status
[08:47:37.628] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[08:47:37.628] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:20:0) after 1m0s
[08:48:37.652] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:20:0)
[08:48:37.652] Timer tick, asking Buildbucket for the build status
[08:48:37.855] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[08:48:37.855] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:21:0) after 1m0s
[08:49:37.860] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:21:0)
[08:49:37.860] Timer tick, asking Buildbucket for the build status
[08:49:38.573] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[08:49:38.573] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:22:0) after 1m0s
[08:50:38.597] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:22:0)
[08:50:38.597] Timer tick, asking Buildbucket for the build status
[08:50:38.819] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[08:50:38.819] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:23:0) after 1m0s
[08:51:38.885] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:23:0)
[08:51:38.885] Timer tick, asking Buildbucket for the build status
[08:51:39.068] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[08:51:39.068] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:24:0) after 1m0s
[08:52:39.097] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:24:0)
[08:52:39.097] Timer tick, asking Buildbucket for the build status
[08:52:39.590] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[08:52:39.590] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:25:0) after 1m0s
[08:53:39.606] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:25:0)
[08:53:39.606] Timer tick, asking Buildbucket for the build status
[08:53:40.098] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[08:53:40.098] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:26:0) after 1m0s
[08:54:40.121] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:26:0)
[08:54:40.121] Timer tick, asking Buildbucket for the build status
[08:54:40.378] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[08:54:40.378] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:27:0) after 1m0s
[08:55:40.403] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:27:0)
[08:55:40.403] Timer tick, asking Buildbucket for the build status
[08:55:40.884] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[08:55:40.884] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:28:0) after 1m0s
[08:56:40.909] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:28:0)
[08:56:40.909] Timer tick, asking Buildbucket for the build status
[08:56:41.108] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[08:56:41.109] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:29:0) after 1m0s
[08:57:41.129] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:29:0)
[08:57:41.129] Timer tick, asking Buildbucket for the build status
[08:57:41.724] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[08:57:41.724] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:30:0) after 1m0s
[08:58:41.741] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:30:0)
[08:58:41.741] Timer tick, asking Buildbucket for the build status
[08:58:41.948] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[08:58:41.948] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:31:0) after 1m0s
[08:59:41.984] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:31:0)
[08:59:41.984] Timer tick, asking Buildbucket for the build status
[08:59:42.729] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[08:59:42.729] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:32:0) after 1m0s
[09:00:42.719] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:32:0)
[09:00:42.719] Timer tick, asking Buildbucket for the build status
[09:00:45.042] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:00:45.042] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:33:0) after 1m0s
[09:01:45.171] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:33:0)
[09:01:45.171] Timer tick, asking Buildbucket for the build status
[09:01:45.463] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:01:45.463] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:34:0) after 1m0s
[09:02:45.494] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:34:0)
[09:02:45.494] Timer tick, asking Buildbucket for the build status
[09:02:45.745] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:02:45.745] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:35:0) after 1m0s
[09:03:45.814] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:35:0)
[09:03:45.814] Timer tick, asking Buildbucket for the build status
[09:03:46.536] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:03:46.536] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:36:0) after 1m0s
[09:04:46.619] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:36:0)
[09:04:46.619] Timer tick, asking Buildbucket for the build status
[09:04:46.800] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:04:46.800] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:37:0) after 1m0s
[09:05:46.896] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:37:0)
[09:05:46.896] Timer tick, asking Buildbucket for the build status
[09:05:47.152] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:05:47.152] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:38:0) after 1m0s
[09:06:47.243] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:38:0)
[09:06:47.243] Timer tick, asking Buildbucket for the build status
[09:06:48.223] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:06:48.223] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:39:0) after 1m0s
[09:07:48.282] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:39:0)
[09:07:48.282] Timer tick, asking Buildbucket for the build status
[09:07:49.088] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:07:49.088] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:40:0) after 1m0s
[09:08:49.095] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:40:0)
[09:08:49.095] Timer tick, asking Buildbucket for the build status
[09:08:49.261] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:08:49.261] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:41:0) after 1m0s
[09:09:49.269] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:41:0)
[09:09:49.269] Timer tick, asking Buildbucket for the build status
[09:09:49.502] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:09:49.502] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:42:0) after 1m0s
[09:10:49.588] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:42:0)
[09:10:49.588] Timer tick, asking Buildbucket for the build status
[09:10:49.924] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:10:49.924] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:43:0) after 1m0s
[09:11:49.973] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:43:0)
[09:11:49.973] Timer tick, asking Buildbucket for the build status
[09:11:50.207] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:11:50.207] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:44:0) after 1m0s
[09:12:50.210] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:44:0)
[09:12:50.210] Timer tick, asking Buildbucket for the build status
[09:12:50.980] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:12:50.980] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:45:0) after 1m0s
[09:13:50.966] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:45:0)
[09:13:50.966] Timer tick, asking Buildbucket for the build status
[09:13:51.547] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:13:51.547] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:46:0) after 1m0s
[09:14:51.569] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:46:0)
[09:14:51.569] Timer tick, asking Buildbucket for the build status
[09:14:52.083] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:14:52.083] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:47:0) after 1m0s
[09:15:52.178] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:47:0)
[09:15:52.178] Timer tick, asking Buildbucket for the build status
[09:15:52.576] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:15:52.576] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:48:0) after 1m0s
[09:16:52.610] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:48:0)
[09:16:52.610] Timer tick, asking Buildbucket for the build status
[09:16:52.883] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:16:52.883] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:49:0) after 1m0s
[09:17:52.924] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:49:0)
[09:17:52.924] Timer tick, asking Buildbucket for the build status
[09:17:53.155] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:17:53.155] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:50:0) after 1m0s
[09:18:53.357] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:50:0)
[09:18:53.357] Timer tick, asking Buildbucket for the build status
[09:18:53.531] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:18:53.531] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:51:0) after 1m0s
[09:19:53.560] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:51:0)
[09:19:53.560] Timer tick, asking Buildbucket for the build status
[09:19:53.836] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:19:53.836] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:52:0) after 1m0s
[09:20:53.820] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:52:0)
[09:20:53.820] Timer tick, asking Buildbucket for the build status
[09:20:59.314] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:20:59.315] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:53:0) after 1m0s
[09:21:59.456] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:53:0)
[09:21:59.456] Timer tick, asking Buildbucket for the build status
[09:21:59.657] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:21:59.657] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:54:0) after 1m0s
[09:22:59.709] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:54:0)
[09:22:59.709] Timer tick, asking Buildbucket for the build status
[09:23:00.374] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:23:00.374] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:55:0) after 1m0s
[09:24:00.568] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:55:0)
[09:24:00.568] Timer tick, asking Buildbucket for the build status
[09:24:01.164] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:24:01.164] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:56:0) after 1m0s
[09:25:01.253] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:56:0)
[09:25:01.253] Timer tick, asking Buildbucket for the build status
[09:25:02.012] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:25:02.012] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:57:0) after 1m0s
[09:26:02.049] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:57:0)
[09:26:02.049] Timer tick, asking Buildbucket for the build status
[09:26:03.023] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:26:03.023] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:58:0) after 1m0s
[09:27:03.079] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:58:0)
[09:27:03.079] Timer tick, asking Buildbucket for the build status
[09:27:03.356] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:27:03.357] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:59:0) after 1m0s
[09:28:03.367] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:59:0)
[09:28:03.367] Timer tick, asking Buildbucket for the build status
[09:28:03.668] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:28:03.668] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:60:0) after 1m0s
[09:29:03.776] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:60:0)
[09:29:03.776] Timer tick, asking Buildbucket for the build status
[09:29:04.298] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:29:04.298] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:61:0) after 1m0s
[09:30:04.324] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:61:0)
[09:30:04.324] Timer tick, asking Buildbucket for the build status
[09:30:04.609] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:30:04.609] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:62:0) after 1m0s
[09:31:04.698] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:62:0)
[09:31:04.698] Timer tick, asking Buildbucket for the build status
[09:31:04.929] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:31:04.929] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:63:0) after 1m0s
[09:32:04.931] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:63:0)
[09:32:04.931] Timer tick, asking Buildbucket for the build status
[09:32:05.282] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:32:05.283] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:64:0) after 1m0s
[09:33:05.342] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:64:0)
[09:33:05.342] Timer tick, asking Buildbucket for the build status
[09:33:05.490] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:33:05.490] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:65:0) after 1m0s
[09:34:05.543] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:65:0)
[09:34:05.543] Timer tick, asking Buildbucket for the build status
[09:34:06.105] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:34:06.105] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:66:0) after 1m0s
[09:35:06.308] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:66:0)
[09:35:06.308] Timer tick, asking Buildbucket for the build status
[09:35:06.519] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:35:06.519] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:67:0) after 1m0s
[09:36:07.038] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:67:0)
[09:36:07.038] Timer tick, asking Buildbucket for the build status
[09:36:07.510] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:36:07.510] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:68:0) after 1m0s
[09:37:07.674] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:68:0)
[09:37:07.674] Timer tick, asking Buildbucket for the build status
[09:37:07.834] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:37:07.834] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:69:0) after 1m0s
[09:38:07.958] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:69:0)
[09:38:07.958] Timer tick, asking Buildbucket for the build status
[09:38:09.072] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:38:09.072] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:70:0) after 1m0s
[09:39:09.259] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:70:0)
[09:39:09.259] Timer tick, asking Buildbucket for the build status
[09:39:10.167] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:39:10.167] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:71:0) after 1m0s
[09:40:10.226] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:71:0)
[09:40:10.226] Timer tick, asking Buildbucket for the build status
[09:40:10.714] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:40:10.714] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:72:0) after 1m0s
[09:41:10.903] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:72:0)
[09:41:10.903] Timer tick, asking Buildbucket for the build status
[09:41:11.557] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:41:11.557] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:73:0) after 1m0s
[09:42:11.587] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:73:0)
[09:42:11.587] Timer tick, asking Buildbucket for the build status
[09:42:11.780] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:42:11.780] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:74:0) after 1m0s
[09:43:12.029] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:74:0)
[09:43:12.029] Timer tick, asking Buildbucket for the build status
[09:43:12.483] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:43:12.483] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:75:0) after 1m0s
[09:44:12.800] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:75:0)
[09:44:12.800] Timer tick, asking Buildbucket for the build status
[09:44:13.075] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:44:13.075] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:76:0) after 1m0s
[09:45:13.149] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:76:0)
[09:45:13.149] Timer tick, asking Buildbucket for the build status
[09:45:13.591] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:45:13.591] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:77:0) after 1m0s
[09:46:13.612] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:77:0)
[09:46:13.612] Timer tick, asking Buildbucket for the build status
[09:46:13.872] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:46:13.872] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:78:0) after 1m0s
[09:47:13.953] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:78:0)
[09:47:13.953] Timer tick, asking Buildbucket for the build status
[09:47:14.152] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:47:14.152] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:79:0) after 1m0s
[09:48:14.173] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:79:0)
[09:48:14.173] Timer tick, asking Buildbucket for the build status
[09:48:15.927] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:48:15.927] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:80:0) after 1m0s
[09:49:15.966] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:80:0)
[09:49:15.966] Timer tick, asking Buildbucket for the build status
[09:49:16.102] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:49:16.102] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:81:0) after 1m0s
[09:50:16.194] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:81:0)
[09:50:16.194] Timer tick, asking Buildbucket for the build status
[09:50:16.394] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:50:16.394] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:82:0) after 1m0s
[09:51:16.450] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:82:0)
[09:51:16.450] Timer tick, asking Buildbucket for the build status
[09:51:16.737] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:51:16.737] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:83:0) after 1m0s
[09:52:16.825] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:83:0)
[09:52:16.825] Timer tick, asking Buildbucket for the build status
[09:52:17.112] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:52:17.112] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:84:0) after 1m0s
[09:53:17.207] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:84:0)
[09:53:17.207] Timer tick, asking Buildbucket for the build status
[09:53:17.410] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:53:17.410] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:85:0) after 1m0s
[09:54:17.427] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:85:0)
[09:54:17.427] Timer tick, asking Buildbucket for the build status
[09:54:17.606] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:54:17.607] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:86:0) after 1m0s
[09:55:17.730] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:86:0)
[09:55:17.730] Timer tick, asking Buildbucket for the build status
[09:55:17.933] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:55:17.933] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:87:0) after 1m0s
[09:56:17.952] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:87:0)
[09:56:17.952] Timer tick, asking Buildbucket for the build status
[09:56:18.347] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:56:18.348] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:88:0) after 1m0s
[09:57:18.440] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:88:0)
[09:57:18.440] Timer tick, asking Buildbucket for the build status
[09:57:18.903] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:57:18.903] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:89:0) after 1m0s
[09:58:18.960] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:89:0)
[09:58:18.960] Timer tick, asking Buildbucket for the build status
[09:58:19.202] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:58:19.202] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:90:0) after 1m0s
[09:59:19.229] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:90:0)
[09:59:19.229] Timer tick, asking Buildbucket for the build status
[09:59:19.380] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:59:19.380] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:91:0) after 1m0s
[10:00:19.407] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:91:0)
[10:00:19.407] Timer tick, asking Buildbucket for the build status
[10:00:19.572] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:00:19.572] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:92:0) after 1m0s
[10:01:19.607] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:92:0)
[10:01:19.607] Timer tick, asking Buildbucket for the build status
[10:01:20.058] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:01:20.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:93:0) after 1m0s
[10:02:20.128] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:93:0)
[10:02:20.128] Timer tick, asking Buildbucket for the build status
[10:02:20.864] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:02:20.864] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:94:0) after 1m0s
[10:03:21.012] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:94:0)
[10:03:21.012] Timer tick, asking Buildbucket for the build status
[10:03:21.708] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:03:21.708] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:95:0) after 1m0s
[10:04:21.757] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:95:0)
[10:04:21.757] Timer tick, asking Buildbucket for the build status
[10:04:21.940] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:04:21.940] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:96:0) after 1m0s
[10:05:21.963] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:96:0)
[10:05:21.963] Timer tick, asking Buildbucket for the build status
[10:05:22.167] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:05:22.167] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:97:0) after 1m0s
[10:06:22.291] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:97:0)
[10:06:22.291] Timer tick, asking Buildbucket for the build status
[10:06:22.444] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:06:22.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:98:0) after 1m0s
[10:07:22.513] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:98:0)
[10:07:22.513] Timer tick, asking Buildbucket for the build status
[10:07:22.724] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:07:22.724] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:99:0) after 1m0s
[10:08:22.814] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:99:0)
[10:08:22.814] Timer tick, asking Buildbucket for the build status
[10:08:23.153] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:08:23.153] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:100:0) after 1m0s
[10:09:23.290] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:100:0)
[10:09:23.290] Timer tick, asking Buildbucket for the build status
[10:09:23.870] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:09:23.870] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:101:0) after 1m0s
[10:10:23.954] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:101:0)
[10:10:23.954] Timer tick, asking Buildbucket for the build status
[10:10:24.479] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:10:24.479] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:102:0) after 1m0s
[10:11:24.552] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:102:0)
[10:11:24.552] Timer tick, asking Buildbucket for the build status
[10:11:25.014] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:11:25.014] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:103:0) after 1m0s
[10:12:25.108] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:103:0)
[10:12:25.108] Timer tick, asking Buildbucket for the build status
[10:12:25.375] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:12:25.375] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:104:0) after 1m0s
[10:13:25.388] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:104:0)
[10:13:25.388] Timer tick, asking Buildbucket for the build status
[10:13:25.609] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:13:25.609] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:105:0) after 1m0s
[10:14:25.706] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:105:0)
[10:14:25.706] Timer tick, asking Buildbucket for the build status
[10:14:25.878] Build 8890033684269914560: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:14:25.878] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9055463746362498336:106:0) after 1m0s
[10:15:17.024] Received PubSub notification, asking Buildbucket for the build status
[10:15:17.313] Build 8890033684269914560: status "COMPLETED", result "FAILURE", failure_reason "INFRA_FAILURE", cancelation_reason ""
[10:15:17.313] Buildbucket build:
{
  "build": {
    "bucket": "luci.chromium.ci",
    "canary_preference": "PROD",
    "completed_ts": "1580206516588169",
    "created_by": "project:chromium",
    "created_ts": "1580200225533760",
    "failure_reason": "INFRA_FAILURE",
    "id": "8890033684269914560",
    "parameters_json": "{\"builder_name\": \"ToTiOSDevice\", \"properties\": {\"branch\": \"refs/heads/master\", \"repository\": \"https://chromium.googlesource.com/chromium/src\", \"revision\": \"fa583a883d0b97b1d2503e4e7dd294c04930cb2d\"}}",
    "project": "chromium",
    "result": "FAILURE",
    "result_details_json": "{\"error\": {\"message\": \"recipe infra failure: Failed base_unittests (iPhone 6s iOS 12.3.1), base_unittests (iPhone 6s iOS 12.3.1), boringssl_crypto_tests (iPhone 6s iOS 12.3.1), boringssl_crypto_tests (iPhone 6s iOS 12.3.1), boringssl_ssl_tests (iPhone 6s iOS 12.3.1), boringssl_ssl_tests (iPhone 6s iOS 12.3.1), components_unittests (iPhone 6s iOS 12.3.1), components_unittests (iPhone 6s iOS 12.3.1), crypto_unittests (iPhone 6s iOS 12.3.1), crypto_unittests (iPhone 6s iOS 12.3.1), gfx_unittests (iPhone 6s iOS 12.3.1), gfx_unittests (iPhone 6s iOS 12.3.1), google_apis_unittests (iPhone 6s iOS 12.3.1), google_apis_unittests (iPhone 6s iOS 12.3.1), ios_chrome_unittests (iPhone 6s iOS 12.3.1), ios_chrome_unittests (iPhone 6s iOS 12.3.1), ios_net_unittests (iPhone 6s iOS 12.3.1), ios_net_unittests (iPhone 6s iOS 12.3.1), ios_web_inttests (iPhone 6s iOS 12.3.1), ios_web_inttests (iPhone 6s iOS 12.3.1), ios_web_unittests (iPhone 6s iOS 12.3.1), ios_web_unittests (iPhone 6s iOS 12.3.1), ios_web_view_inttests (iPhone 6s iOS 12.3.1), ios_web_view_inttests (iPhone 6s iOS 12.3.1), net_unittests (iPhone 6s iOS 12.3.1), net_unittests (iPhone 6s iOS 12.3.1), skia_unittests (iPhone 6s iOS 12.3.1), skia_unittests (iPhone 6s iOS 12.3.1), sql_unittests (iPhone 6s iOS 12.3.1), sql_unittests (iPhone 6s iOS 12.3.1), ui_base_unittests (iPhone 6s iOS 12.3.1), ui_base_unittests (iPhone 6s iOS 12.3.1), url_unittests (iPhone 6s iOS 12.3.1), url_unittests (iPhone 6s iOS 12.3.1).\"}, \"properties\": {\"$recipe_engine/path\": {\"cache_dir\": \"/b/s/w/ir/cache\", \"temp_dir\": \"/b/s/w/ir/tmp/rt\"}, \"$recipe_engine/runtime\": {\"is_experimental\": false, \"is_luci\": true}, \"bot_id\": \"build284-m9\", \"branch\": \"refs/heads/master\", \"buildername\": \"ToTiOSDevice\", \"buildnumber\": 16191, \"got_angle_revision\": \"086aded3cb743b2fc405d8a11b12d7fc132ec181\", \"got_dawn_revision\": \"f329c78b6cb0918e4aeafc9bebdf27173aa710a7\", \"got_nacl_revision\": \"3651f6c52037c96e034cc422746768d59182bff3\", \"got_revision\": \"fa583a883d0b97b1d2503e4e7dd294c04930cb2d\", \"got_revision_cp\": \"refs/heads/master@{#735783}\", \"got_swarming_client_revision\": \"885b3febcc170a60f25795304e60927b77d1e92d\", \"got_swiftshader_revision\": \"34e16df059f8c69f0409e167b4d2e7ef59bf7b55\", \"got_v8_revision\": \"5461451d0802a553ef74684bff602434668cb951\", \"got_v8_revision_cp\": \"refs/heads/8.1.290@{#1}\", \"got_webrtc_revision\": \"8a6f9a03f0207ea8293dc1f13c478b57ba5a5df0\", \"got_webrtc_revision_cp\": \"refs/heads/master@{#30387}\", \"isolate_server\": \"https://isolateserver.appspot.com\", \"mastername\": \"chromium.clang\", \"path_config\": \"generic\", \"perf_dashboard_machine_group\": \"ChromiumClang\", \"recipe\": \"ios/unified_builder_tester\", \"repository\": \"https://chromium.googlesource.com/chromium/src\", \"revision\": \"fa583a883d0b97b1d2503e4e7dd294c04930cb2d\", \"swarm_hashes\": {\"0\": \"87da70d4da92df42122e8f59bcee351246bb3a3e\", \"1\": \"aff08d6f8ea45d8b62887ae201984fea524046b0\", \"10\": \"0c4ef5e43d335040a984beaa94cc060acc332235\", \"11\": \"0821400619ebfaaec9066bada1f64766e324e3c5\", \"12\": \"d5827cdc13e1ff38ec1090aab9ebcfc053a58424\", \"13\": \"4b933ad8408ce67f6d9aebdb710aa543e8723ad6\", \"14\": \"8ecd018d1904f4208bad8cf404ed18f3a970f6b2\", \"15\": \"95fd144328ac4b8ca5e2b88a056c899cdbcb5f91\", \"16\": \"126b61d91fc21ee04d71b84465014627883c919b\", \"2\": \"0dbd077e58d52d2b0f4be696ce65997bc19aff13\", \"3\": \"66accf4ef94f2a9aff756d0857b7028774c0911e\", \"4\": \"233218d3514ea0a872ce8902a39e32931eecfdb5\", \"5\": \"4c9a49da49d794fab70535758fbeaa761f6400a7\", \"6\": \"a846fcdbf8f09a033e1442392101458ee2f27eac\", \"7\": \"eb74f660532e80cf052b199e94a760ce6265b3f5\", \"8\": \"ffd9af26f8d2e10a1f67966e6b264341f9284fba\", \"9\": \"0fb4484ff339c1624db9c25d7175d464356874d5\"}}, \"swarming\": {\"bot_dimensions\": {\"builderless\": [\"1\"], \"caches\": [\"builder_69caa34b8f39daac28a821cac2619730401d46a6479812cc34796e3bf180418a_v2\", \"builder_ae5debd901c74ee0906916cb62621bceb2a8b657b42c2e2e9e89a0f6a2e5e53b_v2\", \"git\", \"vpython\", \"xcode_ios_11a1027\"], \"cores\": [\"24\"], \"cpu\": [\"x86\", \"x86-64\", \"x86-64-E5-2697_v2\"], \"gce\": [\"0\"], \"gpu\": [\"1002\", \"1002:679e\", \"1002:679e-4.0.11-3.2.8\"], \"hidpi\": [\"0\"], \"id\": [\"build284-m9\"], \"mac_model\": [\"MacPro6,1\"], \"machine_type\": [\"n1-standard-16\"], \"os\": [\"Mac\", \"Mac-10.14\", \"Mac-10.14.6\"], \"pool\": [\"luci.chromium.ci\"], \"python\": [\"2.7.10\"], \"server_version\": [\"4801-8ac0b59\"], \"ssd\": [\"1\"], \"zone\": [\"us\", \"us-atl\", \"us-atl-golo\", \"us-atl-golo-m9\"]}}, \"ui\": {\"info\": \"recipe infra failure: Failed base_unittests (iPhone 6s iOS 12.3.1), base_unittests (iPhone 6s iOS 12.3.1), boringssl_crypto_tests (iPhone 6s iOS 12.3.1), boringssl_crypto_tests (iPhone 6s iOS 12.3.1), boringssl_ssl_tests (iPhone 6s iOS 12.3.1), boringssl_ssl_tests (iPhone 6s iOS 12.3.1), components_unittests (iPhone 6s iOS 12.3.1), components_unittests (iPhone 6s iOS 12.3.1), crypto_unittests (iPhone 6s iOS 12.3.1), crypto_unittests (iPhone 6s iOS 12.3.1), gfx_unittests (iPhone 6s iOS 12.3.1), gfx_unittests (iPhone 6s iOS 12.3.1), google_apis_unittests (iPhone 6s iOS 12.3.1), google_apis_unittests (iPhone 6s iOS 12.3.1), ios_chrome_unittests (iPhone 6s iOS 12.3.1), ios_chrome_unittests (iPhone 6s iOS 12.3.1), ios_net_unittests (iPhone 6s iOS 12.3.1), ios_net_unittests (iPhone 6s iOS 12.3.1), ios_web_inttests (iPhone 6s iOS 12.3.1), ios_web_inttests (iPhone 6s iOS 12.3.1), ios_web_unittests (iPhone 6s iOS 12.3.1), ios_web_unittests (iPhone 6s iOS 12.3.1), ios_web_view_inttests (iPhone 6s iOS 12.3.1), ios_web_view_inttests (iPhone 6s iOS 12.3.1), net_unittests (iPhone 6s iOS 12.3.1), net_unittests (iPhone 6s iOS 12.3.1), skia_unittests (iPhone 6s iOS 12.3.1), skia_unittests (iPhone 6s iOS 12.3.1), sql_unittests (iPhone 6s iOS 12.3.1), sql_unittests (iPhone 6s iOS 12.3.1), ui_base_unittests (iPhone 6s iOS 12.3.1), ui_base_unittests (iPhone 6s iOS 12.3.1), url_unittests (iPhone 6s iOS 12.3.1), url_unittests (iPhone 6s iOS 12.3.1).\"}}",
    "service_account": "chromium-ci-builder@chops-service-accounts.iam.gserviceaccount.com",
    "started_ts": "1580200393506485",
    "status": "COMPLETED",
    "status_changed_ts": "1580200394326634",
    "tags": [
      "build_address:luci.chromium.ci/ToTiOSDevice/16191",
      "builder:ToTiOSDevice",
      "buildset:commit/git/fa583a883d0b97b1d2503e4e7dd294c04930cb2d",
      "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/fa583a883d0b97b1d2503e4e7dd294c04930cb2d",
      "gitiles_ref:refs/heads/master",
      "scheduler_invocation_id:9055463746362498336",
      "scheduler_job_id:chromium/ToTiOSDevice",
      "swarming_hostname:chromium-swarm.appspot.com",
      "swarming_tag:log_location:logdog://logs.chromium.org/chromium/buildbucket/cr-buildbucket.appspot.com/8890033684269914560/+/annotations",
      "swarming_tag:luci_project:chromium",
      "swarming_tag:os:Mac",
      "swarming_tag:recipe_name:ios/unified_builder_tester",
      "swarming_tag:recipe_package:infra/recipe_bundles/chromium.googlesource.com/chromium/tools/build",
      "swarming_task_id:4a0417792f7d9810",
      "user_agent:luci-scheduler"
    ],
    "updated_ts": "1580206516753993",
    "url": "https://ci.chromium.org/b/8890033684269914560",
    "utcnow_ts": "1580206517301500"
  }
}
[10:15:17.314] Invocation finished in 1h44m53.159550572s with status FAILED