Status: FAILED
Triggered by: -
Duration: 2 hours
Actions:

Definition (rev ead1c24e5b0e6b883f7d7e816b15c81777fef6bb)

buildbucket: <
  server: "cr-buildbucket.appspot.com"
  bucket: "luci.chromium.ci"
  builder: "ToTMacASan"
>

Incoming triggers

Incoming properties

{
  "branch": "refs/heads/master",
  "repository": "https://chromium.googlesource.com/chromium/src",
  "revision": "18d420be1c28a99064aafb7740789d3fa29bcaa8"
}

Incoming tags

  • buildset:commit/git/18d420be1c28a99064aafb7740789d3fa29bcaa8
  • buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/18d420be1c28a99064aafb7740789d3fa29bcaa8
  • gitiles_ref:refs/heads/master

Debug log (UTC)

[19:13:44.439] New invocation is queued and will start shortly
[19:13:45.475] Starting the invocation (attempt 1)
[19:13:45.515] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[19:13:45.515] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[19:13:45.515] Buildbucket request:
{
  "bucket": "luci.chromium.ci",
  "client_operation_id": "9054154913571271184",
  "parameters_json": "{\"builder_name\":\"ToTMacASan\",\"properties\":{\"branch\":\"refs/heads/master\",\"repository\":\"https://chromium.googlesource.com/chromium/src\",\"revision\":\"18d420be1c28a99064aafb7740789d3fa29bcaa8\"}}",
  "pubsub_callback": {
    "auth_token": "...",
    "topic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
  },
  "tags": [
    "builder:ToTMacASan",
    "scheduler_invocation_id:9054154913571271184",
    "scheduler_job_id:chromium/ToTMacASan",
    "user_agent:luci-scheduler",
    "buildset:commit/git/18d420be1c28a99064aafb7740789d3fa29bcaa8",
    "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/18d420be1c28a99064aafb7740789d3fa29bcaa8",
    "gitiles_ref:refs/heads/master"
  ]
}
[19:13:46.258] Buildbucket response:
{
  "build": {
    "bucket": "luci.chromium.ci",
    "canary_preference": "PROD",
    "created_by": "project:chromium",
    "created_ts": "1581448425678335",
    "id": "8888724851554623856",
    "parameters_json": "{\"builder_name\": \"ToTMacASan\", \"properties\": {\"branch\": \"refs/heads/master\", \"repository\": \"https://chromium.googlesource.com/chromium/src\", \"revision\": \"18d420be1c28a99064aafb7740789d3fa29bcaa8\"}}",
    "project": "chromium",
    "result_details_json": "{\"properties\": {}}",
    "service_account": "chromium-ci-builder@chops-service-accounts.iam.gserviceaccount.com",
    "status": "SCHEDULED",
    "status_changed_ts": "1581448426069303",
    "tags": [
      "build_address:luci.chromium.ci/ToTMacASan/22350",
      "builder:ToTMacASan",
      "buildset:commit/git/18d420be1c28a99064aafb7740789d3fa29bcaa8",
      "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/18d420be1c28a99064aafb7740789d3fa29bcaa8",
      "gitiles_ref:refs/heads/master",
      "scheduler_invocation_id:9054154913571271184",
      "scheduler_job_id:chromium/ToTMacASan",
      "swarming_hostname:chromium-swarm.appspot.com",
      "swarming_tag:log_location:logdog://logs.chromium.org/chromium/buildbucket/cr-buildbucket.appspot.com/8888724851554623856/+/annotations",
      "swarming_tag:luci_project:chromium",
      "swarming_tag:recipe_name:chromium",
      "swarming_tag:recipe_package:infra/recipe_bundles/chromium.googlesource.com/chromium/tools/build",
      "swarming_task_id:",
      "user_agent:luci-scheduler"
    ],
    "updated_ts": "1581448426069467",
    "url": "https://ci.chromium.org/b/8888724851554623856",
    "utcnow_ts": "1581448426244974"
  }
}
[19:13:46.258] Task URL: https://ci.chromium.org/b/8888724851554623856
[19:13:46.258] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:2:0) after 1m0s
[19:14:46.390] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:2:0)
[19:14:46.390] Timer tick, asking Buildbucket for the build status
[19:14:46.610] Build 8888724851554623856: status "SCHEDULED", result "", failure_reason "", cancelation_reason ""
[19:14:46.610] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:3:0) after 1m0s
[19:15:46.733] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:3:0)
[19:15:46.733] Timer tick, asking Buildbucket for the build status
[19:15:47.035] Build 8888724851554623856: status "SCHEDULED", result "", failure_reason "", cancelation_reason ""
[19:15:47.035] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:4:0) after 1m0s
[19:16:47.105] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:4:0)
[19:16:47.105] Timer tick, asking Buildbucket for the build status
[19:16:47.684] Build 8888724851554623856: status "SCHEDULED", result "", failure_reason "", cancelation_reason ""
[19:16:47.684] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:5:0) after 1m0s
[19:17:45.628] Received PubSub notification, asking Buildbucket for the build status
[19:17:46.683] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[19:17:47.768] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:5:0)
[19:17:47.768] Timer tick, asking Buildbucket for the build status
[19:17:47.990] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[19:17:47.990] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:7:0) after 1m0s
[19:18:48.023] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:7:0)
[19:18:48.023] Timer tick, asking Buildbucket for the build status
[19:18:48.203] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[19:18:48.203] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:8:0) after 1m0s
[19:19:48.246] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:8:0)
[19:19:48.246] Timer tick, asking Buildbucket for the build status
[19:19:49.362] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[19:19:49.362] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:9:0) after 1m0s
[19:20:49.393] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:9:0)
[19:20:49.393] Timer tick, asking Buildbucket for the build status
[19:20:49.875] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[19:20:49.875] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:10:0) after 1m0s
[19:21:49.946] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:10:0)
[19:21:49.946] Timer tick, asking Buildbucket for the build status
[19:21:50.240] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[19:21:50.240] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:11:0) after 1m0s
[19:22:50.388] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:11:0)
[19:22:50.388] Timer tick, asking Buildbucket for the build status
[19:22:51.139] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[19:22:51.139] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:12:0) after 1m0s
[19:23:51.227] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:12:0)
[19:23:51.227] Timer tick, asking Buildbucket for the build status
[19:23:51.416] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[19:23:51.416] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:13:0) after 1m0s
[19:24:51.440] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:13:0)
[19:24:51.440] Timer tick, asking Buildbucket for the build status
[19:24:52.179] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[19:24:52.179] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:14:0) after 1m0s
[19:25:52.213] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:14:0)
[19:25:52.213] Timer tick, asking Buildbucket for the build status
[19:25:53.253] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[19:25:53.253] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:15:0) after 1m0s
[19:26:53.324] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:15:0)
[19:26:53.324] Timer tick, asking Buildbucket for the build status
[19:26:53.483] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[19:26:53.483] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:16:0) after 1m0s
[19:27:53.521] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:16:0)
[19:27:53.521] Timer tick, asking Buildbucket for the build status
[19:27:53.730] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[19:27:53.730] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:17:0) after 1m0s
[19:28:53.805] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:17:0)
[19:28:53.805] Timer tick, asking Buildbucket for the build status
[19:28:53.989] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[19:28:53.989] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:18:0) after 1m0s
[19:29:54.064] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:18:0)
[19:29:54.064] Timer tick, asking Buildbucket for the build status
[19:29:54.607] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[19:29:54.607] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:19:0) after 1m0s
[19:30:54.695] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:19:0)
[19:30:54.695] Timer tick, asking Buildbucket for the build status
[19:30:54.838] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[19:30:54.838] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:20:0) after 1m0s
[19:31:54.860] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:20:0)
[19:31:54.860] Timer tick, asking Buildbucket for the build status
[19:31:55.254] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[19:31:55.254] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:21:0) after 1m0s
[19:32:55.303] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:21:0)
[19:32:55.303] Timer tick, asking Buildbucket for the build status
[19:32:56.301] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[19:32:56.301] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:22:0) after 1m0s
[19:33:56.385] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:22:0)
[19:33:56.385] Timer tick, asking Buildbucket for the build status
[19:33:57.287] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[19:33:57.287] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:23:0) after 1m0s
[19:34:57.401] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:23:0)
[19:34:57.401] Timer tick, asking Buildbucket for the build status
[19:34:57.589] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[19:34:57.589] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:24:0) after 1m0s
[19:35:57.619] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:24:0)
[19:35:57.620] Timer tick, asking Buildbucket for the build status
[19:35:57.791] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[19:35:57.791] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:25:0) after 1m0s
[19:36:57.984] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:25:0)
[19:36:57.984] Timer tick, asking Buildbucket for the build status
[19:36:58.450] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[19:36:58.450] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:26:0) after 1m0s
[19:37:58.537] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:26:0)
[19:37:58.537] Timer tick, asking Buildbucket for the build status
[19:37:59.294] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[19:37:59.294] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:27:0) after 1m0s
[19:38:59.349] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:27:0)
[19:38:59.349] Timer tick, asking Buildbucket for the build status
[19:38:59.471] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[19:38:59.471] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:28:0) after 1m0s
[19:39:59.572] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:28:0)
[19:39:59.572] Timer tick, asking Buildbucket for the build status
[19:39:59.743] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[19:39:59.743] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:29:0) after 1m0s
[19:40:59.774] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:29:0)
[19:40:59.774] Timer tick, asking Buildbucket for the build status
[19:40:59.987] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[19:40:59.987] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:30:0) after 1m0s
[19:42:00.143] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:30:0)
[19:42:00.143] Timer tick, asking Buildbucket for the build status
[19:42:00.484] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[19:42:00.484] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:31:0) after 1m0s
[19:43:00.567] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:31:0)
[19:43:00.567] Timer tick, asking Buildbucket for the build status
[19:43:01.095] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[19:43:01.095] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:32:0) after 1m0s
[19:44:01.118] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:32:0)
[19:44:01.118] Timer tick, asking Buildbucket for the build status
[19:44:01.246] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[19:44:01.246] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:33:0) after 1m0s
[19:45:01.293] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:33:0)
[19:45:01.293] Timer tick, asking Buildbucket for the build status
[19:45:01.870] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[19:45:01.870] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:34:0) after 1m0s
[19:46:01.887] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:34:0)
[19:46:01.887] Timer tick, asking Buildbucket for the build status
[19:46:02.083] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[19:46:02.083] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:35:0) after 1m0s
[19:47:02.070] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:35:0)
[19:47:02.070] Timer tick, asking Buildbucket for the build status
[19:47:02.204] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[19:47:02.204] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:36:0) after 1m0s
[19:48:02.276] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:36:0)
[19:48:02.276] Timer tick, asking Buildbucket for the build status
[19:48:02.446] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[19:48:02.446] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:37:0) after 1m0s
[19:49:02.480] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:37:0)
[19:49:02.480] Timer tick, asking Buildbucket for the build status
[19:49:02.815] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[19:49:02.815] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:38:0) after 1m0s
[19:50:02.926] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:38:0)
[19:50:02.926] Timer tick, asking Buildbucket for the build status
[19:50:03.491] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[19:50:03.491] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:39:0) after 1m0s
[19:51:03.526] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:39:0)
[19:51:03.527] Timer tick, asking Buildbucket for the build status
[19:51:03.679] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[19:51:03.679] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:40:0) after 1m0s
[19:52:03.818] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:40:0)
[19:52:03.818] Timer tick, asking Buildbucket for the build status
[19:52:03.999] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[19:52:03.999] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:41:0) after 1m0s
[19:53:04.093] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:41:0)
[19:53:04.093] Timer tick, asking Buildbucket for the build status
[19:53:04.896] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[19:53:04.896] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:42:0) after 1m0s
[19:54:05.003] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:42:0)
[19:54:05.003] Timer tick, asking Buildbucket for the build status
[19:54:05.391] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[19:54:05.391] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:43:0) after 1m0s
[19:55:05.449] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:43:0)
[19:55:05.449] Timer tick, asking Buildbucket for the build status
[19:55:06.315] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[19:55:06.315] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:44:0) after 1m0s
[19:56:06.451] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:44:0)
[19:56:06.451] Timer tick, asking Buildbucket for the build status
[19:56:06.928] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[19:56:06.928] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:45:0) after 1m0s
[19:57:07.089] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:45:0)
[19:57:07.089] Timer tick, asking Buildbucket for the build status
[19:57:07.328] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[19:57:07.328] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:46:0) after 1m0s
[19:58:07.463] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:46:0)
[19:58:07.463] Timer tick, asking Buildbucket for the build status
[19:58:07.626] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[19:58:07.626] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:47:0) after 1m0s
[19:59:07.659] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:47:0)
[19:59:07.659] Timer tick, asking Buildbucket for the build status
[19:59:08.169] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[19:59:08.169] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:48:0) after 1m0s
[20:00:08.332] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:48:0)
[20:00:08.332] Timer tick, asking Buildbucket for the build status
[20:00:08.489] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[20:00:08.489] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:49:0) after 1m0s
[20:01:08.614] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:49:0)
[20:01:08.614] Timer tick, asking Buildbucket for the build status
[20:01:08.836] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[20:01:08.836] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:50:0) after 1m0s
[20:02:08.858] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:50:0)
[20:02:08.858] Timer tick, asking Buildbucket for the build status
[20:02:08.994] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[20:02:08.994] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:51:0) after 1m0s
[20:03:09.015] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:51:0)
[20:03:09.015] Timer tick, asking Buildbucket for the build status
[20:03:09.334] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[20:03:09.335] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:52:0) after 1m0s
[20:04:09.440] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:52:0)
[20:04:09.440] Timer tick, asking Buildbucket for the build status
[20:04:09.592] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[20:04:09.592] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:53:0) after 1m0s
[20:05:09.684] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:53:0)
[20:05:09.684] Timer tick, asking Buildbucket for the build status
[20:05:10.162] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[20:05:10.162] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:54:0) after 1m0s
[20:06:10.225] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:54:0)
[20:06:10.225] Timer tick, asking Buildbucket for the build status
[20:06:10.355] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[20:06:10.355] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:55:0) after 1m0s
[20:07:10.407] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:55:0)
[20:07:10.407] Timer tick, asking Buildbucket for the build status
[20:07:10.581] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[20:07:10.581] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:56:0) after 1m0s
[20:08:10.652] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:56:0)
[20:08:10.652] Timer tick, asking Buildbucket for the build status
[20:08:10.862] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[20:08:10.862] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:57:0) after 1m0s
[20:09:10.889] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:57:0)
[20:09:10.889] Timer tick, asking Buildbucket for the build status
[20:09:11.074] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[20:09:11.074] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:58:0) after 1m0s
[20:10:11.202] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:58:0)
[20:10:11.202] Timer tick, asking Buildbucket for the build status
[20:10:11.401] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[20:10:11.401] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:59:0) after 1m0s
[20:11:11.461] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:59:0)
[20:11:11.461] Timer tick, asking Buildbucket for the build status
[20:11:11.662] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[20:11:11.662] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:60:0) after 1m0s
[20:12:11.702] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:60:0)
[20:12:11.702] Timer tick, asking Buildbucket for the build status
[20:12:12.300] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[20:12:12.300] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:61:0) after 1m0s
[20:13:12.356] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:61:0)
[20:13:12.356] Timer tick, asking Buildbucket for the build status
[20:13:12.680] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[20:13:12.680] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:62:0) after 1m0s
[20:14:13.154] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:62:0)
[20:14:13.154] Timer tick, asking Buildbucket for the build status
[20:14:13.303] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[20:14:13.303] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:63:0) after 1m0s
[20:15:13.578] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:63:0)
[20:15:13.578] Timer tick, asking Buildbucket for the build status
[20:15:13.868] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[20:15:13.868] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:64:0) after 1m0s
[20:16:14.152] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:64:0)
[20:16:14.152] Timer tick, asking Buildbucket for the build status
[20:16:14.374] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[20:16:14.374] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:65:0) after 1m0s
[20:17:14.667] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:65:0)
[20:17:14.667] Timer tick, asking Buildbucket for the build status
[20:17:15.600] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[20:17:15.600] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:66:0) after 1m0s
[20:18:15.699] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:66:0)
[20:18:15.699] Timer tick, asking Buildbucket for the build status
[20:18:15.991] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[20:18:15.991] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:67:0) after 1m0s
[20:19:16.012] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:67:0)
[20:19:16.012] Timer tick, asking Buildbucket for the build status
[20:19:16.143] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[20:19:16.143] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:68:0) after 1m0s
[20:20:16.199] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:68:0)
[20:20:16.199] Timer tick, asking Buildbucket for the build status
[20:20:16.367] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[20:20:16.367] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:69:0) after 1m0s
[20:21:16.630] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:69:0)
[20:21:16.630] Timer tick, asking Buildbucket for the build status
[20:21:16.877] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[20:21:16.877] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:70:0) after 1m0s
[20:22:16.927] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:70:0)
[20:22:16.927] Timer tick, asking Buildbucket for the build status
[20:22:17.947] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[20:22:17.947] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:71:0) after 1m0s
[20:23:18.043] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:71:0)
[20:23:18.043] Timer tick, asking Buildbucket for the build status
[20:23:18.300] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[20:23:18.300] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:72:0) after 1m0s
[20:24:18.372] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:72:0)
[20:24:18.372] Timer tick, asking Buildbucket for the build status
[20:24:18.793] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[20:24:18.793] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:73:0) after 1m0s
[20:25:18.902] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:73:0)
[20:25:18.902] Timer tick, asking Buildbucket for the build status
[20:25:19.156] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[20:25:19.156] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:74:0) after 1m0s
[20:26:19.254] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:74:0)
[20:26:19.254] Timer tick, asking Buildbucket for the build status
[20:26:19.700] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[20:26:19.700] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:75:0) after 1m0s
[20:27:19.749] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:75:0)
[20:27:19.749] Timer tick, asking Buildbucket for the build status
[20:27:19.933] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[20:27:19.933] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:76:0) after 1m0s
[20:28:19.957] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:76:0)
[20:28:19.957] Timer tick, asking Buildbucket for the build status
[20:28:20.202] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[20:28:20.202] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:77:0) after 1m0s
[20:29:20.224] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:77:0)
[20:29:20.224] Timer tick, asking Buildbucket for the build status
[20:29:20.385] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[20:29:20.385] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:78:0) after 1m0s
[20:30:20.423] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:78:0)
[20:30:20.423] Timer tick, asking Buildbucket for the build status
[20:30:21.062] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[20:30:21.062] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:79:0) after 1m0s
[20:31:21.089] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:79:0)
[20:31:21.089] Timer tick, asking Buildbucket for the build status
[20:31:21.243] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[20:31:21.243] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:80:0) after 1m0s
[20:32:21.269] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:80:0)
[20:32:21.269] Timer tick, asking Buildbucket for the build status
[20:32:21.416] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[20:32:21.416] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:81:0) after 1m0s
[20:33:21.429] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:81:0)
[20:33:21.429] Timer tick, asking Buildbucket for the build status
[20:33:21.569] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[20:33:21.569] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:82:0) after 1m0s
[20:34:21.704] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:82:0)
[20:34:21.704] Timer tick, asking Buildbucket for the build status
[20:34:22.740] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[20:34:22.740] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:83:0) after 1m0s
[20:35:22.798] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:83:0)
[20:35:22.798] Timer tick, asking Buildbucket for the build status
[20:35:22.949] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[20:35:22.949] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:84:0) after 1m0s
[20:36:23.007] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:84:0)
[20:36:23.007] Timer tick, asking Buildbucket for the build status
[20:36:23.541] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[20:36:23.541] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:85:0) after 1m0s
[20:37:23.573] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:85:0)
[20:37:23.573] Timer tick, asking Buildbucket for the build status
[20:37:24.199] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[20:37:24.199] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:86:0) after 1m0s
[20:38:24.272] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:86:0)
[20:38:24.272] Timer tick, asking Buildbucket for the build status
[20:38:24.600] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[20:38:24.600] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:87:0) after 1m0s
[20:39:24.699] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:87:0)
[20:39:24.699] Timer tick, asking Buildbucket for the build status
[20:39:25.632] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[20:39:25.632] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:88:0) after 1m0s
[20:40:25.667] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:88:0)
[20:40:25.667] Timer tick, asking Buildbucket for the build status
[20:40:25.802] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[20:40:25.802] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:89:0) after 1m0s
[20:41:25.806] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:89:0)
[20:41:25.806] Timer tick, asking Buildbucket for the build status
[20:41:25.959] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[20:41:25.959] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:90:0) after 1m0s
[20:42:26.026] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:90:0)
[20:42:26.026] Timer tick, asking Buildbucket for the build status
[20:42:26.175] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[20:42:26.175] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:91:0) after 1m0s
[20:43:26.183] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:91:0)
[20:43:26.183] Timer tick, asking Buildbucket for the build status
[20:43:26.787] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[20:43:26.787] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:92:0) after 1m0s
[20:44:26.809] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:92:0)
[20:44:26.809] Timer tick, asking Buildbucket for the build status
[20:44:27.039] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[20:44:27.039] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:93:0) after 1m0s
[20:45:27.038] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:93:0)
[20:45:27.038] Timer tick, asking Buildbucket for the build status
[20:45:28.049] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[20:45:28.049] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:94:0) after 1m0s
[20:46:28.079] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:94:0)
[20:46:28.079] Timer tick, asking Buildbucket for the build status
[20:46:28.281] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[20:46:28.281] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:95:0) after 1m0s
[20:47:28.353] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:95:0)
[20:47:28.353] Timer tick, asking Buildbucket for the build status
[20:47:29.325] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[20:47:29.325] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:96:0) after 1m0s
[20:48:29.394] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:96:0)
[20:48:29.394] Timer tick, asking Buildbucket for the build status
[20:48:29.565] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[20:48:29.565] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:97:0) after 1m0s
[20:49:29.667] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:97:0)
[20:49:29.667] Timer tick, asking Buildbucket for the build status
[20:49:29.824] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[20:49:29.824] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:98:0) after 1m0s
[20:50:29.881] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:98:0)
[20:50:29.881] Timer tick, asking Buildbucket for the build status
[20:50:30.043] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[20:50:30.043] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:99:0) after 1m0s
[20:51:30.195] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:99:0)
[20:51:30.195] Timer tick, asking Buildbucket for the build status
[20:51:31.907] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[20:51:31.907] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:100:0) after 1m0s
[20:52:32.037] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:100:0)
[20:52:32.037] Timer tick, asking Buildbucket for the build status
[20:52:32.706] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[20:52:32.706] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:101:0) after 1m0s
[20:53:32.815] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:101:0)
[20:53:32.815] Timer tick, asking Buildbucket for the build status
[20:53:33.057] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[20:53:33.057] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:102:0) after 1m0s
[20:54:33.148] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:102:0)
[20:54:33.148] Timer tick, asking Buildbucket for the build status
[20:54:33.634] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[20:54:33.634] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:103:0) after 1m0s
[20:55:33.667] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:103:0)
[20:55:33.667] Timer tick, asking Buildbucket for the build status
[20:55:33.841] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[20:55:33.841] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:104:0) after 1m0s
[20:56:33.888] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:104:0)
[20:56:33.888] Timer tick, asking Buildbucket for the build status
[20:56:36.104] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[20:56:36.104] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:105:0) after 1m0s
[20:57:36.151] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:105:0)
[20:57:36.152] Timer tick, asking Buildbucket for the build status
[20:57:36.275] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[20:57:36.275] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:106:0) after 1m0s
[20:58:36.293] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:106:0)
[20:58:36.293] Timer tick, asking Buildbucket for the build status
[20:58:36.444] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[20:58:36.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:107:0) after 1m0s
[20:59:36.486] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:107:0)
[20:59:36.486] Timer tick, asking Buildbucket for the build status
[20:59:37.396] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[20:59:37.396] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:108:0) after 1m0s
[21:00:37.455] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:108:0)
[21:00:37.455] Timer tick, asking Buildbucket for the build status
[21:00:37.605] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[21:00:37.605] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:109:0) after 1m0s
[21:01:37.681] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:109:0)
[21:01:37.681] Timer tick, asking Buildbucket for the build status
[21:01:38.305] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[21:01:38.305] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:110:0) after 1m0s
[21:02:38.502] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:110:0)
[21:02:38.502] Timer tick, asking Buildbucket for the build status
[21:02:38.667] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[21:02:38.667] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:111:0) after 1m0s
[21:03:38.738] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:111:0)
[21:03:38.738] Timer tick, asking Buildbucket for the build status
[21:03:39.217] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[21:03:39.217] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:112:0) after 1m0s
[21:04:39.291] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:112:0)
[21:04:39.291] Timer tick, asking Buildbucket for the build status
[21:04:39.986] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[21:04:39.986] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:113:0) after 1m0s
[21:05:40.046] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:113:0)
[21:05:40.046] Timer tick, asking Buildbucket for the build status
[21:05:40.907] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[21:05:40.907] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:114:0) after 1m0s
[21:06:40.989] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:114:0)
[21:06:40.989] Timer tick, asking Buildbucket for the build status
[21:06:41.151] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[21:06:41.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:115:0) after 1m0s
[21:07:41.174] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:115:0)
[21:07:41.174] Timer tick, asking Buildbucket for the build status
[21:07:42.015] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[21:07:42.015] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:116:0) after 1m0s
[21:08:42.092] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:116:0)
[21:08:42.092] Timer tick, asking Buildbucket for the build status
[21:08:42.423] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[21:08:42.423] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:117:0) after 1m0s
[21:09:42.553] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:117:0)
[21:09:42.553] Timer tick, asking Buildbucket for the build status
[21:09:42.821] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[21:09:42.821] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:118:0) after 1m0s
[21:10:42.846] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:118:0)
[21:10:42.846] Timer tick, asking Buildbucket for the build status
[21:10:43.766] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[21:10:43.766] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:119:0) after 1m0s
[21:11:43.878] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:119:0)
[21:11:43.878] Timer tick, asking Buildbucket for the build status
[21:11:44.201] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[21:11:44.202] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:120:0) after 1m0s
[21:12:44.215] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:120:0)
[21:12:44.215] Timer tick, asking Buildbucket for the build status
[21:12:44.353] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[21:12:44.353] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:121:0) after 1m0s
[21:13:44.446] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:121:0)
[21:13:44.446] Timer tick, asking Buildbucket for the build status
[21:13:44.743] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[21:13:44.743] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:122:0) after 1m0s
[21:14:44.804] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:122:0)
[21:14:44.804] Timer tick, asking Buildbucket for the build status
[21:14:45.126] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[21:14:45.126] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:123:0) after 1m0s
[21:15:45.253] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:123:0)
[21:15:45.253] Timer tick, asking Buildbucket for the build status
[21:15:45.611] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[21:15:45.611] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:124:0) after 1m0s
[21:16:45.721] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:124:0)
[21:16:45.721] Timer tick, asking Buildbucket for the build status
[21:16:46.189] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[21:16:46.189] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:125:0) after 1m0s
[21:17:46.244] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:125:0)
[21:17:46.244] Timer tick, asking Buildbucket for the build status
[21:17:46.407] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[21:17:46.407] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:126:0) after 1m0s
[21:18:46.493] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:126:0)
[21:18:46.493] Timer tick, asking Buildbucket for the build status
[21:18:46.681] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[21:18:46.681] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:127:0) after 1m0s
[21:19:46.830] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:127:0)
[21:19:46.830] Timer tick, asking Buildbucket for the build status
[21:19:47.022] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[21:19:47.022] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:128:0) after 1m0s
[21:20:47.221] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:128:0)
[21:20:47.222] Timer tick, asking Buildbucket for the build status
[21:20:47.388] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[21:20:47.388] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:129:0) after 1m0s
[21:21:47.429] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:129:0)
[21:21:47.429] Timer tick, asking Buildbucket for the build status
[21:21:48.291] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[21:21:48.291] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:130:0) after 1m0s
[21:22:48.343] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:130:0)
[21:22:48.343] Timer tick, asking Buildbucket for the build status
[21:22:48.523] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[21:22:48.523] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:131:0) after 1m0s
[21:23:48.560] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:131:0)
[21:23:48.560] Timer tick, asking Buildbucket for the build status
[21:23:48.974] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[21:23:48.974] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:132:0) after 1m0s
[21:24:49.078] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:132:0)
[21:24:49.078] Timer tick, asking Buildbucket for the build status
[21:24:49.233] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[21:24:49.233] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:133:0) after 1m0s
[21:25:49.324] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:133:0)
[21:25:49.324] Timer tick, asking Buildbucket for the build status
[21:25:49.470] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[21:25:49.470] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:134:0) after 1m0s
[21:26:49.678] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:134:0)
[21:26:49.678] Timer tick, asking Buildbucket for the build status
[21:26:50.127] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[21:26:50.127] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:135:0) after 1m0s
[21:27:50.540] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:135:0)
[21:27:50.540] Timer tick, asking Buildbucket for the build status
[21:27:50.716] Build 8888724851554623856: status "STARTED", result "", failure_reason "", cancelation_reason ""
[21:27:50.716] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9054154913571271184:136:0) after 1m0s
[21:28:25.494] Received PubSub notification, asking Buildbucket for the build status
[21:28:26.565] Build 8888724851554623856: status "COMPLETED", result "FAILURE", failure_reason "BUILD_FAILURE", cancelation_reason ""
[21:28:26.565] Buildbucket build:
{
  "build": {
    "bucket": "luci.chromium.ci",
    "canary_preference": "PROD",
    "completed_ts": "1581456505110495",
    "created_by": "project:chromium",
    "created_ts": "1581448425678335",
    "failure_reason": "BUILD_FAILURE",
    "id": "8888724851554623856",
    "parameters_json": "{\"builder_name\": \"ToTMacASan\", \"properties\": {\"branch\": \"refs/heads/master\", \"repository\": \"https://chromium.googlesource.com/chromium/src\", \"revision\": \"18d420be1c28a99064aafb7740789d3fa29bcaa8\"}}",
    "project": "chromium",
    "result": "FAILURE",
    "result_details_json": "{\"error\": {\"message\": \"#### Step _compile_ failed. Error logs are shown below:\\n```\\n[20905/59970] CXX obj/net/dns/tests/dns_transaction_unittest.o\\nFAILED: obj/net/dns/tests/dns_transaction_unittest.o\\n../../third_party/llvm-build/Release+Asserts/bin/clang++ -MMD -MF obj/net/dns/tests/dns_transaction_...(too long)\\nIn file included from ../../net/dns/dns_transaction_unittest.cc:5:\\nIn file included from ../../net/dns/dns_transaction.h:10:\\n../../buildtools/third_party/libc++/trunk/include/memory:3043:32: error: no matching constructor for initialization of 'net::ResolveContext'\\nreturn unique_ptr\u003c_Tp\u003e(new _Tp(_VSTD::forward\u003c_Args\u003e(__args)...));\\n^   ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~\\n```\\n##### ...The message was too long...\\n#### More information in raw_io.output[failure_summary]\"}, \"properties\": {\"$recipe_engine/path\": {\"cache_dir\": \"/b/s/w/ir/cache\", \"temp_dir\": \"/b/s/w/ir/tmp/rt\"}, \"$recipe_engine/runtime\": {\"is_experimental\": false, \"is_luci\": true}, \"bot_id\": \"build285-m9\", \"branch\": \"refs/heads/master\", \"buildername\": \"ToTMacASan\", \"buildnumber\": 22350, \"got_angle_revision\": \"b40d48a67c932625f349c6e58036c2d96b62489b\", \"got_clang_revision\": \"n342274-d7de7ac3-0\", \"got_dawn_revision\": \"713d9cbf939e525e025a69a17bda0bf51b449c47\", \"got_nacl_revision\": \"3651f6c52037c96e034cc422746768d59182bff3\", \"got_revision\": \"18d420be1c28a99064aafb7740789d3fa29bcaa8\", \"got_revision_cp\": \"refs/heads/master@{#740377}\", \"got_swarming_client_revision\": \"0ac28472d073a515124c85b128c4378a914e0a4d\", \"got_swiftshader_revision\": \"196d81774ef86d1c6c2d028dd5407b47eaa51a99\", \"got_v8_revision\": \"d0da7b4db4d335d91a374ec3be53199c482e7174\", \"got_v8_revision_cp\": \"refs/heads/8.2.56@{#1}\", \"got_webrtc_revision\": \"d4c3c3a454215b21f02d2a772a729b4c87d6b33e\", \"got_webrtc_revision_cp\": \"refs/heads/master@{#30486}\", \"mastername\": \"chromium.clang\", \"path_config\": \"generic\", \"perf_dashboard_machine_group\": \"ChromiumClang\", \"recipe\": \"chromium\", \"repository\": \"https://chromium.googlesource.com/chromium/src\", \"revision\": \"18d420be1c28a99064aafb7740789d3fa29bcaa8\", \"xcode_build_version\": \"11a1027\"}, \"swarming\": {\"bot_dimensions\": {\"builderless\": [\"1\"], \"caches\": [\"builder_0c96c161cf7dd2e1c2b922319da904a0c0164c4adceed5a8844a45f1c516ad13_v2\", \"builder_4a4feefdd7e355061708c01720b06a0ca8c49ffc9968a2ebc674541738676b8f_v2\", \"builder_5372538a354f163a20d332d881c6c5d85e35654ac8a57c760866f12033f8a8a5_v2\", \"builder_ae5debd901c74ee0906916cb62621bceb2a8b657b42c2e2e9e89a0f6a2e5e53b_v2\", \"builder_d42b89eab403033f5a2a8102ec9c436397350cedb439d5e09b11874a5784adb4_v2\", \"git\", \"goma_v2\", \"vpython\", \"xcode_ios_11a1027\"], \"cores\": [\"24\"], \"cpu\": [\"x86\", \"x86-64\", \"x86-64-E5-2697_v2\"], \"gce\": [\"0\"], \"gpu\": [\"1002\", \"1002:679e\", \"1002:679e-4.0.11-3.2.8\"], \"hidpi\": [\"0\"], \"id\": [\"build285-m9\"], \"mac_model\": [\"MacPro6,1\"], \"machine_type\": [\"n1-standard-16\"], \"os\": [\"Mac\", \"Mac-10.14\", \"Mac-10.14.6\"], \"pool\": [\"luci.chromium.ci\"], \"python\": [\"2.7.10\"], \"server_version\": [\"4812-ea7e8fc\"], \"ssd\": [\"1\"], \"zone\": [\"us\", \"us-atl\", \"us-atl-golo\", \"us-atl-golo-m9\"]}}, \"ui\": {\"info\": \"#### Step _compile_ failed. Error logs are shown below:\\n```\\n[20905/59970] CXX obj/net/dns/tests/dns_transaction_unittest.o\\nFAILED: obj/net/dns/tests/dns_transaction_unittest.o\\n../../third_party/llvm-build/Release+Asserts/bin/clang++ -MMD -MF obj/net/dns/tests/dns_transaction_...(too long)\\nIn file included from ../../net/dns/dns_transaction_unittest.cc:5:\\nIn file included from ../../net/dns/dns_transaction.h:10:\\n../../buildtools/third_party/libc++/trunk/include/memory:3043:32: error: no matching constructor for initialization of 'net::ResolveContext'\\nreturn unique_ptr\u003c_Tp\u003e(new _Tp(_VSTD::forward\u003c_Args\u003e(__args)...));\\n^   ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~\\n```\\n##### ...The message was too long...\\n#### More information in raw_io.output[failure_summary]\"}}",
    "service_account": "chromium-ci-builder@chops-service-accounts.iam.gserviceaccount.com",
    "started_ts": "1581448664808912",
    "status": "COMPLETED",
    "status_changed_ts": "1581448665352866",
    "tags": [
      "build_address:luci.chromium.ci/ToTMacASan/22350",
      "builder:ToTMacASan",
      "buildset:commit/git/18d420be1c28a99064aafb7740789d3fa29bcaa8",
      "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/18d420be1c28a99064aafb7740789d3fa29bcaa8",
      "gitiles_ref:refs/heads/master",
      "scheduler_invocation_id:9054154913571271184",
      "scheduler_job_id:chromium/ToTMacASan",
      "swarming_hostname:chromium-swarm.appspot.com",
      "swarming_tag:log_location:logdog://logs.chromium.org/chromium/buildbucket/cr-buildbucket.appspot.com/8888724851554623856/+/annotations",
      "swarming_tag:luci_project:chromium",
      "swarming_tag:os:Mac",
      "swarming_tag:recipe_name:chromium",
      "swarming_tag:recipe_package:infra/recipe_bundles/chromium.googlesource.com/chromium/tools/build",
      "swarming_task_id:4a4e7d7b95d6ed10",
      "user_agent:luci-scheduler"
    ],
    "updated_ts": "1581456505227214",
    "url": "https://ci.chromium.org/b/8888724851554623856",
    "utcnow_ts": "1581456506509411"
  }
}
[21:28:26.565] Invocation finished in 2h14m42.194210803s with status FAILED