[15:40:06.440] New invocation is queued and will start shortly
[15:40:07.591] Starting the invocation (attempt 1)
[15:40:07.680] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[15:40:07.680] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[15:40:07.680] Buildbucket request:
{
"bucket": "luci.chromium.ci",
"client_operation_id": "9068392077889602992",
"parameters_json": "{\"builder_name\":\"ToTiOSDevice\",\"properties\":{\"branch\":\"refs/heads/master\",\"repository\":\"https://chromium.googlesource.com/chromium/src.git\",\"revision\":\"3f147665c1dd77e4647dfffaa6b07e1a1c5b2284\"}}",
"pubsub_callback": {
"auth_token": "...",
"topic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
},
"tags": [
"builder:ToTiOSDevice",
"scheduler_invocation_id:9068392077889602992",
"scheduler_job_id:chromium/ToTiOSDevice",
"user_agent:luci-scheduler",
"buildset:commit/git/3f147665c1dd77e4647dfffaa6b07e1a1c5b2284",
"buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/3f147665c1dd77e4647dfffaa6b07e1a1c5b2284",
"gitiles_ref:refs/heads/master"
]
}
[15:40:08.634] Buildbucket response:
{
"build": {
"bucket": "luci.chromium.ci",
"canary_preference": "PROD",
"created_by": "project:chromium",
"created_ts": "1567870807866340",
"id": "8902962015729875984",
"parameters_json": "{\"builder_name\": \"ToTiOSDevice\", \"properties\": {\"branch\": \"refs/heads/master\", \"repository\": \"https://chromium.googlesource.com/chromium/src.git\", \"revision\": \"3f147665c1dd77e4647dfffaa6b07e1a1c5b2284\"}}",
"project": "chromium",
"result_details_json": "{\"properties\": {}}",
"service_account": "chromium-ci-builder@chops-service-accounts.iam.gserviceaccount.com",
"status": "SCHEDULED",
"status_changed_ts": "1567870808461154",
"tags": [
"build_address:luci.chromium.ci/ToTiOSDevice/14007",
"builder:ToTiOSDevice",
"buildset:commit/git/3f147665c1dd77e4647dfffaa6b07e1a1c5b2284",
"buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/3f147665c1dd77e4647dfffaa6b07e1a1c5b2284",
"gitiles_ref:refs/heads/master",
"scheduler_invocation_id:9068392077889602992",
"scheduler_job_id:chromium/ToTiOSDevice",
"swarming_hostname:chromium-swarm.appspot.com",
"swarming_tag:log_location:logdog://logs.chromium.org/chromium/buildbucket/cr-buildbucket.appspot.com/8902962015729875984/+/annotations",
"swarming_tag:luci_project:chromium",
"swarming_tag:recipe_name:ios/unified_builder_tester",
"swarming_tag:recipe_package:infra/recipe_bundles/chromium.googlesource.com/chromium/tools/build",
"swarming_task_id:",
"user_agent:luci-scheduler"
],
"updated_ts": "1567870808461252",
"url": "https://ci.chromium.org/b/8902962015729875984",
"utcnow_ts": "1567870808624258"
}
}
[15:40:08.634] Task URL: https://ci.chromium.org/b/8902962015729875984
[15:40:08.634] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:2:0) after 1m0s
[15:41:08.668] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:2:0)
[15:41:08.668] Timer tick, asking Buildbucket for the build status
[15:41:08.810] Build 8902962015729875984: status "SCHEDULED", result "", failure_reason "", cancelation_reason ""
[15:41:08.810] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:3:0) after 1m0s
[15:42:08.856] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:3:0)
[15:42:08.856] Timer tick, asking Buildbucket for the build status
[15:42:09.011] Build 8902962015729875984: status "SCHEDULED", result "", failure_reason "", cancelation_reason ""
[15:42:09.011] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:4:0) after 1m0s
[15:43:05.695] Received PubSub notification, asking Buildbucket for the build status
[15:43:06.346] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[15:43:09.038] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:4:0)
[15:43:09.038] Timer tick, asking Buildbucket for the build status
[15:43:10.097] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[15:43:10.097] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:6:0) after 1m0s
[15:44:10.107] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:6:0)
[15:44:10.107] Timer tick, asking Buildbucket for the build status
[15:44:10.828] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[15:44:10.828] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:7:0) after 1m0s
[15:45:10.852] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:7:0)
[15:45:10.852] Timer tick, asking Buildbucket for the build status
[15:45:11.398] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[15:45:11.398] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:8:0) after 1m0s
[15:46:11.423] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:8:0)
[15:46:11.423] Timer tick, asking Buildbucket for the build status
[15:46:11.652] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[15:46:11.652] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:9:0) after 1m0s
[15:47:11.675] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:9:0)
[15:47:11.675] Timer tick, asking Buildbucket for the build status
[15:47:11.815] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[15:47:11.815] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:10:0) after 1m0s
[15:48:11.837] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:10:0)
[15:48:11.837] Timer tick, asking Buildbucket for the build status
[15:48:12.443] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[15:48:12.443] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:11:0) after 1m0s
[15:49:12.471] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:11:0)
[15:49:12.471] Timer tick, asking Buildbucket for the build status
[15:49:13.400] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[15:49:13.400] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:12:0) after 1m0s
[15:50:13.515] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:12:0)
[15:50:13.515] Timer tick, asking Buildbucket for the build status
[15:50:13.934] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[15:50:13.934] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:13:0) after 1m0s
[15:51:13.971] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:13:0)
[15:51:13.971] Timer tick, asking Buildbucket for the build status
[15:51:14.244] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[15:51:14.244] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:14:0) after 1m0s
[15:52:14.471] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:14:0)
[15:52:14.471] Timer tick, asking Buildbucket for the build status
[15:52:15.145] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[15:52:15.145] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:15:0) after 1m0s
[15:53:15.127] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:15:0)
[15:53:15.127] Timer tick, asking Buildbucket for the build status
[15:53:17.871] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[15:53:17.871] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:16:0) after 1m0s
[15:54:17.943] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:16:0)
[15:54:17.943] Timer tick, asking Buildbucket for the build status
[15:54:18.197] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[15:54:18.197] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:17:0) after 1m0s
[15:55:18.341] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:17:0)
[15:55:18.341] Timer tick, asking Buildbucket for the build status
[15:55:18.481] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[15:55:18.481] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:18:0) after 1m0s
[15:56:18.669] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:18:0)
[15:56:18.669] Timer tick, asking Buildbucket for the build status
[15:56:19.432] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[15:56:19.432] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:19:0) after 1m0s
[15:57:19.497] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:19:0)
[15:57:19.497] Timer tick, asking Buildbucket for the build status
[15:57:20.086] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[15:57:20.086] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:20:0) after 1m0s
[15:58:20.159] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:20:0)
[15:58:20.159] Timer tick, asking Buildbucket for the build status
[15:58:20.414] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[15:58:20.414] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:21:0) after 1m0s
[15:59:20.453] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:21:0)
[15:59:20.453] Timer tick, asking Buildbucket for the build status
[15:59:20.742] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[15:59:20.742] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:22:0) after 1m0s
[16:00:20.775] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:22:0)
[16:00:20.775] Timer tick, asking Buildbucket for the build status
[16:00:21.244] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[16:00:21.244] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:23:0) after 1m0s
[16:01:21.272] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:23:0)
[16:01:21.272] Timer tick, asking Buildbucket for the build status
[16:01:22.051] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[16:01:22.052] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:24:0) after 1m0s
[16:02:22.130] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:24:0)
[16:02:22.130] Timer tick, asking Buildbucket for the build status
[16:02:22.556] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[16:02:22.556] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:25:0) after 1m0s
[16:03:22.707] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:25:0)
[16:03:22.707] Timer tick, asking Buildbucket for the build status
[16:03:23.228] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[16:03:23.228] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:26:0) after 1m0s
[16:04:23.240] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:26:0)
[16:04:23.240] Timer tick, asking Buildbucket for the build status
[16:04:23.411] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[16:04:23.411] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:27:0) after 1m0s
[16:05:23.533] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:27:0)
[16:05:23.533] Timer tick, asking Buildbucket for the build status
[16:05:23.703] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[16:05:23.703] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:28:0) after 1m0s
[16:06:23.756] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:28:0)
[16:06:23.756] Timer tick, asking Buildbucket for the build status
[16:06:23.994] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[16:06:23.994] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:29:0) after 1m0s
[16:07:24.049] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:29:0)
[16:07:24.049] Timer tick, asking Buildbucket for the build status
[16:07:24.778] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[16:07:24.778] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:30:0) after 1m0s
[16:08:24.823] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:30:0)
[16:08:24.823] Timer tick, asking Buildbucket for the build status
[16:08:25.147] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[16:08:25.147] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:31:0) after 1m0s
[16:09:25.198] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:31:0)
[16:09:25.198] Timer tick, asking Buildbucket for the build status
[16:09:25.484] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[16:09:25.484] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:32:0) after 1m0s
[16:10:25.507] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:32:0)
[16:10:25.507] Timer tick, asking Buildbucket for the build status
[16:10:25.685] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[16:10:25.685] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:33:0) after 1m0s
[16:11:25.765] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:33:0)
[16:11:25.765] Timer tick, asking Buildbucket for the build status
[16:11:26.809] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[16:11:26.809] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:34:0) after 1m0s
[16:12:26.893] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:34:0)
[16:12:26.893] Timer tick, asking Buildbucket for the build status
[16:12:27.252] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[16:12:27.252] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:35:0) after 1m0s
[16:13:27.283] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:35:0)
[16:13:27.283] Timer tick, asking Buildbucket for the build status
[16:13:27.483] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[16:13:27.483] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:36:0) after 1m0s
[16:14:27.509] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:36:0)
[16:14:27.509] Timer tick, asking Buildbucket for the build status
[16:14:28.094] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[16:14:28.094] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:37:0) after 1m0s
[16:15:28.202] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:37:0)
[16:15:28.202] Timer tick, asking Buildbucket for the build status
[16:15:28.515] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[16:15:28.515] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:38:0) after 1m0s
[16:16:28.577] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:38:0)
[16:16:28.577] Timer tick, asking Buildbucket for the build status
[16:16:28.822] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[16:16:28.822] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:39:0) after 1m0s
[16:17:28.892] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:39:0)
[16:17:28.892] Timer tick, asking Buildbucket for the build status
[16:17:29.102] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[16:17:29.102] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:40:0) after 1m0s
[16:18:29.129] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:40:0)
[16:18:29.129] Timer tick, asking Buildbucket for the build status
[16:18:29.294] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[16:18:29.294] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:41:0) after 1m0s
[16:19:29.327] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:41:0)
[16:19:29.327] Timer tick, asking Buildbucket for the build status
[16:19:29.503] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[16:19:29.503] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:42:0) after 1m0s
[16:20:29.524] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:42:0)
[16:20:29.524] Timer tick, asking Buildbucket for the build status
[16:20:30.372] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[16:20:30.372] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:43:0) after 1m0s
[16:21:30.420] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:43:0)
[16:21:30.420] Timer tick, asking Buildbucket for the build status
[16:21:30.649] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[16:21:30.649] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:44:0) after 1m0s
[16:22:30.716] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:44:0)
[16:22:30.716] Timer tick, asking Buildbucket for the build status
[16:22:31.015] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[16:22:31.015] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:45:0) after 1m0s
[16:23:31.062] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:45:0)
[16:23:31.062] Timer tick, asking Buildbucket for the build status
[16:23:31.364] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[16:23:31.364] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:46:0) after 1m0s
[16:24:31.385] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:46:0)
[16:24:31.385] Timer tick, asking Buildbucket for the build status
[16:24:31.736] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[16:24:31.736] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:47:0) after 1m0s
[16:25:31.773] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:47:0)
[16:25:31.773] Timer tick, asking Buildbucket for the build status
[16:25:31.937] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[16:25:31.937] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:48:0) after 1m0s
[16:26:31.925] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:48:0)
[16:26:31.925] Timer tick, asking Buildbucket for the build status
[16:26:32.240] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[16:26:32.240] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:49:0) after 1m0s
[16:27:32.268] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:49:0)
[16:27:32.268] Timer tick, asking Buildbucket for the build status
[16:27:32.413] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[16:27:32.413] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:50:0) after 1m0s
[16:28:32.422] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:50:0)
[16:28:32.422] Timer tick, asking Buildbucket for the build status
[16:28:32.839] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[16:28:32.839] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:51:0) after 1m0s
[16:29:32.897] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:51:0)
[16:29:32.897] Timer tick, asking Buildbucket for the build status
[16:29:33.334] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[16:29:33.334] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:52:0) after 1m0s
[16:30:33.375] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:52:0)
[16:30:33.375] Timer tick, asking Buildbucket for the build status
[16:30:33.630] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[16:30:33.630] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:53:0) after 1m0s
[16:31:33.685] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:53:0)
[16:31:33.685] Timer tick, asking Buildbucket for the build status
[16:31:35.179] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[16:31:35.179] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:54:0) after 1m0s
[16:32:35.222] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:54:0)
[16:32:35.222] Timer tick, asking Buildbucket for the build status
[16:32:35.421] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[16:32:35.421] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:55:0) after 1m0s
[16:33:35.463] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:55:0)
[16:33:35.463] Timer tick, asking Buildbucket for the build status
[16:33:35.628] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[16:33:35.628] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:56:0) after 1m0s
[16:34:35.715] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:56:0)
[16:34:35.715] Timer tick, asking Buildbucket for the build status
[16:34:36.347] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[16:34:36.347] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:57:0) after 1m0s
[16:35:36.397] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:57:0)
[16:35:36.397] Timer tick, asking Buildbucket for the build status
[16:35:37.686] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[16:35:37.686] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:58:0) after 1m0s
[16:36:37.886] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:58:0)
[16:36:37.886] Timer tick, asking Buildbucket for the build status
[16:36:38.085] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[16:36:38.085] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:59:0) after 1m0s
[16:37:38.124] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:59:0)
[16:37:38.124] Timer tick, asking Buildbucket for the build status
[16:37:38.304] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[16:37:38.304] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:60:0) after 1m0s
[16:38:38.333] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:60:0)
[16:38:38.333] Timer tick, asking Buildbucket for the build status
[16:38:38.713] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[16:38:38.713] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:61:0) after 1m0s
[16:39:38.796] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:61:0)
[16:39:38.796] Timer tick, asking Buildbucket for the build status
[16:39:38.953] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[16:39:38.953] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:62:0) after 1m0s
[16:40:38.991] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:62:0)
[16:40:38.991] Timer tick, asking Buildbucket for the build status
[16:40:39.312] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[16:40:39.312] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:63:0) after 1m0s
[16:41:39.350] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:63:0)
[16:41:39.350] Timer tick, asking Buildbucket for the build status
[16:41:40.156] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[16:41:40.156] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:64:0) after 1m0s
[16:42:40.181] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:64:0)
[16:42:40.181] Timer tick, asking Buildbucket for the build status
[16:42:41.075] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[16:42:41.075] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:65:0) after 1m0s
[16:43:41.102] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:65:0)
[16:43:41.103] Timer tick, asking Buildbucket for the build status
[16:43:41.358] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[16:43:41.358] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:66:0) after 1m0s
[16:44:41.430] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:66:0)
[16:44:41.430] Timer tick, asking Buildbucket for the build status
[16:44:41.753] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[16:44:41.753] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:67:0) after 1m0s
[16:45:41.796] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:67:0)
[16:45:41.796] Timer tick, asking Buildbucket for the build status
[16:45:42.705] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[16:45:42.706] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:68:0) after 1m0s
[16:46:42.792] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:68:0)
[16:46:42.792] Timer tick, asking Buildbucket for the build status
[16:46:42.995] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[16:46:42.995] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:69:0) after 1m0s
[16:47:43.020] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:69:0)
[16:47:43.020] Timer tick, asking Buildbucket for the build status
[16:47:43.442] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[16:47:43.442] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:70:0) after 1m0s
[16:48:43.463] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:70:0)
[16:48:43.463] Timer tick, asking Buildbucket for the build status
[16:48:43.902] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[16:48:43.902] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:71:0) after 1m0s
[16:49:43.932] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:71:0)
[16:49:43.932] Timer tick, asking Buildbucket for the build status
[16:49:44.498] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[16:49:44.498] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:72:0) after 1m0s
[16:50:44.535] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:72:0)
[16:50:44.535] Timer tick, asking Buildbucket for the build status
[16:50:45.043] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[16:50:45.043] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:73:0) after 1m0s
[16:51:45.066] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:73:0)
[16:51:45.066] Timer tick, asking Buildbucket for the build status
[16:51:45.320] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[16:51:45.320] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:74:0) after 1m0s
[16:52:45.323] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:74:0)
[16:52:45.323] Timer tick, asking Buildbucket for the build status
[16:52:45.618] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[16:52:45.618] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:75:0) after 1m0s
[16:53:45.648] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:75:0)
[16:53:45.648] Timer tick, asking Buildbucket for the build status
[16:53:46.215] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[16:53:46.215] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:76:0) after 1m0s
[16:54:46.261] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:76:0)
[16:54:46.261] Timer tick, asking Buildbucket for the build status
[16:54:46.440] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[16:54:46.440] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:77:0) after 1m0s
[16:55:46.476] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:77:0)
[16:55:46.476] Timer tick, asking Buildbucket for the build status
[16:55:46.627] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[16:55:46.627] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:78:0) after 1m0s
[16:56:46.658] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:78:0)
[16:56:46.658] Timer tick, asking Buildbucket for the build status
[16:56:47.399] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[16:56:47.399] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:79:0) after 1m0s
[16:57:47.425] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:79:0)
[16:57:47.425] Timer tick, asking Buildbucket for the build status
[16:57:47.595] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[16:57:47.595] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:80:0) after 1m0s
[16:58:47.623] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:80:0)
[16:58:47.623] Timer tick, asking Buildbucket for the build status
[16:58:47.879] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[16:58:47.879] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:81:0) after 1m0s
[16:59:47.949] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:81:0)
[16:59:47.949] Timer tick, asking Buildbucket for the build status
[16:59:48.682] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[16:59:48.682] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:82:0) after 1m0s
[17:00:48.719] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:82:0)
[17:00:48.719] Timer tick, asking Buildbucket for the build status
[17:00:49.350] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[17:00:49.350] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:83:0) after 1m0s
[17:01:49.381] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:83:0)
[17:01:49.381] Timer tick, asking Buildbucket for the build status
[17:01:49.937] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[17:01:49.937] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:84:0) after 1m0s
[17:02:49.960] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:84:0)
[17:02:49.960] Timer tick, asking Buildbucket for the build status
[17:02:50.192] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[17:02:50.192] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:85:0) after 1m0s
[17:03:50.279] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:85:0)
[17:03:50.279] Timer tick, asking Buildbucket for the build status
[17:03:50.542] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[17:03:50.542] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:86:0) after 1m0s
[17:04:50.596] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:86:0)
[17:04:50.597] Timer tick, asking Buildbucket for the build status
[17:04:51.439] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[17:04:51.439] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:87:0) after 1m0s
[17:05:51.479] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:87:0)
[17:05:51.479] Timer tick, asking Buildbucket for the build status
[17:05:51.711] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[17:05:51.711] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:88:0) after 1m0s
[17:06:51.746] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:88:0)
[17:06:51.746] Timer tick, asking Buildbucket for the build status
[17:06:52.854] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[17:06:52.854] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:89:0) after 1m0s
[17:07:52.842] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:89:0)
[17:07:52.842] Timer tick, asking Buildbucket for the build status
[17:07:53.720] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[17:07:53.720] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:90:0) after 1m0s
[17:08:53.752] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:90:0)
[17:08:53.752] Timer tick, asking Buildbucket for the build status
[17:08:54.024] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[17:08:54.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:91:0) after 1m0s
[17:09:54.050] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:91:0)
[17:09:54.050] Timer tick, asking Buildbucket for the build status
[17:09:54.225] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[17:09:54.225] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:92:0) after 1m0s
[17:10:54.287] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:92:0)
[17:10:54.287] Timer tick, asking Buildbucket for the build status
[17:10:54.523] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[17:10:54.524] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:93:0) after 1m0s
[17:11:54.645] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:93:0)
[17:11:54.645] Timer tick, asking Buildbucket for the build status
[17:11:55.131] Build 8902962015729875984: status "STARTED", result "", failure_reason "", cancelation_reason ""
[17:11:55.131] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9068392077889602992:94:0) after 1m0s
[17:12:52.238] Received PubSub notification, asking Buildbucket for the build status
[17:12:52.471] Build 8902962015729875984: status "COMPLETED", result "FAILURE", failure_reason "INFRA_FAILURE", cancelation_reason ""
[17:12:52.471] Buildbucket build:
{
"build": {
"bucket": "luci.chromium.ci",
"canary_preference": "PROD",
"completed_ts": "1567876371048621",
"created_by": "project:chromium",
"created_ts": "1567870807866340",
"failure_reason": "INFRA_FAILURE",
"id": "8902962015729875984",
"parameters_json": "{\"builder_name\": \"ToTiOSDevice\", \"properties\": {\"branch\": \"refs/heads/master\", \"repository\": \"https://chromium.googlesource.com/chromium/src.git\", \"revision\": \"3f147665c1dd77e4647dfffaa6b07e1a1c5b2284\"}}",
"project": "chromium",
"result": "FAILURE",
"result_details_json": "{\"error\": {\"message\": \"recipe infra failure: Failed base_unittests (iPhone 6s iOS 12.3.1), base_unittests (iPhone 6s iOS 12.3.1), boringssl_crypto_tests (iPhone 6s iOS 12.3.1), boringssl_crypto_tests (iPhone 6s iOS 12.3.1), boringssl_ssl_tests (iPhone 6s iOS 12.3.1), boringssl_ssl_tests (iPhone 6s iOS 12.3.1), components_unittests (iPhone 6s iOS 12.3.1), components_unittests (iPhone 6s iOS 12.3.1), crypto_unittests (iPhone 6s iOS 12.3.1), crypto_unittests (iPhone 6s iOS 12.3.1), gfx_unittests (iPhone 6s iOS 12.3.1), gfx_unittests (iPhone 6s iOS 12.3.1), google_apis_unittests (iPhone 6s iOS 12.3.1), google_apis_unittests (iPhone 6s iOS 12.3.1), ios_chrome_unittests (iPhone 6s iOS 12.3.1), ios_chrome_unittests (iPhone 6s iOS 12.3.1), ios_net_unittests (iPhone 6s iOS 12.3.1), ios_net_unittests (iPhone 6s iOS 12.3.1), ios_web_inttests (iPhone 6s iOS 12.3.1), ios_web_inttests (iPhone 6s iOS 12.3.1), ios_web_unittests (iPhone 6s iOS 12.3.1), ios_web_unittests (iPhone 6s iOS 12.3.1), ios_web_view_inttests (iPhone 6s iOS 12.3.1), ios_web_view_inttests (iPhone 6s iOS 12.3.1), net_unittests (iPhone 6s iOS 12.3.1), net_unittests (iPhone 6s iOS 12.3.1), skia_unittests (iPhone 6s iOS 12.3.1), skia_unittests (iPhone 6s iOS 12.3.1), sql_unittests (iPhone 6s iOS 12.3.1), sql_unittests (iPhone 6s iOS 12.3.1), ui_base_unittests (iPhone 6s iOS 12.3.1), ui_base_unittests (iPhone 6s iOS 12.3.1), url_unittests (iPhone 6s iOS 12.3.1), url_unittests (iPhone 6s iOS 12.3.1).\"}, \"properties\": {\"$recipe_engine/path\": {\"cache_dir\": \"/b/s/w/ir/cache\", \"temp_dir\": \"/b/s/w/ir/tmp/rt\"}, \"$recipe_engine/runtime\": {\"is_experimental\": false, \"is_luci\": true}, \"bot_id\": \"build285-m9\", \"branch\": \"refs/heads/master\", \"buildername\": \"ToTiOSDevice\", \"buildnumber\": 14007, \"got_angle_revision\": \"32d6006bf2ef9ea1cc5a705df3493ed7cca16821\", \"got_dawn_revision\": \"a900ccebcf428c99184ca44a3fad6030b2e43fc7\", \"got_nacl_revision\": \"058a26f57015051953a727add26e7e26348b9558\", \"got_revision\": \"3f147665c1dd77e4647dfffaa6b07e1a1c5b2284\", \"got_revision_cp\": \"refs/heads/master@{#694587}\", \"got_swarming_client_revision\": \"96f125709acfd0b48fc1e5dae7d6ea42291726ac\", \"got_v8_revision\": \"73694fd32996da7f914e05ebc84aa9fbe2cd6b52\", \"got_v8_revision_cp\": \"refs/heads/7.8.279@{#1}\", \"got_webrtc_revision\": \"3146ea01ae59f7b9e75205bae471505407f6316e\", \"got_webrtc_revision_cp\": \"refs/heads/master@{#29104}\", \"isolate_server\": \"https://isolateserver.appspot.com\", \"mastername\": \"chromium.clang\", \"path_config\": \"generic\", \"perf_dashboard_machine_group\": \"ChromiumClang\", \"recipe\": \"ios/unified_builder_tester\", \"repository\": \"https://chromium.googlesource.com/chromium/src.git\", \"revision\": \"3f147665c1dd77e4647dfffaa6b07e1a1c5b2284\", \"swarm_hashes\": {\"0\": \"7d6fc874a27ed1d4e7c72ec55ae3efac42c6f2ef\", \"1\": \"fcd11c2a3111c05436077e62b48974e2df1e73e4\", \"10\": \"b14ee1497a2bc95d5c94d83d646a3b82f11cc560\", \"11\": \"57d10e4de6f778ebb2c65bd5d31341eee4cb699b\", \"12\": \"beabb416662311432cb48b3d99dceb40ad424d93\", \"13\": \"506b2b5938b850eabb3fbbc9847a803395a863a4\", \"14\": \"1e45650faa8f54181f521a7ac46c9d0617ca1240\", \"15\": \"7a83859c5114c4b3078d94ad8120d36d3d5d9bfe\", \"16\": \"17895021372b68989e7020019a0c744e677e4385\", \"2\": \"ece2d5721fe8973669b48f189f569cad37635940\", \"3\": \"bba3892abba15c60b6d22f98b36af2e23bac2f35\", \"4\": \"4304554a712263ba382447a9d756c39bf5d5a0d5\", \"5\": \"6c3c66618f132d18e3ce620c2be4f27e0285b8d5\", \"6\": \"38085f773055d0ef8bf84eda22c07ed572ddba23\", \"7\": \"7c7af51ae405c9c612c939d236bdf2961ed9723b\", \"8\": \"6958f9c9faab54b617e36bc8a5aa6b9f0498cbb6\", \"9\": \"3f1d572b358b93e5ba92391c3c870037411fad8d\"}}, \"swarming\": {\"bot_dimensions\": {\"builderless\": [\"1\"], \"caches\": [\"builder_4a4feefdd7e355061708c01720b06a0ca8c49ffc9968a2ebc674541738676b8f_v2\", \"builder_5372538a354f163a20d332d881c6c5d85e35654ac8a57c760866f12033f8a8a5_v2\", \"builder_69caa34b8f39daac28a821cac2619730401d46a6479812cc34796e3bf180418a_v2\", \"builder_ae5debd901c74ee0906916cb62621bceb2a8b657b42c2e2e9e89a0f6a2e5e53b_v2\", \"builder_d42b89eab403033f5a2a8102ec9c436397350cedb439d5e09b11874a5784adb4_v2\", \"git\", \"goma_v2\", \"vpython\", \"xcode_ios_11m382q\", \"xcode_ios_11m392q\", \"xcode_ios_11m392r\"], \"cores\": [\"24\"], \"cpu\": [\"x86\", \"x86-64\", \"x86-64-E5-2697_v2\"], \"gce\": [\"0\"], \"gpu\": [\"1002\", \"1002:679e\", \"1002:679e-4.0.11-3.2.8\"], \"hidpi\": [\"0\"], \"id\": [\"build285-m9\"], \"mac_model\": [\"MacPro6,1\"], \"machine_type\": [\"n1-standard-16\"], \"os\": [\"Mac\", \"Mac-10.14\", \"Mac-10.14.6\"], \"pool\": [\"luci.chromium.ci\"], \"python\": [\"2.7.10\"], \"server_version\": [\"4417-ad2503b\"], \"ssd\": [\"1\"], \"zone\": [\"us\", \"us-atl\", \"us-atl-golo\", \"us-atl-golo-m9\"]}}, \"ui\": {\"info\": \"recipe infra failure: Failed base_unittests (iPhone 6s iOS 12.3.1), base_unittests (iPhone 6s iOS 12.3.1), boringssl_crypto_tests (iPhone 6s iOS 12.3.1), boringssl_crypto_tests (iPhone 6s iOS 12.3.1), boringssl_ssl_tests (iPhone 6s iOS 12.3.1), boringssl_ssl_tests (iPhone 6s iOS 12.3.1), components_unittests (iPhone 6s iOS 12.3.1), components_unittests (iPhone 6s iOS 12.3.1), crypto_unittests (iPhone 6s iOS 12.3.1), crypto_unittests (iPhone 6s iOS 12.3.1), gfx_unittests (iPhone 6s iOS 12.3.1), gfx_unittests (iPhone 6s iOS 12.3.1), google_apis_unittests (iPhone 6s iOS 12.3.1), google_apis_unittests (iPhone 6s iOS 12.3.1), ios_chrome_unittests (iPhone 6s iOS 12.3.1), ios_chrome_unittests (iPhone 6s iOS 12.3.1), ios_net_unittests (iPhone 6s iOS 12.3.1), ios_net_unittests (iPhone 6s iOS 12.3.1), ios_web_inttests (iPhone 6s iOS 12.3.1), ios_web_inttests (iPhone 6s iOS 12.3.1), ios_web_unittests (iPhone 6s iOS 12.3.1), ios_web_unittests (iPhone 6s iOS 12.3.1), ios_web_view_inttests (iPhone 6s iOS 12.3.1), ios_web_view_inttests (iPhone 6s iOS 12.3.1), net_unittests (iPhone 6s iOS 12.3.1), net_unittests (iPhone 6s iOS 12.3.1), skia_unittests (iPhone 6s iOS 12.3.1), skia_unittests (iPhone 6s iOS 12.3.1), sql_unittests (iPhone 6s iOS 12.3.1), sql_unittests (iPhone 6s iOS 12.3.1), ui_base_unittests (iPhone 6s iOS 12.3.1), ui_base_unittests (iPhone 6s iOS 12.3.1), url_unittests (iPhone 6s iOS 12.3.1), url_unittests (iPhone 6s iOS 12.3.1).\"}}",
"service_account": "chromium-ci-builder@chops-service-accounts.iam.gserviceaccount.com",
"started_ts": "1567870983202167",
"status": "COMPLETED",
"status_changed_ts": "1567870984959477",
"tags": [
"build_address:luci.chromium.ci/ToTiOSDevice/14007",
"builder:ToTiOSDevice",
"buildset:commit/git/3f147665c1dd77e4647dfffaa6b07e1a1c5b2284",
"buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/3f147665c1dd77e4647dfffaa6b07e1a1c5b2284",
"gitiles_ref:refs/heads/master",
"scheduler_invocation_id:9068392077889602992",
"scheduler_job_id:chromium/ToTiOSDevice",
"swarming_hostname:chromium-swarm.appspot.com",
"swarming_tag:log_location:logdog://logs.chromium.org/chromium/buildbucket/cr-buildbucket.appspot.com/8902962015729875984/+/annotations",
"swarming_tag:luci_project:chromium",
"swarming_tag:os:Mac",
"swarming_tag:recipe_name:ios/unified_builder_tester",
"swarming_tag:recipe_package:infra/recipe_bundles/chromium.googlesource.com/chromium/tools/build",
"swarming_task_id:4725337aa261c110",
"user_agent:luci-scheduler"
],
"updated_ts": "1567876371546602",
"url": "https://ci.chromium.org/b/8902962015729875984",
"utcnow_ts": "1567876372459365"
}
}
[17:12:52.471] Invocation finished in 1h32m46.049451155s with status FAILED