[03:06:27.717] New invocation is queued and will start shortly
[03:06:28.932] Starting the invocation (attempt 1)
[03:06:29.006] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[03:06:29.009] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[03:06:29.009] Buildbucket request:
{
"bucket": "luci.chromium.ci",
"client_operation_id": "9017705191973862416",
"parameters_json": "{\"builder_name\":\"ToTMacASan\",\"properties\":{\"branch\":\"refs/heads/master\",\"repository\":\"https://chromium.googlesource.com/chromium/src\",\"revision\":\"57524c8161ed7bf736a488b2dbaf84d5482f3e89\"}}",
"pubsub_callback": {
"auth_token": "...",
"topic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
},
"tags": [
"builder:ToTMacASan",
"scheduler_invocation_id:9017705191973862416",
"scheduler_job_id:chromium/ToTMacASan",
"user_agent:luci-scheduler",
"buildset:commit/git/57524c8161ed7bf736a488b2dbaf84d5482f3e89",
"buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/57524c8161ed7bf736a488b2dbaf84d5482f3e89",
"gitiles_ref:refs/heads/master"
]
}
[03:06:29.701] Buildbucket response:
{
"build": {
"bucket": "luci.chromium.ci",
"canary_preference": "PROD",
"created_by": "project:chromium",
"created_ts": "1616209589147016",
"id": "8852275129809282336",
"parameters_json": "{\"builder_name\": \"ToTMacASan\", \"properties\": {\"branch\": \"refs/heads/master\", \"repository\": \"https://chromium.googlesource.com/chromium/src\", \"revision\": \"57524c8161ed7bf736a488b2dbaf84d5482f3e89\"}}",
"project": "chromium",
"result_details_json": "{\"properties\": {}}",
"service_account": "chromium-ci-builder@chops-service-accounts.iam.gserviceaccount.com",
"status": "SCHEDULED",
"status_changed_ts": "1616209589605238",
"tags": [
"build_address:luci.chromium.ci/ToTMacASan/24656",
"builder:ToTMacASan",
"buildset:commit/git/57524c8161ed7bf736a488b2dbaf84d5482f3e89",
"buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/57524c8161ed7bf736a488b2dbaf84d5482f3e89",
"gitiles_ref:refs/heads/master",
"scheduler_invocation_id:9017705191973862416",
"scheduler_job_id:chromium/ToTMacASan",
"swarming_hostname:chromium-swarm.appspot.com",
"swarming_tag:log_location:logdog://logs.chromium.org/chromium/buildbucket/cr-buildbucket.appspot.com/8852275129809282336/+/annotations",
"swarming_tag:luci_project:chromium",
"swarming_tag:recipe_name:chromium",
"swarming_tag:recipe_package:infra/recipe_bundles/chromium.googlesource.com/chromium/tools/build",
"swarming_task_id:",
"user_agent:luci-scheduler"
],
"updated_ts": "1616209589605353",
"url": "https://ci.chromium.org/b/8852275129809282336",
"utcnow_ts": "1616209589694413"
}
}
[03:06:29.701] Task URL: https://ci.chromium.org/b/8852275129809282336
[03:06:29.701] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:2:0) after 1m0s
[03:07:04.849] Received PubSub notification, asking Buildbucket for the build status
[03:07:04.950] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[03:07:29.784] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:2:0)
[03:07:29.815] Build status: STARTED
[03:07:29.815] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:4:0) after 2m48s
[03:10:17.835] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:4:0)
[03:10:17.864] Build status: STARTED
[03:10:17.864] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:5:0) after 6m38s
[03:16:55.897] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:5:0)
[03:16:55.928] Build status: STARTED
[03:16:55.928] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:6:0) after 1m26s
[03:18:22.064] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:6:0)
[03:18:22.104] Build status: STARTED
[03:18:22.104] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:7:0) after 2m52s
[03:21:14.112] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:7:0)
[03:21:14.112] Timer tick, asking Buildbucket for the build status
[03:21:14.194] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[03:21:14.194] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:8:0) after 1m0s
[03:22:14.267] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:8:0)
[03:22:14.267] Timer tick, asking Buildbucket for the build status
[03:22:14.336] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[03:22:14.336] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:9:0) after 1m0s
[03:23:14.424] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:9:0)
[03:23:14.450] Build status: STARTED
[03:23:14.450] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:10:0) after 8m43s
[03:31:57.658] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:10:0)
[03:31:57.658] Timer tick, asking Buildbucket for the build status
[03:31:57.767] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[03:31:57.767] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:11:0) after 1m0s
[03:32:57.837] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:11:0)
[03:32:57.837] Timer tick, asking Buildbucket for the build status
[03:32:58.059] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[03:32:58.059] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:12:0) after 1m0s
[03:33:58.234] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:12:0)
[03:33:58.267] Build status: STARTED
[03:33:58.267] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:13:0) after 5m34s
[03:39:32.391] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:13:0)
[03:39:32.391] Timer tick, asking Buildbucket for the build status
[03:39:32.659] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[03:39:32.659] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:14:0) after 1m0s
[03:40:32.681] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:14:0)
[03:40:32.707] Build status: STARTED
[03:40:32.707] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:15:0) after 8m59s
[03:49:31.735] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:15:0)
[03:49:31.735] Timer tick, asking Buildbucket for the build status
[03:49:32.314] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[03:49:32.314] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:16:0) after 1m0s
[03:50:32.345] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:16:0)
[03:50:32.345] Timer tick, asking Buildbucket for the build status
[03:50:32.526] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[03:50:32.526] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:17:0) after 1m0s
[03:51:32.599] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:17:0)
[03:51:32.599] Timer tick, asking Buildbucket for the build status
[03:51:32.718] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[03:51:32.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:18:0) after 1m0s
[03:52:32.743] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:18:0)
[03:52:32.743] Timer tick, asking Buildbucket for the build status
[03:52:32.821] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[03:52:32.821] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:19:0) after 1m0s
[03:53:32.970] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:19:0)
[03:53:32.970] Timer tick, asking Buildbucket for the build status
[03:53:33.203] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[03:53:33.203] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:20:0) after 1m0s
[03:54:33.328] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:20:0)
[03:54:33.360] Build status: STARTED
[03:54:33.360] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:21:0) after 5m22s
[03:59:55.499] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:21:0)
[03:59:55.499] Timer tick, asking Buildbucket for the build status
[03:59:55.618] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[03:59:55.618] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:22:0) after 1m0s
[04:00:55.646] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:22:0)
[04:00:55.684] Build status: STARTED
[04:00:55.684] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:23:0) after 4m26s
[04:05:21.792] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:23:0)
[04:05:21.792] Timer tick, asking Buildbucket for the build status
[04:05:22.070] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[04:05:22.070] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:24:0) after 1m0s
[04:06:22.108] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:24:0)
[04:06:22.108] Timer tick, asking Buildbucket for the build status
[04:06:22.169] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[04:06:22.169] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:25:0) after 1m0s
[04:07:22.199] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:25:0)
[04:07:22.226] Build status: STARTED
[04:07:22.226] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:26:0) after 6m0s
[04:13:22.252] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:26:0)
[04:13:22.252] Timer tick, asking Buildbucket for the build status
[04:13:22.356] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[04:13:22.356] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:27:0) after 1m0s
[04:14:22.369] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:27:0)
[04:14:22.369] Timer tick, asking Buildbucket for the build status
[04:14:22.456] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[04:14:22.456] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:28:0) after 1m0s
[04:15:22.581] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:28:0)
[04:15:22.581] Timer tick, asking Buildbucket for the build status
[04:15:22.746] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[04:15:22.746] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:29:0) after 1m0s
[04:16:22.774] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:29:0)
[04:16:22.774] Timer tick, asking Buildbucket for the build status
[04:16:22.915] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[04:16:22.915] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:30:0) after 1m0s
[04:17:23.265] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:30:0)
[04:17:23.265] Timer tick, asking Buildbucket for the build status
[04:17:23.494] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[04:17:23.494] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:31:0) after 1m0s
[04:18:23.590] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:31:0)
[04:18:23.590] Timer tick, asking Buildbucket for the build status
[04:18:23.656] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[04:18:23.656] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:32:0) after 1m0s
[04:19:23.854] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:32:0)
[04:19:23.884] Build status: STARTED
[04:19:23.884] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:33:0) after 8m40s
[04:28:03.910] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:33:0)
[04:28:03.910] Timer tick, asking Buildbucket for the build status
[04:28:04.071] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[04:28:04.071] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:34:0) after 1m0s
[04:29:04.190] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:34:0)
[04:29:04.228] Build status: STARTED
[04:29:04.228] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:35:0) after 8m18s
[04:37:22.254] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:35:0)
[04:37:22.282] Build status: STARTED
[04:37:22.282] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:36:0) after 3m45s
[04:41:07.311] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:36:0)
[04:41:07.341] Build status: STARTED
[04:41:07.341] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:37:0) after 7m42s
[04:48:49.396] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:37:0)
[04:48:49.424] Build status: STARTED
[04:48:49.424] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:38:0) after 7m53s
[04:56:42.457] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:38:0)
[04:56:42.457] Timer tick, asking Buildbucket for the build status
[04:56:42.618] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[04:56:42.618] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:39:0) after 1m0s
[04:57:42.706] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:39:0)
[04:57:42.706] Timer tick, asking Buildbucket for the build status
[04:57:42.898] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[04:57:42.898] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:40:0) after 1m0s
[04:58:42.930] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:40:0)
[04:58:42.930] Timer tick, asking Buildbucket for the build status
[04:58:43.019] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[04:58:43.019] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:41:0) after 1m0s
[04:59:43.058] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:41:0)
[04:59:43.058] Timer tick, asking Buildbucket for the build status
[04:59:43.288] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[04:59:43.288] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:42:0) after 1m0s
[05:00:43.316] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:42:0)
[05:00:43.316] Timer tick, asking Buildbucket for the build status
[05:00:43.511] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[05:00:43.511] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:43:0) after 1m0s
[05:01:43.747] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:43:0)
[05:01:43.774] Build status: STARTED
[05:01:43.774] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:44:0) after 6m21s
[05:08:05.069] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:44:0)
[05:08:05.104] Build status: STARTED
[05:08:05.104] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:45:0) after 9m12s
[05:17:17.226] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:45:0)
[05:17:17.226] Timer tick, asking Buildbucket for the build status
[05:17:17.325] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[05:17:17.325] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:46:0) after 1m0s
[05:18:17.480] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:46:0)
[05:18:17.524] Build status: STARTED
[05:18:17.524] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:47:0) after 4m55s
[05:23:12.733] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:47:0)
[05:23:12.733] Timer tick, asking Buildbucket for the build status
[05:23:13.193] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[05:23:13.193] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:48:0) after 1m0s
[05:24:13.223] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:48:0)
[05:24:13.223] Timer tick, asking Buildbucket for the build status
[05:24:13.344] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[05:24:13.344] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:49:0) after 1m0s
[05:25:13.383] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:49:0)
[05:25:13.414] Build status: STARTED
[05:25:13.414] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:50:0) after 1m49s
[05:27:02.454] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:50:0)
[05:27:02.454] Timer tick, asking Buildbucket for the build status
[05:27:02.549] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[05:27:02.549] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:51:0) after 1m0s
[05:28:02.591] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:51:0)
[05:28:02.656] Build status: STARTED
[05:28:02.657] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:52:0) after 6m33s
[05:34:35.698] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:52:0)
[05:34:35.739] Build status: STARTED
[05:34:35.739] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:53:0) after 2m42s
[05:37:17.905] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:53:0)
[05:37:17.905] Timer tick, asking Buildbucket for the build status
[05:37:17.976] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[05:37:17.976] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:54:0) after 1m0s
[05:38:18.144] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:54:0)
[05:38:18.168] Build status: STARTED
[05:38:18.168] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:55:0) after 3m18s
[05:41:36.297] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:55:0)
[05:41:36.297] Timer tick, asking Buildbucket for the build status
[05:41:36.446] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[05:41:36.446] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:56:0) after 1m0s
[05:42:36.516] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:56:0)
[05:42:36.539] Build status: STARTED
[05:42:36.539] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:57:0) after 8m40s
[05:51:16.618] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:57:0)
[05:51:16.642] Build status: STARTED
[05:51:16.642] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:58:0) after 6m50s
[05:58:07.039] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:58:0)
[05:58:07.039] Timer tick, asking Buildbucket for the build status
[05:58:07.193] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[05:58:07.193] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:59:0) after 1m0s
[05:59:07.318] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:59:0)
[05:59:07.340] Build status: STARTED
[05:59:07.340] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:60:0) after 5m38s
[06:04:45.392] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:60:0)
[06:04:45.392] Timer tick, asking Buildbucket for the build status
[06:04:45.677] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[06:04:45.677] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:61:0) after 1m0s
[06:05:45.713] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:61:0)
[06:05:45.713] Timer tick, asking Buildbucket for the build status
[06:05:45.779] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[06:05:45.779] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:62:0) after 1m0s
[06:06:45.803] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:62:0)
[06:06:45.827] Build status: STARTED
[06:06:45.827] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:63:0) after 3m33s
[06:10:18.876] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:63:0)
[06:10:18.917] Build status: STARTED
[06:10:18.917] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:64:0) after 6m18s
[06:16:37.010] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:64:0)
[06:16:37.040] Build status: STARTED
[06:16:37.040] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:65:0) after 5m20s
[06:21:57.067] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:65:0)
[06:21:57.091] Build status: STARTED
[06:21:57.091] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:66:0) after 6m26s
[06:28:23.218] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:66:0)
[06:28:23.248] Build status: STARTED
[06:28:23.248] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:67:0) after 5m42s
[06:34:05.346] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:67:0)
[06:34:05.377] Build status: STARTED
[06:34:05.377] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:68:0) after 9m21s
[06:43:27.449] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:68:0)
[06:43:27.472] Build status: STARTED
[06:43:27.472] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:69:0) after 3m2s
[06:46:29.600] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:69:0)
[06:46:29.600] Timer tick, asking Buildbucket for the build status
[06:46:29.757] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[06:46:29.757] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:70:0) after 1m0s
[06:47:29.786] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:70:0)
[06:47:29.811] Build status: STARTED
[06:47:29.811] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:71:0) after 8m8s
[06:55:37.923] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:71:0)
[06:55:37.923] Timer tick, asking Buildbucket for the build status
[06:55:38.003] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[06:55:38.003] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:72:0) after 1m0s
[06:56:38.165] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:72:0)
[06:56:38.165] Timer tick, asking Buildbucket for the build status
[06:56:38.229] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[06:56:38.229] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:73:0) after 1m0s
[06:57:38.369] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:73:0)
[06:57:38.426] Build status: STARTED
[06:57:38.426] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:74:0) after 9m35s
[07:07:13.731] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:74:0)
[07:07:13.771] Build status: STARTED
[07:07:13.771] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:75:0) after 4m44s
[07:11:57.799] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:75:0)
[07:11:57.799] Timer tick, asking Buildbucket for the build status
[07:11:57.873] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[07:11:57.873] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:76:0) after 1m0s
[07:12:57.952] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:76:0)
[07:12:57.952] Timer tick, asking Buildbucket for the build status
[07:12:58.023] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[07:12:58.023] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:77:0) after 1m0s
[07:13:58.130] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:77:0)
[07:13:58.156] Build status: STARTED
[07:13:58.156] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:78:0) after 5m52s
[07:19:50.236] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:78:0)
[07:19:50.266] Build status: STARTED
[07:19:50.266] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:79:0) after 7m50s
[07:27:40.395] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:79:0)
[07:27:40.395] Timer tick, asking Buildbucket for the build status
[07:27:40.487] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[07:27:40.487] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:80:0) after 1m0s
[07:28:40.518] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:80:0)
[07:28:40.518] Timer tick, asking Buildbucket for the build status
[07:28:40.583] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[07:28:40.583] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:81:0) after 1m0s
[07:29:40.631] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:81:0)
[07:29:40.631] Timer tick, asking Buildbucket for the build status
[07:29:40.775] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[07:29:40.776] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:82:0) after 1m0s
[07:30:40.885] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:82:0)
[07:30:40.885] Timer tick, asking Buildbucket for the build status
[07:30:41.041] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[07:30:41.041] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:83:0) after 1m0s
[07:31:41.070] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:83:0)
[07:31:41.070] Timer tick, asking Buildbucket for the build status
[07:31:41.190] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[07:31:41.190] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:84:0) after 1m0s
[07:32:41.222] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:84:0)
[07:32:41.247] Build status: STARTED
[07:32:41.247] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:85:0) after 4m6s
[07:36:47.371] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:85:0)
[07:36:47.371] Timer tick, asking Buildbucket for the build status
[07:36:47.576] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[07:36:47.576] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:86:0) after 1m0s
[07:37:47.895] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:86:0)
[07:37:47.895] Timer tick, asking Buildbucket for the build status
[07:37:47.985] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[07:37:47.985] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:87:0) after 1m0s
[07:38:48.354] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:87:0)
[07:38:48.405] Build status: STARTED
[07:38:48.405] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:88:0) after 4m15s
[07:43:03.446] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:88:0)
[07:43:03.446] Timer tick, asking Buildbucket for the build status
[07:43:03.723] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[07:43:03.723] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:89:0) after 1m0s
[07:44:03.819] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:89:0)
[07:44:03.819] Timer tick, asking Buildbucket for the build status
[07:44:03.938] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[07:44:03.938] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:90:0) after 1m0s
[07:45:04.294] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:90:0)
[07:45:04.294] Timer tick, asking Buildbucket for the build status
[07:45:04.587] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[07:45:04.587] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:91:0) after 1m0s
[07:46:05.254] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:91:0)
[07:46:05.254] Timer tick, asking Buildbucket for the build status
[07:46:05.325] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[07:46:05.325] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:92:0) after 1m0s
[07:47:05.493] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:92:0)
[07:47:05.548] Build status: STARTED
[07:47:05.548] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:93:0) after 7m43s
[07:54:48.691] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:93:0)
[07:54:48.720] Build status: STARTED
[07:54:48.720] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:94:0) after 4m26s
[07:59:14.835] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:94:0)
[07:59:14.835] Timer tick, asking Buildbucket for the build status
[07:59:14.913] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[07:59:14.913] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:95:0) after 1m0s
[08:00:14.995] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:95:0)
[08:00:14.995] Timer tick, asking Buildbucket for the build status
[08:00:15.132] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[08:00:15.132] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:96:0) after 1m0s
[08:01:15.410] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:96:0)
[08:01:15.437] Build status: STARTED
[08:01:15.437] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:97:0) after 7m32s
[08:08:47.465] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:97:0)
[08:08:47.497] Build status: STARTED
[08:08:47.497] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:98:0) after 6m19s
[08:15:06.532] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:98:0)
[08:15:06.559] Build status: STARTED
[08:15:06.559] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:99:0) after 2m28s
[08:17:34.590] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:99:0)
[08:17:34.590] Timer tick, asking Buildbucket for the build status
[08:17:34.667] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[08:17:34.667] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:100:0) after 1m0s
[08:18:34.828] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:100:0)
[08:18:34.853] Build status: STARTED
[08:18:34.853] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:101:0) after 6m35s
[08:25:09.899] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:101:0)
[08:25:09.899] Timer tick, asking Buildbucket for the build status
[08:25:10.046] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[08:25:10.046] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:102:0) after 1m0s
[08:26:10.080] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:102:0)
[08:26:10.114] Build status: STARTED
[08:26:10.114] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:103:0) after 2m41s
[08:28:51.249] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:103:0)
[08:28:51.280] Build status: STARTED
[08:28:51.280] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:104:0) after 5m40s
[08:34:31.364] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:104:0)
[08:34:31.364] Timer tick, asking Buildbucket for the build status
[08:34:31.451] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[08:34:31.451] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:105:0) after 1m0s
[08:35:31.481] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:105:0)
[08:35:31.481] Timer tick, asking Buildbucket for the build status
[08:35:31.551] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[08:35:31.551] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:106:0) after 1m0s
[08:36:31.695] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:106:0)
[08:36:31.723] Build status: STARTED
[08:36:31.723] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:107:0) after 1m40s
[08:38:11.761] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:107:0)
[08:38:11.791] Build status: STARTED
[08:38:11.791] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:108:0) after 4m11s
[08:42:22.845] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:108:0)
[08:42:22.845] Timer tick, asking Buildbucket for the build status
[08:42:22.988] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[08:42:22.988] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:109:0) after 1m0s
[08:43:23.017] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:109:0)
[08:43:23.017] Timer tick, asking Buildbucket for the build status
[08:43:23.145] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[08:43:23.145] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:110:0) after 1m0s
[08:44:23.177] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:110:0)
[08:44:23.177] Timer tick, asking Buildbucket for the build status
[08:44:23.276] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[08:44:23.276] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:111:0) after 1m0s
[08:45:23.269] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:111:0)
[08:45:23.292] Build status: STARTED
[08:45:23.293] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:112:0) after 7m30s
[08:52:53.372] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:112:0)
[08:52:53.372] Timer tick, asking Buildbucket for the build status
[08:52:53.541] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[08:52:53.541] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:113:0) after 1m0s
[08:53:53.567] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:113:0)
[08:53:53.592] Build status: STARTED
[08:53:53.592] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:114:0) after 9m33s
[09:03:26.622] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:114:0)
[09:03:26.622] Timer tick, asking Buildbucket for the build status
[09:03:26.765] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:03:26.765] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:115:0) after 1m0s
[09:04:26.894] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:115:0)
[09:04:26.894] Timer tick, asking Buildbucket for the build status
[09:04:26.966] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:04:26.966] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:116:0) after 1m0s
[09:05:26.993] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:116:0)
[09:05:27.038] Build status: STARTED
[09:05:27.038] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:117:0) after 3m3s
[09:08:30.073] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:117:0)
[09:08:30.073] Timer tick, asking Buildbucket for the build status
[09:08:30.621] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:08:30.621] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:118:0) after 1m0s
[09:09:30.648] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:118:0)
[09:09:30.648] Timer tick, asking Buildbucket for the build status
[09:09:30.719] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:09:30.720] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:119:0) after 1m0s
[09:10:30.806] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:119:0)
[09:10:30.838] Build status: STARTED
[09:10:30.838] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:120:0) after 7m53s
[09:18:23.964] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:120:0)
[09:18:23.965] Timer tick, asking Buildbucket for the build status
[09:18:24.065] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:18:24.065] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:121:0) after 1m0s
[09:19:24.150] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:121:0)
[09:19:24.181] Build status: STARTED
[09:19:24.181] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:122:0) after 6m22s
[09:25:46.351] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:122:0)
[09:25:46.351] Timer tick, asking Buildbucket for the build status
[09:25:46.460] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:25:46.460] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:123:0) after 1m0s
[09:26:46.542] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:123:0)
[09:26:46.542] Timer tick, asking Buildbucket for the build status
[09:26:46.601] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:26:46.601] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:124:0) after 1m0s
[09:27:46.627] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:124:0)
[09:27:46.653] Build status: STARTED
[09:27:46.653] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:125:0) after 4m30s
[09:32:16.778] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:125:0)
[09:32:16.807] Build status: STARTED
[09:32:16.807] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:126:0) after 1m20s
[09:33:36.886] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:126:0)
[09:33:36.914] Build status: STARTED
[09:33:36.914] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:127:0) after 4m28s
[09:38:05.014] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:127:0)
[09:38:05.045] Build status: STARTED
[09:38:05.045] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:128:0) after 6m38s
[09:44:43.031] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:128:0)
[09:44:43.059] Build status: STARTED
[09:44:43.059] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:129:0) after 5m57s
[09:50:40.087] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:129:0)
[09:50:40.129] Build status: STARTED
[09:50:40.129] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:130:0) after 7m1s
[09:57:41.157] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:130:0)
[09:57:41.182] Build status: STARTED
[09:57:41.182] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:131:0) after 9m28s
[10:07:09.223] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:131:0)
[10:07:09.223] Timer tick, asking Buildbucket for the build status
[10:07:09.317] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:07:09.317] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:132:0) after 1m0s
[10:08:09.447] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:132:0)
[10:08:09.476] Build status: STARTED
[10:08:09.476] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:133:0) after 8m9s
[10:16:18.490] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:133:0)
[10:16:18.490] Timer tick, asking Buildbucket for the build status
[10:16:18.721] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:16:18.721] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:134:0) after 1m0s
[10:17:18.754] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:134:0)
[10:17:18.754] Timer tick, asking Buildbucket for the build status
[10:17:18.952] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:17:18.952] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:135:0) after 1m0s
[10:18:18.983] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:135:0)
[10:18:19.047] Build status: STARTED
[10:18:19.047] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:136:0) after 3m58s
[10:22:17.077] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:136:0)
[10:22:17.077] Timer tick, asking Buildbucket for the build status
[10:22:17.276] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:22:17.276] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:137:0) after 1m0s
[10:23:17.319] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:137:0)
[10:23:17.319] Timer tick, asking Buildbucket for the build status
[10:23:17.390] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:23:17.390] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:138:0) after 1m0s
[10:24:17.827] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:138:0)
[10:24:17.827] Timer tick, asking Buildbucket for the build status
[10:24:18.294] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:24:18.294] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:139:0) after 1m0s
[10:25:18.325] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:139:0)
[10:25:18.325] Timer tick, asking Buildbucket for the build status
[10:25:18.583] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:25:18.583] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:140:0) after 1m0s
[10:26:18.693] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:140:0)
[10:26:18.718] Build status: STARTED
[10:26:18.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:141:0) after 6m9s
[10:32:27.780] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:141:0)
[10:32:27.807] Build status: STARTED
[10:32:27.807] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:142:0) after 8m14s
[10:40:42.074] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:142:0)
[10:40:42.108] Build status: STARTED
[10:40:42.108] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:143:0) after 5m6s
[10:45:48.923] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:143:0)
[10:45:48.967] Build status: STARTED
[10:45:48.967] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:144:0) after 1m3s
[10:46:51.994] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:144:0)
[10:46:51.994] Timer tick, asking Buildbucket for the build status
[10:46:52.152] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:46:52.152] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:145:0) after 1m0s
[10:47:52.279] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:145:0)
[10:47:52.308] Build status: STARTED
[10:47:52.308] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:146:0) after 7m39s
[10:55:31.332] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:146:0)
[10:55:31.361] Build status: STARTED
[10:55:31.361] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:147:0) after 3m56s
[10:59:27.521] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:147:0)
[10:59:27.521] Timer tick, asking Buildbucket for the build status
[10:59:27.615] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:59:27.615] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:148:0) after 1m0s
[11:00:27.806] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:148:0)
[11:00:27.806] Timer tick, asking Buildbucket for the build status
[11:00:27.870] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[11:00:27.870] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:149:0) after 1m0s
[11:01:28.112] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:149:0)
[11:01:28.137] Build status: STARTED
[11:01:28.137] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:150:0) after 5m49s
[11:07:17.169] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:150:0)
[11:07:17.169] Timer tick, asking Buildbucket for the build status
[11:07:17.249] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[11:07:17.249] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:151:0) after 1m0s
[11:08:17.281] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:151:0)
[11:08:17.281] Timer tick, asking Buildbucket for the build status
[11:08:17.979] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[11:08:17.979] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:152:0) after 1m0s
[11:09:18.165] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:152:0)
[11:09:18.165] Timer tick, asking Buildbucket for the build status
[11:09:18.240] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[11:09:18.240] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:153:0) after 1m0s
[11:10:18.272] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:153:0)
[11:10:18.272] Timer tick, asking Buildbucket for the build status
[11:10:18.369] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[11:10:18.369] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:154:0) after 1m0s
[11:11:18.405] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:154:0)
[11:11:18.405] Timer tick, asking Buildbucket for the build status
[11:11:18.665] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[11:11:18.665] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:155:0) after 1m0s
[11:12:18.709] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:155:0)
[11:12:18.738] Build status: STARTED
[11:12:18.738] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:156:0) after 8m33s
[11:20:51.766] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:156:0)
[11:20:51.766] Timer tick, asking Buildbucket for the build status
[11:20:51.908] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[11:20:51.908] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:157:0) after 1m0s
[11:21:51.940] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:157:0)
[11:21:51.940] Timer tick, asking Buildbucket for the build status
[11:21:52.300] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[11:21:52.300] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:158:0) after 1m0s
[11:22:52.436] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:158:0)
[11:22:52.461] Build status: STARTED
[11:22:52.461] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:159:0) after 4m34s
[11:27:26.501] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:159:0)
[11:27:26.501] Timer tick, asking Buildbucket for the build status
[11:27:26.641] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[11:27:26.641] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:160:0) after 1m0s
[11:28:26.724] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:160:0)
[11:28:26.758] Build status: STARTED
[11:28:26.758] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:161:0) after 9m40s
[11:38:07.018] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:161:0)
[11:38:07.050] Build status: STARTED
[11:38:07.050] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:162:0) after 2m8s
[11:40:15.288] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:162:0)
[11:40:15.316] Build status: STARTED
[11:40:15.316] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:163:0) after 5m44s
[11:45:59.353] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:163:0)
[11:45:59.353] Timer tick, asking Buildbucket for the build status
[11:45:59.427] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[11:45:59.427] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:164:0) after 1m0s
[11:46:59.456] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:164:0)
[11:46:59.456] Timer tick, asking Buildbucket for the build status
[11:46:59.530] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[11:46:59.530] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:165:0) after 1m0s
[11:47:59.568] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:165:0)
[11:47:59.595] Build status: STARTED
[11:47:59.595] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:166:0) after 8m22s
[11:56:21.626] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:166:0)
[11:56:21.626] Timer tick, asking Buildbucket for the build status
[11:56:21.735] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[11:56:21.735] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:167:0) after 1m0s
[11:57:21.837] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:167:0)
[11:57:21.862] Build status: STARTED
[11:57:21.862] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:168:0) after 5m18s
[12:02:40.023] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:168:0)
[12:02:40.050] Build status: STARTED
[12:02:40.050] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:169:0) after 3m59s
[12:06:39.079] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:169:0)
[12:06:39.105] Build status: STARTED
[12:06:39.105] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:170:0) after 7m46s
[12:14:25.361] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:170:0)
[12:14:25.387] Build status: STARTED
[12:14:25.387] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:171:0) after 9m44s
[12:24:09.417] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:171:0)
[12:24:09.442] Build status: STARTED
[12:24:09.443] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:172:0) after 8m38s
[12:32:47.631] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:172:0)
[12:32:47.631] Timer tick, asking Buildbucket for the build status
[12:32:47.715] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[12:32:47.715] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:173:0) after 1m0s
[12:33:47.810] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:173:0)
[12:33:47.810] Timer tick, asking Buildbucket for the build status
[12:33:47.988] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[12:33:47.988] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:174:0) after 1m0s
[12:34:48.044] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:174:0)
[12:34:48.068] Build status: STARTED
[12:34:48.068] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:175:0) after 4m53s
[12:39:41.106] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:175:0)
[12:39:41.147] Build status: STARTED
[12:39:41.147] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:176:0) after 3m36s
[12:43:17.355] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:176:0)
[12:43:17.382] Build status: STARTED
[12:43:17.382] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:177:0) after 9m4s
[12:52:21.441] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:177:0)
[12:52:21.441] Timer tick, asking Buildbucket for the build status
[12:52:21.526] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[12:52:21.526] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:178:0) after 1m0s
[12:53:21.961] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:178:0)
[12:53:21.987] Build status: STARTED
[12:53:21.987] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:179:0) after 4m40s
[12:58:02.480] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:179:0)
[12:58:02.480] Timer tick, asking Buildbucket for the build status
[12:58:02.575] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[12:58:02.575] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:180:0) after 1m0s
[12:59:02.663] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:180:0)
[12:59:02.663] Timer tick, asking Buildbucket for the build status
[12:59:02.941] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[12:59:02.941] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:181:0) after 1m0s
[13:00:02.976] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:181:0)
[13:00:02.976] Timer tick, asking Buildbucket for the build status
[13:00:03.067] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[13:00:03.067] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:182:0) after 1m0s
[13:01:03.326] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:182:0)
[13:01:03.353] Build status: STARTED
[13:01:03.353] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:183:0) after 1m30s
[13:02:33.417] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:183:0)
[13:02:33.417] Timer tick, asking Buildbucket for the build status
[13:02:33.510] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[13:02:33.510] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:184:0) after 1m0s
[13:03:33.976] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:184:0)
[13:03:34.002] Build status: STARTED
[13:03:34.002] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:185:0) after 4m24s
[13:07:58.693] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:185:0)
[13:07:58.693] Timer tick, asking Buildbucket for the build status
[13:07:59.057] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[13:07:59.057] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:186:0) after 1m0s
[13:08:59.119] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:186:0)
[13:08:59.150] Build status: STARTED
[13:08:59.150] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:187:0) after 4m23s
[13:13:22.196] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:187:0)
[13:13:22.197] Timer tick, asking Buildbucket for the build status
[13:13:22.333] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[13:13:22.333] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:188:0) after 1m0s
[13:14:22.384] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:188:0)
[13:14:22.447] Build status: STARTED
[13:14:22.447] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:189:0) after 3m55s
[13:18:17.477] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:189:0)
[13:18:17.477] Timer tick, asking Buildbucket for the build status
[13:18:17.563] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[13:18:17.563] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:190:0) after 1m0s
[13:19:17.710] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:190:0)
[13:19:17.736] Build status: STARTED
[13:19:17.736] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:191:0) after 2m9s
[13:21:26.765] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:191:0)
[13:21:26.790] Build status: STARTED
[13:21:26.790] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:192:0) after 4m57s
[13:26:23.824] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:192:0)
[13:26:23.824] Timer tick, asking Buildbucket for the build status
[13:26:23.927] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[13:26:23.927] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:193:0) after 1m0s
[13:27:23.962] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:193:0)
[13:27:23.962] Timer tick, asking Buildbucket for the build status
[13:27:24.182] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[13:27:24.182] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:194:0) after 1m0s
[13:28:24.211] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:194:0)
[13:28:24.264] Build status: STARTED
[13:28:24.264] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:195:0) after 7m52s
[13:36:16.295] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:195:0)
[13:36:16.347] Build status: STARTED
[13:36:16.347] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:196:0) after 1m39s
[13:37:55.378] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:196:0)
[13:37:55.425] Build status: STARTED
[13:37:55.425] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:197:0) after 2m10s
[13:40:05.493] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:197:0)
[13:40:05.493] Timer tick, asking Buildbucket for the build status
[13:40:05.775] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[13:40:05.775] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:198:0) after 1m0s
[13:41:06.143] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:198:0)
[13:41:06.143] Timer tick, asking Buildbucket for the build status
[13:41:06.216] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[13:41:06.216] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:199:0) after 1m0s
[13:42:06.312] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:199:0)
[13:42:06.312] Timer tick, asking Buildbucket for the build status
[13:42:06.434] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[13:42:06.434] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:200:0) after 1m0s
[13:43:25.435] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:200:0)
[13:43:25.435] Timer tick, asking Buildbucket for the build status
[13:43:25.523] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[13:43:25.523] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:201:0) after 1m0s
[13:44:25.551] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:201:0)
[13:44:25.551] Timer tick, asking Buildbucket for the build status
[13:44:25.696] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[13:44:25.696] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:202:0) after 1m0s
[13:45:25.796] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:202:0)
[13:45:25.822] Build status: STARTED
[13:45:25.822] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:203:0) after 1m27s
[13:46:52.876] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:203:0)
[13:46:52.914] Build status: STARTED
[13:46:52.914] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:204:0) after 5m44s
[13:52:37.081] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:204:0)
[13:52:37.081] Timer tick, asking Buildbucket for the build status
[13:52:37.157] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[13:52:37.157] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:205:0) after 1m0s
[13:53:37.196] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:205:0)
[13:53:37.224] Build status: STARTED
[13:53:37.225] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:206:0) after 6m44s
[14:00:21.304] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:206:0)
[14:00:21.304] Timer tick, asking Buildbucket for the build status
[14:00:21.441] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[14:00:21.441] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:207:0) after 1m0s
[14:01:21.528] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:207:0)
[14:01:21.564] Build status: STARTED
[14:01:21.564] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:208:0) after 6m2s
[14:07:23.569] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:208:0)
[14:07:23.569] Timer tick, asking Buildbucket for the build status
[14:07:23.673] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[14:07:23.673] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:209:0) after 1m0s
[14:08:23.946] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:209:0)
[14:08:23.946] Timer tick, asking Buildbucket for the build status
[14:08:24.108] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[14:08:24.108] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:210:0) after 1m0s
[14:09:24.173] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:210:0)
[14:09:24.173] Timer tick, asking Buildbucket for the build status
[14:09:24.252] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[14:09:24.252] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:211:0) after 1m0s
[14:10:24.292] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:211:0)
[14:10:24.292] Timer tick, asking Buildbucket for the build status
[14:10:24.389] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[14:10:24.389] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:212:0) after 1m0s
[14:11:24.426] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:212:0)
[14:11:24.453] Build status: STARTED
[14:11:24.453] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:213:0) after 2m1s
[14:13:25.510] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:213:0)
[14:13:25.510] Timer tick, asking Buildbucket for the build status
[14:13:25.806] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[14:13:25.806] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:214:0) after 1m0s
[14:14:25.841] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:214:0)
[14:14:25.841] Timer tick, asking Buildbucket for the build status
[14:14:25.928] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[14:14:25.928] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:215:0) after 1m0s
[14:15:25.967] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:215:0)
[14:15:25.967] Timer tick, asking Buildbucket for the build status
[14:15:26.049] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[14:15:26.049] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:216:0) after 1m0s
[14:16:26.080] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:216:0)
[14:16:26.080] Timer tick, asking Buildbucket for the build status
[14:16:26.169] Build 8852275129809282336: status "STARTED", result "", failure_reason "", cancelation_reason ""
[14:16:26.169] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:217:0) after 1m0s
[14:17:26.199] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:217:0)
[14:17:26.234] Build status: STARTED
[14:17:26.234] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017705191973862416:218:0) after 5m16s
[14:19:07.513] Received PubSub notification, asking Buildbucket for the build status
[14:19:07.605] Build 8852275129809282336: status "COMPLETED", result "FAILURE", failure_reason "BUILD_FAILURE", cancelation_reason ""
[14:19:07.605] Buildbucket build:
{
"build": {
"bucket": "luci.chromium.ci",
"canary_preference": "PROD",
"completed_ts": "1616249947012718",
"created_by": "project:chromium",
"created_ts": "1616209589147016",
"failure_reason": "BUILD_FAILURE",
"id": "8852275129809282336",
"parameters_json": "{\"builder_name\": \"ToTMacASan\", \"properties\": {\"branch\": \"refs/heads/master\", \"repository\": \"https://chromium.googlesource.com/chromium/src\", \"revision\": \"57524c8161ed7bf736a488b2dbaf84d5482f3e89\"}}",
"project": "chromium",
"result": "FAILURE",
"result_details_json": "{\"error\": {\"message\": \"3 Test Suite(s) failed.\\n\\n**content_browsertests** failed because of:\\n\\n- All/PrerenderBrowserTest.MojoCapabilityControl_CancelMainFrame/WebContents\\n\\n- All/SitePerProcessBrowserTest.SubframePostMessage/1\\n\\n- All/WebRtcImageCaptureSucceedsBrowserTest.ManipulatePan/0\\n\\n- All/SitePerProcessBrowserTest.OpenUnsandboxedPopupFromSandboxedFrame/1\\n\\n- ...1123 more failure(s) (1127 total)...\\n\\n**browser_tests** failed because of:\\n\\n- TabManagerTest.AutoDiscardable\\n\\n- HistoryCounterTest.PrefChanged\\n\\n- TabStripBrowsertest.MoveTabFirst_DoesNotAddToGroup\\n\\n- SafeBrowsingBlockingPageBrowserTestWithThreatTypeAndIsolationSetting/SafeBrowsingBlockingPageBrowserTest.VerifyHitReportSentOnSBERAndNotIncognito/3\\n\\n- ...11681 more failure(s) (11685 total)...\\n\\n#### ...1 more test(s)...\"}, \"properties\": {\"$build/goma\": {\"use_luci_auth\": true}, \"$recipe_engine/isolated\": {\"server\": \"https://isolateserver.appspot.com\"}, \"$recipe_engine/milo/blamelist_pins\": [{\"host\": \"chromium.googlesource.com\", \"id\": \"57524c8161ed7bf736a488b2dbaf84d5482f3e89\", \"project\": \"chromium/src\"}], \"$recipe_engine/path\": {\"cache_dir\": \"/opt/s/w/ir/cache\", \"temp_dir\": \"/opt/s/w/ir/tmp/rt\"}, \"$recipe_engine/runtime\": {\"is_experimental\": false, \"is_luci\": true}, \"bot_id\": \"build227-m9\", \"branch\": \"refs/heads/master\", \"builder_group\": \"chromium.clang\", \"buildername\": \"ToTMacASan\", \"buildnumber\": 24656, \"clang_revision\": \"llvmorg-13-init-5020-gfe5f4c39-0\", \"got_angle_revision\": \"d5bc8a27abec7e86ea555f816e6dfa3947a2ffa5\", \"got_dawn_revision\": \"682f32af32aea8e40775ec56b4e25ab7aaea1c28\", \"got_nacl_revision\": \"abf3277f295c6c87f0b103f291ed5e3e73933b76\", \"got_revision\": \"57524c8161ed7bf736a488b2dbaf84d5482f3e89\", \"got_revision_cp\": \"refs/heads/master@{#864921}\", \"got_swarming_client_revision\": \"a32a1607f6093d338f756c7e7c7b4333b0c50c9c\", \"got_swiftshader_revision\": \"a98fb3f8380a3a5c9ae3e0175634ba88c85a434f\", \"got_v8_revision\": \"66377e9eee38ae5d2bec601ec40a6e7e792169bf\", \"got_v8_revision_cp\": \"refs/heads/9.1.169@{#1}\", \"got_webrtc_revision\": \"490c1503d92696894e9c88c2a40a24ed78abe0a8\", \"got_webrtc_revision_cp\": \"refs/heads/master@{#33510}\", \"is_cached\": true, \"isolate_server\": \"https://isolateserver.appspot.com\", \"path_config\": \"generic\", \"perf_dashboard_machine_group\": \"ChromiumClang\", \"recipe\": \"chromium\", \"repository\": \"https://chromium.googlesource.com/chromium/src\", \"revision\": \"57524c8161ed7bf736a488b2dbaf84d5482f3e89\", \"swarm_hashes_refs/heads/master(at){#864921}_without_patch\": {\"absl_hardening_tests\": \"2646cccaf4983e40719870bdd00003273af65542\", \"accessibility_unittests\": \"b92ef3738ec59c1a4037af53ca6b5fe34bd09ca3\", \"angle_unittests\": \"34d1b7b5bcac8ec1d11dcab2426228c0efa58975\", \"app_shell_unittests\": \"a9208aa52c6b86559943410f018fba14075331c0\", \"base_unittests\": \"2d988c24855a9480bf346c1f3e96e131c0a6645f\", \"base_util_unittests\": \"35ca8c31618766548b7eace1724011766eabb8bb\", \"blink_common_unittests\": \"1a76c54eb46a6591a7946b736dfb8fdeb7ef826b\", \"blink_fuzzer_unittests\": \"d77cdbeb7a4457356f43bb64a42a0fc8bb9418df\", \"blink_heap_unittests\": \"78d58dbadf2c44d76951a721ba26d6e5cf166573\", \"blink_platform_unittests\": \"46ffeb120d80b9132d2f2d00b9ae9fa5eabe8f99\", \"blink_unittests\": \"0ede1fec3d6cc7f17dcc976c7af627f32db84490\", \"boringssl_crypto_tests\": \"30ec018b99b795f4af37118245fa72bf1364fe3e\", \"boringssl_ssl_tests\": \"4b21a078a9e7b9c7d72f8dc035c9bc2309295a0d\", \"browser_tests\": \"e45bc50f20540404034cd9c2bb800d3f09ff6c88\", \"capture_unittests\": \"0f1287809487d1cd547879cd8368a5729027e371\", \"cast_unittests\": \"fd4e422a1e4209da7c47d85ba84ee343b464cad0\", \"cc_unittests\": \"18ccf15fb352edee76052303d3e6ba1612a42672\", \"chrome_app_unittests\": \"c2560d768260d88467cefb44613c20fc8ab58a16\", \"chromedriver_unittests\": \"fa878d0d5f7ca5c939748f6fcd50f9277bb5f37f\", \"color_unittests\": \"c6b198b40394fae3547e7ec56ba102230b93de75\", \"components_browsertests\": \"310d2b1376bfb998bf4000bdc896bd2463499a16\", \"components_unittests\": \"78eb8303a463ce3b0d80e1bff20765be7671eb25\", \"content_browsertests\": \"7ee2b3d42b3044acaef8150fe3a51f1ac6a6d9a9\", \"content_nocompile_tests\": \"5c1ee04b9c005b42711634c5fa060a3c417e4deb\", \"content_unittests\": \"fb0676c0a28672454f9295cef77dcae7a11744b3\", \"crashpad_tests\": \"cb60853369490e4549f0e3a0473510fe9d57250c\", \"cronet_tests\": \"f06704a62ed40bd8570f4d7a0c7b03c825a72a16\", \"cronet_unittests\": \"a96633cacd239284eaf5a69bb3c0b064edbd4d62\", \"crypto_unittests\": \"61f6f7dafc074beb40c7cb15976b30f0e95859c1\", \"device_unittests\": \"7c0d5abca31373bf76f782c1f9b5b4fd781b2134\", \"display_unittests\": \"3ebc0f4ea432c21563f372d0e1fa183835ead537\", \"events_unittests\": \"acfbe40ec987cabbe234c038532620f7bb18d3fb\", \"extensions_browsertests\": \"a5332a5455cd43a3d0b10a2a105b6992f1ad4fb1\", \"extensions_unittests\": \"173ed926dc3339af5f4c5abf3402c54238854b9a\", \"filesystem_service_unittests\": \"2fa9bac642e79aa6cbdb89992b9b267ba8b767f8\", \"gcm_unit_tests\": \"b36e4d072b36ac4c1afef6ecba9097c130bb863a\", \"gfx_unittests\": \"c1cb6113388455c255a7f3dfe21e846067c09fff\", \"gin_unittests\": \"eb1bcdd43a7294c066b0bee94a221fb3e721f28a\", \"google_apis_unittests\": \"b4a32df2ca8ed801fd98109369517b7277d3ae8e\", \"gpu_unittests\": \"dad4f5f0289194c2b6a8756e8aeb40a15b25cb5d\", \"gwp_asan_unittests\": \"6b13306d5ababdf4a4e88d14483c78fe2d153d0c\", \"headless_browsertests\": \"eb1a194002642a254559d480a895583151bcaeba\", \"headless_unittests\": \"cea39e8fc0363173037da7b8ae0e9f4494e9101e\", \"interactive_ui_tests\": \"63ee3088ce97cf0123c53a45212d771f6366388b\", \"ipc_tests\": \"89a1d8d1c7cc0a1472b2e325eec38e49b968ec5d\", \"jingle_unittests\": \"59c1e56bb1862ac345cd9386d8d5c0d97a8b84e9\", \"latency_unittests\": \"8af47658eb5c10a836a3e7dfa87de963d595ed79\", \"libjingle_xmpp_unittests\": \"7b956ddd82aebf2aed3c1840505d68b2dae05927\", \"liburlpattern_unittests\": \"06b3fc83ba8a53570f6bc4e1d54a1973dbcdc7e3\", \"media_blink_unittests\": \"5773c827e63350e5a6068cb4a0fd80dd1cee3323\", \"media_unittests\": \"a50ddd788b376db0336f71ef9cc919696e714467\", \"message_center_unittests\": \"7b575403d5050b202a93a96a518273a111048848\", \"midi_unittests\": \"1ea3972a093365c013f66053b4ea248ed66b720d\", \"mojo_unittests\": \"bbbe004bc82a45955bb61bf39874814a1f3a11db\", \"native_theme_unittests\": \"0beccbd79c58899a42d805832a875390eb1c4aa2\", \"net_unittests\": \"a863f592b0bc3e174d1026dc393ab9c97cb21a4a\", \"openscreen_unittests\": \"bcb660721a61db6d52ee0fc43477528f65f64efa\", \"pdf_unittests\": \"5d5aafb091b5eb3fbf6324507e22de3fb5941e72\", \"perfetto_unittests\": \"a5ed5cbd6de5755b3621c6cdd001bd320d240bb3\", \"ppapi_unittests\": \"63ebe18d086be43fa752c7e71830fb154b233090\", \"printing_unittests\": \"bbe15b168a827ede37f3859ba04f1b26bada3418\", \"remoting_unittests\": \"0d5535b8b3b293d4e8403ca5ce566a50e1c06933\", \"sandbox_mac_unittests\": \"dff8d17fcf6895684a17cd694fee6583c541fc92\", \"service_manager_unittests\": \"582d5c782f58e46dcd0dd97bf01c594e11eaa9f4\", \"services_unittests\": \"0f86f1d1322bc5b3c6458a04167a7baf3ddf8c04\", \"shell_dialogs_unittests\": \"d55bf295f07b099468696f8e1c1f6f7b9daa5feb\", \"skia_unittests\": \"5d04d4a2be19062547f879fe528d0616858aaea7\", \"snapshot_unittests\": \"0aea53457be9aa945336e2df89f2b50c180a14a1\", \"sql_unittests\": \"179cff4c78130f625907f5b294cdc219a2ad69f2\", \"storage_unittests\": \"3e678ab63cf366e8fd0b624e77fbf25d7d0dc560\", \"sync_integration_tests\": \"748b698bca6da231b58309565b4cbfca0894c186\", \"ui_base_unittests\": \"a17045862c4e93b9c28c35585a26e7739bf5c03c\", \"ui_touch_selection_unittests\": \"e43bd47644d4dc8c1672c35ba871a19c83f4393b\", \"unit_tests\": \"5de0699dbef7b3f91eaad817250a6d4d12dac2c4\", \"updater_tests\": \"25496d0aa06a91a51fe49339824f4e34ad7087b3\", \"url_unittests\": \"44ed74a520d15cacfdb259c3f307d0f735aa4a5d\", \"views_unittests\": \"afe444ad32212a5d963de24729f833cc843e2539\", \"viz_unittests\": \"b2fa6b5dae52548ca0b74258b1d684a205beb1cb\", \"wtf_unittests\": \"35ab3e1a0e18598d2e866567d658bb0af19b37d5\", \"xr_browser_tests\": \"69072c0e637ebdb27a0544fa6ef2b7c0b57c1554\", \"zlib_unittests\": \"1e0250f2c946ec45abf2a6e470ef427bc83ffbe7\"}, \"xcode_build_version\": \"12d4e\"}, \"swarming\": {\"bot_dimensions\": {\"builderless\": [\"1\"], \"caches\": [\"builder_0c96c161cf7dd2e1c2b922319da904a0c0164c4adceed5a8844a45f1c516ad13_v2\", \"builder_35788ef09d8eae7507b346e2b8d132d76f2bde09fc8050ac1251d555c07cf94e_v2\", \"builder_5372538a354f163a20d332d881c6c5d85e35654ac8a57c760866f12033f8a8a5_v2\", \"builder_69caa34b8f39daac28a821cac2619730401d46a6479812cc34796e3bf180418a_v2\", \"builder_a165fbc5f77948fe8465d1f67a1e4a103f195e4f29767b5fac0876e41f78e10e_v2\", \"builder_a6b7812892ce2803c2af7edd05905c93375f7b9beeb5faec870a74a927aae8ee_v2\", \"builder_d42b89eab403033f5a2a8102ec9c436397350cedb439d5e09b11874a5784adb4_v2\", \"git\", \"goma_v2\", \"vpython\"], \"cores\": [\"24\"], \"cpu\": [\"x86\", \"x86-64\", \"x86-64-E5-2697_v2\"], \"gce\": [\"0\"], \"gpu\": [\"1002\", \"1002:679e\", \"1002:679e-4.0.11-3.2.8\"], \"hidpi\": [\"0\"], \"id\": [\"build227-m9\"], \"mac_model\": [\"MacPro6,1\"], \"machine_type\": [\"n1-standard-16\"], \"os\": [\"Mac\", \"Mac-10\", \"Mac-10.15\", \"Mac-10.15.7\", \"Mac-10.15.7-19H2\"], \"pool\": [\"luci.chromium.ci\"], \"python\": [\"2\", \"2.7\", \"2.7.16\"], \"server_version\": [\"5776-cb9e157\"], \"ssd\": [\"1\"], \"zone\": [\"us\", \"us-atl\", \"us-atl-golo\", \"us-atl-golo-m9\"]}}, \"ui\": {\"info\": \"3 Test Suite(s) failed.\\n\\n**content_browsertests** failed because of:\\n\\n- All/PrerenderBrowserTest.MojoCapabilityControl_CancelMainFrame/WebContents\\n\\n- All/SitePerProcessBrowserTest.SubframePostMessage/1\\n\\n- All/WebRtcImageCaptureSucceedsBrowserTest.ManipulatePan/0\\n\\n- All/SitePerProcessBrowserTest.OpenUnsandboxedPopupFromSandboxedFrame/1\\n\\n- ...1123 more failure(s) (1127 total)...\\n\\n**browser_tests** failed because of:\\n\\n- TabManagerTest.AutoDiscardable\\n\\n- HistoryCounterTest.PrefChanged\\n\\n- TabStripBrowsertest.MoveTabFirst_DoesNotAddToGroup\\n\\n- SafeBrowsingBlockingPageBrowserTestWithThreatTypeAndIsolationSetting/SafeBrowsingBlockingPageBrowserTest.VerifyHitReportSentOnSBERAndNotIncognito/3\\n\\n- ...11681 more failure(s) (11685 total)...\\n\\n#### ...1 more test(s)...\"}}",
"service_account": "chromium-ci-builder@chops-service-accounts.iam.gserviceaccount.com",
"started_ts": "1616209623931986",
"status": "COMPLETED",
"status_changed_ts": "1616209624497440",
"tags": [
"build_address:luci.chromium.ci/ToTMacASan/24656",
"builder:ToTMacASan",
"buildset:commit/git/57524c8161ed7bf736a488b2dbaf84d5482f3e89",
"buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/57524c8161ed7bf736a488b2dbaf84d5482f3e89",
"gitiles_ref:refs/heads/master",
"scheduler_invocation_id:9017705191973862416",
"scheduler_job_id:chromium/ToTMacASan",
"swarming_hostname:chromium-swarm.appspot.com",
"swarming_tag:log_location:logdog://logs.chromium.org/chromium/buildbucket/cr-buildbucket.appspot.com/8852275129809282336/+/annotations",
"swarming_tag:luci_project:chromium",
"swarming_tag:os:Mac",
"swarming_tag:recipe_name:chromium",
"swarming_tag:recipe_package:infra/recipe_bundles/chromium.googlesource.com/chromium/tools/build",
"swarming_task_id:52666abe305eb010",
"user_agent:luci-scheduler"
],
"updated_ts": "1616249947013127",
"url": "https://ci.chromium.org/b/8852275129809282336",
"utcnow_ts": "1616249947588446"
}
}
[14:19:07.605] Invocation finished in 11h12m39.905447015s with status FAILED