[08:53:30.787] New invocation is queued and will start shortly
[08:53:32.739] Starting the invocation (attempt 1)
[08:53:32.777] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[08:53:32.778] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[08:53:32.778] Buildbucket request:
{
"bucket": "luci.chromium.ci",
"client_operation_id": "9062347661843419920",
"parameters_json": "{\"builder_name\":\"ToTLinuxASan\",\"properties\":{\"branch\":\"refs/heads/master\",\"repository\":\"https://chromium.googlesource.com/chromium/src\",\"revision\":\"aa0ddde04b14d0361d74b78c4d091d70bbebee93\"}}",
"pubsub_callback": {
"auth_token": "...",
"topic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
},
"tags": [
"builder:ToTLinuxASan",
"scheduler_invocation_id:9062347661843419920",
"scheduler_job_id:chromium/ToTLinuxASan",
"user_agent:luci-scheduler",
"buildset:commit/git/aa0ddde04b14d0361d74b78c4d091d70bbebee93",
"buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/aa0ddde04b14d0361d74b78c4d091d70bbebee93",
"gitiles_ref:refs/heads/master"
]
}
[08:53:34.704] Buildbucket response:
{
"build": {
"bucket": "luci.chromium.ci",
"canary_preference": "PROD",
"created_by": "project:chromium",
"created_ts": "1573635213398090",
"id": "8896917598434095408",
"parameters_json": "{\"builder_name\": \"ToTLinuxASan\", \"properties\": {\"branch\": \"refs/heads/master\", \"repository\": \"https://chromium.googlesource.com/chromium/src\", \"revision\": \"aa0ddde04b14d0361d74b78c4d091d70bbebee93\"}}",
"project": "chromium",
"result_details_json": "{\"properties\": {}}",
"service_account": "chromium-ci-builder@chops-service-accounts.iam.gserviceaccount.com",
"status": "SCHEDULED",
"status_changed_ts": "1573635214442880",
"tags": [
"build_address:luci.chromium.ci/ToTLinuxASan/8333",
"builder:ToTLinuxASan",
"buildset:commit/git/aa0ddde04b14d0361d74b78c4d091d70bbebee93",
"buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/aa0ddde04b14d0361d74b78c4d091d70bbebee93",
"gitiles_ref:refs/heads/master",
"scheduler_invocation_id:9062347661843419920",
"scheduler_job_id:chromium/ToTLinuxASan",
"swarming_hostname:chromium-swarm.appspot.com",
"swarming_tag:log_location:logdog://logs.chromium.org/chromium/buildbucket/cr-buildbucket.appspot.com/8896917598434095408/+/annotations",
"swarming_tag:luci_project:chromium",
"swarming_tag:recipe_name:chromium",
"swarming_tag:recipe_package:infra/recipe_bundles/chromium.googlesource.com/chromium/tools/build",
"swarming_task_id:",
"user_agent:luci-scheduler"
],
"updated_ts": "1573635214443015",
"url": "https://ci.chromium.org/b/8896917598434095408",
"utcnow_ts": "1573635214684865"
}
}
[08:53:34.704] Task URL: https://ci.chromium.org/b/8896917598434095408
[08:53:34.704] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:2:0) after 1m0s
[08:54:37.213] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:2:0)
[08:54:37.213] Timer tick, asking Buildbucket for the build status
[08:54:37.697] Build 8896917598434095408: status "SCHEDULED", result "", failure_reason "", cancelation_reason ""
[08:54:37.697] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:3:0) after 1m0s
[08:54:51.903] Received PubSub notification, asking Buildbucket for the build status
[08:54:52.193] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[08:55:37.708] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:3:0)
[08:55:37.708] Timer tick, asking Buildbucket for the build status
[08:55:38.428] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[08:55:38.428] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:5:0) after 1m0s
[08:56:38.447] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:5:0)
[08:56:38.447] Timer tick, asking Buildbucket for the build status
[08:56:42.783] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[08:56:42.783] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:6:0) after 1m0s
[08:57:42.880] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:6:0)
[08:57:42.880] Timer tick, asking Buildbucket for the build status
[08:57:43.389] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[08:57:43.389] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:7:0) after 1m0s
[08:58:43.468] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:7:0)
[08:58:43.468] Timer tick, asking Buildbucket for the build status
[08:58:43.757] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[08:58:43.757] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:8:0) after 1m0s
[08:59:43.807] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:8:0)
[08:59:43.807] Timer tick, asking Buildbucket for the build status
[08:59:47.024] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[08:59:47.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:9:0) after 1m0s
[09:00:47.290] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:9:0)
[09:00:47.290] Timer tick, asking Buildbucket for the build status
[09:00:47.871] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:00:47.871] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:10:0) after 1m0s
[09:01:48.083] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:10:0)
[09:01:48.083] Timer tick, asking Buildbucket for the build status
[09:01:49.914] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:01:49.914] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:11:0) after 1m0s
[09:02:50.008] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:11:0)
[09:02:50.008] Timer tick, asking Buildbucket for the build status
[09:02:50.374] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:02:50.374] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:12:0) after 1m0s
[09:03:50.425] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:12:0)
[09:03:50.425] Timer tick, asking Buildbucket for the build status
[09:03:53.174] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:03:53.174] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:13:0) after 1m0s
[09:04:53.223] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:13:0)
[09:04:53.223] Timer tick, asking Buildbucket for the build status
[09:04:54.439] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:04:54.439] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:14:0) after 1m0s
[09:05:54.464] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:14:0)
[09:05:54.464] Timer tick, asking Buildbucket for the build status
[09:05:54.754] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:05:54.754] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:15:0) after 1m0s
[09:06:54.776] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:15:0)
[09:06:54.776] Timer tick, asking Buildbucket for the build status
[09:06:56.283] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:06:56.283] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:16:0) after 1m0s
[09:07:56.319] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:16:0)
[09:07:56.319] Timer tick, asking Buildbucket for the build status
[09:07:58.097] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:07:58.097] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:17:0) after 1m0s
[09:08:58.190] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:17:0)
[09:08:58.190] Timer tick, asking Buildbucket for the build status
[09:09:01.762] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:09:01.762] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:18:0) after 1m0s
[09:10:01.948] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:18:0)
[09:10:01.948] Timer tick, asking Buildbucket for the build status
[09:10:02.586] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:10:02.586] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:19:0) after 1m0s
[09:11:02.611] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:19:0)
[09:11:02.611] Timer tick, asking Buildbucket for the build status
[09:11:02.904] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:11:02.904] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:20:0) after 1m0s
[09:12:02.990] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:20:0)
[09:12:02.990] Timer tick, asking Buildbucket for the build status
[09:12:03.669] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:12:03.669] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:21:0) after 1m0s
[09:13:03.797] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:21:0)
[09:13:03.798] Timer tick, asking Buildbucket for the build status
[09:13:06.409] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:13:06.409] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:22:0) after 1m0s
[09:14:09.047] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:22:0)
[09:14:09.047] Timer tick, asking Buildbucket for the build status
[09:14:14.160] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:14:14.160] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:23:0) after 1m0s
[09:15:14.241] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:23:0)
[09:15:14.241] Timer tick, asking Buildbucket for the build status
[09:15:15.408] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:15:15.408] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:24:0) after 1m0s
[09:16:15.512] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:24:0)
[09:16:15.512] Timer tick, asking Buildbucket for the build status
[09:16:15.906] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:16:15.906] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:25:0) after 1m0s
[09:17:15.996] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:25:0)
[09:17:15.996] Timer tick, asking Buildbucket for the build status
[09:17:16.787] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:17:16.787] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:26:0) after 1m0s
[09:18:16.827] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:26:0)
[09:18:16.827] Timer tick, asking Buildbucket for the build status
[09:18:17.244] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:18:17.244] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:27:0) after 1m0s
[09:19:17.471] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:27:0)
[09:19:17.471] Timer tick, asking Buildbucket for the build status
[09:19:17.727] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:19:17.727] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:28:0) after 1m0s
[09:20:19.662] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:28:0)
[09:20:19.662] Timer tick, asking Buildbucket for the build status
[09:20:20.133] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:20:20.133] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:29:0) after 1m0s
[09:21:20.247] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:29:0)
[09:21:20.247] Timer tick, asking Buildbucket for the build status
[09:21:21.042] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:21:21.042] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:30:0) after 1m0s
[09:22:21.200] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:30:0)
[09:22:21.200] Timer tick, asking Buildbucket for the build status
[09:22:21.561] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:22:21.561] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:31:0) after 1m0s
[09:23:21.621] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:31:0)
[09:23:21.621] Timer tick, asking Buildbucket for the build status
[09:23:21.982] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:23:21.982] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:32:0) after 1m0s
[09:24:21.993] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:32:0)
[09:24:21.993] Timer tick, asking Buildbucket for the build status
[09:24:22.776] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:24:22.776] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:33:0) after 1m0s
[09:25:22.795] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:33:0)
[09:25:22.795] Timer tick, asking Buildbucket for the build status
[09:25:24.254] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:25:24.254] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:34:0) after 1m0s
[09:26:24.458] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:34:0)
[09:26:24.458] Timer tick, asking Buildbucket for the build status
[09:26:25.669] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:26:25.669] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:35:0) after 1m0s
[09:27:25.856] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:35:0)
[09:27:25.856] Timer tick, asking Buildbucket for the build status
[09:27:26.438] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:27:26.438] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:36:0) after 1m0s
[09:28:26.529] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:36:0)
[09:28:26.529] Timer tick, asking Buildbucket for the build status
[09:28:26.921] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:28:26.921] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:37:0) after 1m0s
[09:29:27.162] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:37:0)
[09:29:27.162] Timer tick, asking Buildbucket for the build status
[09:29:28.139] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:29:28.139] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:38:0) after 1m0s
[09:30:30.716] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:38:0)
[09:30:30.716] Timer tick, asking Buildbucket for the build status
[09:30:33.879] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:30:33.879] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:39:0) after 1m0s
[09:31:34.394] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:39:0)
[09:31:34.394] Timer tick, asking Buildbucket for the build status
[09:31:34.840] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:31:34.840] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:40:0) after 1m0s
[09:32:34.841] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:40:0)
[09:32:34.841] Timer tick, asking Buildbucket for the build status
[09:32:35.140] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:32:35.140] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:41:0) after 1m0s
[09:33:35.191] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:41:0)
[09:33:35.191] Timer tick, asking Buildbucket for the build status
[09:33:35.442] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:33:35.442] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:42:0) after 1m0s
[09:34:35.505] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:42:0)
[09:34:35.505] Timer tick, asking Buildbucket for the build status
[09:34:37.973] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:34:37.973] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:43:0) after 1m0s
[09:35:38.024] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:43:0)
[09:35:38.024] Timer tick, asking Buildbucket for the build status
[09:35:38.372] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:35:38.372] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:44:0) after 1m0s
[09:36:38.399] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:44:0)
[09:36:38.399] Timer tick, asking Buildbucket for the build status
[09:36:40.481] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:36:40.482] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:45:0) after 1m0s
[09:37:40.503] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:45:0)
[09:37:40.503] Timer tick, asking Buildbucket for the build status
[09:37:40.967] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:37:40.967] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:46:0) after 1m0s
[09:38:40.987] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:46:0)
[09:38:40.987] Timer tick, asking Buildbucket for the build status
[09:38:41.187] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:38:41.187] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:47:0) after 1m0s
[09:39:41.249] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:47:0)
[09:39:41.249] Timer tick, asking Buildbucket for the build status
[09:39:42.317] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:39:42.317] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:48:0) after 1m0s
[09:40:42.405] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:48:0)
[09:40:42.405] Timer tick, asking Buildbucket for the build status
[09:40:42.685] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:40:42.685] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:49:0) after 1m0s
[09:41:42.691] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:49:0)
[09:41:42.691] Timer tick, asking Buildbucket for the build status
[09:41:43.335] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:41:43.335] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:50:0) after 1m0s
[09:42:43.469] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:50:0)
[09:42:43.469] Timer tick, asking Buildbucket for the build status
[09:42:44.088] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:42:44.088] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:51:0) after 1m0s
[09:43:44.206] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:51:0)
[09:43:44.206] Timer tick, asking Buildbucket for the build status
[09:43:44.470] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:43:44.470] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:52:0) after 1m0s
[09:44:44.508] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:52:0)
[09:44:44.508] Timer tick, asking Buildbucket for the build status
[09:44:44.754] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:44:44.754] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:53:0) after 1m0s
[09:45:44.786] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:53:0)
[09:45:44.786] Timer tick, asking Buildbucket for the build status
[09:45:45.023] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:45:45.023] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:54:0) after 1m0s
[09:46:45.149] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:54:0)
[09:46:45.149] Timer tick, asking Buildbucket for the build status
[09:46:45.578] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:46:45.578] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:55:0) after 1m0s
[09:47:45.773] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:55:0)
[09:47:45.773] Timer tick, asking Buildbucket for the build status
[09:47:46.331] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:47:46.331] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:56:0) after 1m0s
[09:48:46.409] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:56:0)
[09:48:46.409] Timer tick, asking Buildbucket for the build status
[09:48:46.599] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:48:46.599] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:57:0) after 1m0s
[09:49:46.843] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:57:0)
[09:49:46.843] Timer tick, asking Buildbucket for the build status
[09:49:47.770] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:49:47.770] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:58:0) after 1m0s
[09:50:47.797] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:58:0)
[09:50:47.797] Timer tick, asking Buildbucket for the build status
[09:50:48.528] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:50:48.528] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:59:0) after 1m0s
[09:51:48.653] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:59:0)
[09:51:48.653] Timer tick, asking Buildbucket for the build status
[09:51:49.478] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:51:49.478] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:60:0) after 1m0s
[09:52:49.482] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:60:0)
[09:52:49.482] Timer tick, asking Buildbucket for the build status
[09:52:49.820] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:52:49.820] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:61:0) after 1m0s
[09:53:49.810] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:61:0)
[09:53:49.810] Timer tick, asking Buildbucket for the build status
[09:53:50.414] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:53:50.415] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:62:0) after 1m0s
[09:54:50.580] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:62:0)
[09:54:50.580] Timer tick, asking Buildbucket for the build status
[09:54:53.007] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:54:53.007] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:63:0) after 1m0s
[09:55:53.077] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:63:0)
[09:55:53.078] Timer tick, asking Buildbucket for the build status
[09:55:53.328] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:55:53.328] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:64:0) after 1m0s
[09:56:53.425] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:64:0)
[09:56:53.425] Timer tick, asking Buildbucket for the build status
[09:56:53.920] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:56:53.920] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:65:0) after 1m0s
[09:57:53.952] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:65:0)
[09:57:53.952] Timer tick, asking Buildbucket for the build status
[09:57:54.722] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:57:54.722] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:66:0) after 1m0s
[09:58:54.832] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:66:0)
[09:58:54.832] Timer tick, asking Buildbucket for the build status
[09:58:55.012] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:58:55.012] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:67:0) after 1m0s
[09:59:55.079] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:67:0)
[09:59:55.079] Timer tick, asking Buildbucket for the build status
[09:59:55.413] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[09:59:55.413] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:68:0) after 1m0s
[10:00:55.525] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:68:0)
[10:00:55.525] Timer tick, asking Buildbucket for the build status
[10:00:56.132] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:00:56.132] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:69:0) after 1m0s
[10:01:56.196] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:69:0)
[10:01:56.196] Timer tick, asking Buildbucket for the build status
[10:01:56.717] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:01:56.717] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:70:0) after 1m0s
[10:02:56.803] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:70:0)
[10:02:56.803] Timer tick, asking Buildbucket for the build status
[10:02:57.023] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:02:57.023] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:71:0) after 1m0s
[10:03:57.081] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:71:0)
[10:03:57.081] Timer tick, asking Buildbucket for the build status
[10:03:59.440] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:03:59.440] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:72:0) after 1m0s
[10:04:59.607] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:72:0)
[10:04:59.607] Timer tick, asking Buildbucket for the build status
[10:04:59.826] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:04:59.826] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:73:0) after 1m0s
[10:05:59.891] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:73:0)
[10:05:59.891] Timer tick, asking Buildbucket for the build status
[10:06:02.360] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:06:02.360] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:74:0) after 1m0s
[10:07:02.406] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:74:0)
[10:07:02.406] Timer tick, asking Buildbucket for the build status
[10:07:03.879] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:07:03.879] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:75:0) after 1m0s
[10:08:03.911] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:75:0)
[10:08:03.911] Timer tick, asking Buildbucket for the build status
[10:08:04.266] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:08:04.266] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:76:0) after 1m0s
[10:09:04.312] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:76:0)
[10:09:04.312] Timer tick, asking Buildbucket for the build status
[10:09:08.573] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:09:08.573] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:77:0) after 1m0s
[10:10:09.004] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:77:0)
[10:10:09.004] Timer tick, asking Buildbucket for the build status
[10:10:09.346] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:10:09.346] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:78:0) after 1m0s
[10:11:09.555] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:78:0)
[10:11:09.555] Timer tick, asking Buildbucket for the build status
[10:11:14.784] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:11:14.784] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:79:0) after 1m0s
[10:12:14.833] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:79:0)
[10:12:14.833] Timer tick, asking Buildbucket for the build status
[10:12:15.555] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:12:15.555] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:80:0) after 1m0s
[10:13:15.703] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:80:0)
[10:13:15.703] Timer tick, asking Buildbucket for the build status
[10:13:15.948] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:13:15.948] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:81:0) after 1m0s
[10:14:15.972] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:81:0)
[10:14:15.972] Timer tick, asking Buildbucket for the build status
[10:14:16.273] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:14:16.273] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:82:0) after 1m0s
[10:15:16.527] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:82:0)
[10:15:16.527] Timer tick, asking Buildbucket for the build status
[10:15:16.815] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:15:16.815] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:83:0) after 1m0s
[10:16:16.836] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:83:0)
[10:16:16.836] Timer tick, asking Buildbucket for the build status
[10:16:17.084] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:16:17.084] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:84:0) after 1m0s
[10:17:17.061] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:84:0)
[10:17:17.061] Timer tick, asking Buildbucket for the build status
[10:17:17.238] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:17:17.238] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:85:0) after 1m0s
[10:18:17.339] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:85:0)
[10:18:17.339] Timer tick, asking Buildbucket for the build status
[10:18:17.678] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:18:17.678] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:86:0) after 1m0s
[10:19:17.709] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:86:0)
[10:19:17.709] Timer tick, asking Buildbucket for the build status
[10:19:18.916] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:19:18.916] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:87:0) after 1m0s
[10:20:18.972] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:87:0)
[10:20:18.972] Timer tick, asking Buildbucket for the build status
[10:20:19.733] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:20:19.733] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:88:0) after 1m0s
[10:21:19.811] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:88:0)
[10:21:19.811] Timer tick, asking Buildbucket for the build status
[10:21:20.390] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:21:20.390] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:89:0) after 1m0s
[10:22:20.575] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:89:0)
[10:22:20.575] Timer tick, asking Buildbucket for the build status
[10:22:20.712] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:22:20.712] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:90:0) after 1m0s
[10:23:20.892] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:90:0)
[10:23:20.892] Timer tick, asking Buildbucket for the build status
[10:23:22.605] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:23:22.605] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:91:0) after 1m0s
[10:24:22.652] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:91:0)
[10:24:22.652] Timer tick, asking Buildbucket for the build status
[10:24:23.368] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:24:23.368] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:92:0) after 1m0s
[10:25:23.457] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:92:0)
[10:25:23.457] Timer tick, asking Buildbucket for the build status
[10:25:24.623] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:25:24.623] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:93:0) after 1m0s
[10:26:24.652] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:93:0)
[10:26:24.652] Timer tick, asking Buildbucket for the build status
[10:26:25.014] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:26:25.014] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:94:0) after 1m0s
[10:27:25.085] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:94:0)
[10:27:25.085] Timer tick, asking Buildbucket for the build status
[10:27:26.344] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:27:26.344] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:95:0) after 1m0s
[10:28:26.361] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:95:0)
[10:28:26.361] Timer tick, asking Buildbucket for the build status
[10:28:26.600] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:28:26.600] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:96:0) after 1m0s
[10:29:26.654] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:96:0)
[10:29:26.654] Timer tick, asking Buildbucket for the build status
[10:29:27.233] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:29:27.233] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:97:0) after 1m0s
[10:30:27.240] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:97:0)
[10:30:27.240] Timer tick, asking Buildbucket for the build status
[10:30:27.426] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:30:27.426] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:98:0) after 1m0s
[10:31:27.511] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:98:0)
[10:31:27.511] Timer tick, asking Buildbucket for the build status
[10:31:27.718] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:31:27.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:99:0) after 1m0s
[10:32:30.177] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:99:0)
[10:32:30.181] Timer tick, asking Buildbucket for the build status
[10:32:33.362] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:32:33.362] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:100:0) after 1m0s
[10:33:33.636] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:100:0)
[10:33:33.636] Timer tick, asking Buildbucket for the build status
[10:33:35.552] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:33:35.552] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:101:0) after 1m0s
[10:34:35.648] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:101:0)
[10:34:35.648] Timer tick, asking Buildbucket for the build status
[10:34:36.086] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:34:36.086] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:102:0) after 1m0s
[10:35:36.128] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:102:0)
[10:35:36.128] Timer tick, asking Buildbucket for the build status
[10:35:36.349] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:35:36.349] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:103:0) after 1m0s
[10:36:36.551] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:103:0)
[10:36:36.551] Timer tick, asking Buildbucket for the build status
[10:36:37.715] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:36:37.715] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:104:0) after 1m0s
[10:37:37.987] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:104:0)
[10:37:37.987] Timer tick, asking Buildbucket for the build status
[10:37:39.235] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:37:39.235] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:105:0) after 1m0s
[10:38:39.334] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:105:0)
[10:38:39.334] Timer tick, asking Buildbucket for the build status
[10:38:40.780] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:38:40.780] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:106:0) after 1m0s
[10:39:40.820] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:106:0)
[10:39:40.820] Timer tick, asking Buildbucket for the build status
[10:39:42.399] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:39:42.399] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:107:0) after 1m0s
[10:40:42.442] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:107:0)
[10:40:42.442] Timer tick, asking Buildbucket for the build status
[10:40:43.017] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:40:43.017] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:108:0) after 1m0s
[10:41:43.069] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:108:0)
[10:41:43.069] Timer tick, asking Buildbucket for the build status
[10:41:43.267] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:41:43.267] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:109:0) after 1m0s
[10:42:43.378] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:109:0)
[10:42:43.378] Timer tick, asking Buildbucket for the build status
[10:42:43.555] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:42:43.555] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:110:0) after 1m0s
[10:43:43.664] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:110:0)
[10:43:43.664] Timer tick, asking Buildbucket for the build status
[10:43:43.917] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:43:43.917] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:111:0) after 1m0s
[10:44:43.960] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:111:0)
[10:44:43.960] Timer tick, asking Buildbucket for the build status
[10:44:44.895] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:44:44.895] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:112:0) after 1m0s
[10:45:44.941] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:112:0)
[10:45:44.941] Timer tick, asking Buildbucket for the build status
[10:45:48.241] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:45:48.241] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:113:0) after 1m0s
[10:46:48.311] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:113:0)
[10:46:48.311] Timer tick, asking Buildbucket for the build status
[10:46:48.562] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:46:48.562] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:114:0) after 1m0s
[10:47:48.606] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:114:0)
[10:47:48.606] Timer tick, asking Buildbucket for the build status
[10:47:49.381] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:47:49.381] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:115:0) after 1m0s
[10:48:49.405] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:115:0)
[10:48:49.405] Timer tick, asking Buildbucket for the build status
[10:48:49.694] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:48:49.694] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:116:0) after 1m0s
[10:49:49.755] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:116:0)
[10:49:49.755] Timer tick, asking Buildbucket for the build status
[10:49:50.017] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:49:50.017] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:117:0) after 1m0s
[10:50:50.062] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:117:0)
[10:50:50.062] Timer tick, asking Buildbucket for the build status
[10:50:50.327] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:50:50.327] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:118:0) after 1m0s
[10:51:50.396] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:118:0)
[10:51:50.396] Timer tick, asking Buildbucket for the build status
[10:51:50.540] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:51:50.540] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:119:0) after 1m0s
[10:52:50.627] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:119:0)
[10:52:50.627] Timer tick, asking Buildbucket for the build status
[10:52:51.465] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:52:51.465] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:120:0) after 1m0s
[10:53:51.521] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:120:0)
[10:53:51.521] Timer tick, asking Buildbucket for the build status
[10:53:51.755] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:53:51.755] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:121:0) after 1m0s
[10:54:51.836] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:121:0)
[10:54:51.836] Timer tick, asking Buildbucket for the build status
[10:54:52.021] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:54:52.021] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:122:0) after 1m0s
[10:55:52.069] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:122:0)
[10:55:52.069] Timer tick, asking Buildbucket for the build status
[10:55:53.203] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:55:53.203] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:123:0) after 1m0s
[10:56:53.378] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:123:0)
[10:56:53.378] Timer tick, asking Buildbucket for the build status
[10:56:56.937] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:56:56.937] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:124:0) after 1m0s
[10:57:56.933] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:124:0)
[10:57:56.933] Timer tick, asking Buildbucket for the build status
[10:57:57.603] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:57:57.603] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:125:0) after 1m0s
[10:58:57.818] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:125:0)
[10:58:57.818] Timer tick, asking Buildbucket for the build status
[10:58:58.153] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:58:58.153] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:126:0) after 1m0s
[10:59:58.209] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:126:0)
[10:59:58.209] Timer tick, asking Buildbucket for the build status
[10:59:58.519] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[10:59:58.519] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:127:0) after 1m0s
[11:00:58.544] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:127:0)
[11:00:58.544] Timer tick, asking Buildbucket for the build status
[11:00:58.827] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[11:00:58.827] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:128:0) after 1m0s
[11:01:58.997] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:128:0)
[11:01:58.997] Timer tick, asking Buildbucket for the build status
[11:01:59.837] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[11:01:59.837] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:129:0) after 1m0s
[11:03:00.188] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:129:0)
[11:03:00.188] Timer tick, asking Buildbucket for the build status
[11:03:00.442] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[11:03:00.442] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:130:0) after 1m0s
[11:04:00.741] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:130:0)
[11:04:00.741] Timer tick, asking Buildbucket for the build status
[11:04:01.570] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[11:04:01.570] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:131:0) after 1m0s
[11:05:01.703] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:131:0)
[11:05:01.703] Timer tick, asking Buildbucket for the build status
[11:05:01.996] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[11:05:01.996] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:132:0) after 1m0s
[11:06:02.115] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:132:0)
[11:06:02.115] Timer tick, asking Buildbucket for the build status
[11:06:03.897] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[11:06:03.897] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:133:0) after 1m0s
[11:07:03.992] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:133:0)
[11:07:03.992] Timer tick, asking Buildbucket for the build status
[11:07:05.158] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[11:07:05.158] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:134:0) after 1m0s
[11:08:05.244] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:134:0)
[11:08:05.244] Timer tick, asking Buildbucket for the build status
[11:08:05.674] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[11:08:05.674] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:135:0) after 1m0s
[11:09:05.812] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:135:0)
[11:09:05.812] Timer tick, asking Buildbucket for the build status
[11:09:07.634] Build 8896917598434095408: status "STARTED", result "", failure_reason "", cancelation_reason ""
[11:09:07.634] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9062347661843419920:136:0) after 1m0s
[11:09:27.988] Received PubSub notification, asking Buildbucket for the build status
[11:09:28.557] Build 8896917598434095408: status "COMPLETED", result "FAILURE", failure_reason "BUILD_FAILURE", cancelation_reason ""
[11:09:28.557] Buildbucket build:
{
"build": {
"bucket": "luci.chromium.ci",
"canary_preference": "PROD",
"completed_ts": "1573643367475354",
"created_by": "project:chromium",
"created_ts": "1573635213398090",
"failure_reason": "BUILD_FAILURE",
"id": "8896917598434095408",
"parameters_json": "{\"builder_name\": \"ToTLinuxASan\", \"properties\": {\"branch\": \"refs/heads/master\", \"repository\": \"https://chromium.googlesource.com/chromium/src\", \"revision\": \"aa0ddde04b14d0361d74b78c4d091d70bbebee93\"}}",
"project": "chromium",
"result": "FAILURE",
"result_details_json": "{\"error\": {\"message\": \"#### Step _compile_ failed. Error logs are shown below:\\n```\\n[40155/59353] CXX obj/chrome/test/unit_tests/profile_info_cache_unittest.o\\nFAILED: obj/chrome/test/unit_tests/profile_info_cache_unittest.o\\n../../third_party/llvm-build/Release+Asserts/bin/clang++ -MMD -MF obj/chrome/test/unit_tests/profile...(too long)\\n../../chrome/browser/profiles/profile_info_cache_unittest.cc:783:11: error: bitwise or with non-zero value always evaluates to true [-Werror,-Wtautological-bitwise-compare]\\nif (i | 2u)\\n~~^~~~\\n../../chrome/browser/profiles/profile_info_cache_unittest.cc:749:11: error: bitwise or with non-zero value always evaluates to true [-Werror,-Wtautological-bitwise-compare]\\nif (i | 1u) {\\n~~^~~~\\n2 errors generated.\\n```\\n#### More information in raw_io.output[failure_summary]\"}, \"properties\": {\"$recipe_engine/path\": {\"cache_dir\": \"/b/s/w/ir/cache\", \"temp_dir\": \"/b/s/w/ir/tmp/rt\"}, \"$recipe_engine/runtime\": {\"is_experimental\": false, \"is_luci\": true}, \"bot_id\": \"luci-chromium-ci-xenial-32-18-6tao\", \"branch\": \"refs/heads/master\", \"buildername\": \"ToTLinuxASan\", \"buildnumber\": 8333, \"got_angle_revision\": \"4f023f565a618bd2325147e2fe7b05a992419f66\", \"got_clang_revision\": \"n331704-1d55c9e5-0\", \"got_dawn_revision\": \"604072bc2ed01018eb03bcbbf9d94042f679af63\", \"got_nacl_revision\": \"3651f6c52037c96e034cc422746768d59182bff3\", \"got_revision\": \"aa0ddde04b14d0361d74b78c4d091d70bbebee93\", \"got_revision_cp\": \"refs/heads/master@{#714862}\", \"got_swarming_client_revision\": \"885b3febcc170a60f25795304e60927b77d1e92d\", \"got_swiftshader_revision\": \"88632cac30e167d56deef8a84fb97491bc390636\", \"got_v8_revision\": \"092205497b35a2e8c3e9289c946ff2034e8d77d2\", \"got_v8_revision_cp\": \"refs/heads/8.0.251@{#1}\", \"got_webrtc_revision\": \"d4002a733dc695c2227f872a1501e65a6653210f\", \"got_webrtc_revision_cp\": \"refs/heads/master@{#29781}\", \"mastername\": \"chromium.clang\", \"path_config\": \"generic\", \"perf_dashboard_machine_group\": \"ChromiumClang\", \"recipe\": \"chromium\", \"repository\": \"https://chromium.googlesource.com/chromium/src\", \"revision\": \"aa0ddde04b14d0361d74b78c4d091d70bbebee93\"}, \"swarming\": {\"bot_dimensions\": {\"builderless\": [\"1\"], \"caches\": [\"builder_32f037bbb88023afe0dab3b292a7a92da0ac70796876f4ab4f7ae1596c401abf_v2\", \"builder_608a43c213d1fbf09444ab7c8abfb2a24c74a7c840e76eba6946ec84b4490281_v2\", \"git\", \"vpython\"], \"cores\": [\"32\"], \"cpu\": [\"x86\", \"x86-64\", \"x86-64-Broadwell_GCE\", \"x86-64-avx2\"], \"gce\": [\"1\"], \"gpu\": [\"none\"], \"id\": [\"luci-chromium-ci-xenial-32-18-6tao\"], \"image\": [\"chrome-xenial-19102400-d35fedf5a0d\"], \"inside_docker\": [\"0\"], \"kvm\": [\"1\"], \"locale\": [\"en_US.UTF-8\"], \"machine_type\": [\"n1-standard-32\"], \"os\": [\"Linux\", \"Ubuntu\", \"Ubuntu-16.04\"], \"pool\": [\"luci.chromium.ci\"], \"python\": [\"2.7.12\"], \"server_version\": [\"4621-f8a5b1c\"], \"ssd\": [\"0\"], \"zone\": [\"us\", \"us-west\", \"us-west1\", \"us-west1-c\"]}}, \"ui\": {\"info\": \"#### Step _compile_ failed. Error logs are shown below:\\n```\\n[40155/59353] CXX obj/chrome/test/unit_tests/profile_info_cache_unittest.o\\nFAILED: obj/chrome/test/unit_tests/profile_info_cache_unittest.o\\n../../third_party/llvm-build/Release+Asserts/bin/clang++ -MMD -MF obj/chrome/test/unit_tests/profile...(too long)\\n../../chrome/browser/profiles/profile_info_cache_unittest.cc:783:11: error: bitwise or with non-zero value always evaluates to true [-Werror,-Wtautological-bitwise-compare]\\nif (i | 2u)\\n~~^~~~\\n../../chrome/browser/profiles/profile_info_cache_unittest.cc:749:11: error: bitwise or with non-zero value always evaluates to true [-Werror,-Wtautological-bitwise-compare]\\nif (i | 1u) {\\n~~^~~~\\n2 errors generated.\\n```\\n#### More information in raw_io.output[failure_summary]\"}}",
"service_account": "chromium-ci-builder@chops-service-accounts.iam.gserviceaccount.com",
"started_ts": "1573635291244986",
"status": "COMPLETED",
"status_changed_ts": "1573635291650470",
"tags": [
"build_address:luci.chromium.ci/ToTLinuxASan/8333",
"builder:ToTLinuxASan",
"buildset:commit/git/aa0ddde04b14d0361d74b78c4d091d70bbebee93",
"buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/aa0ddde04b14d0361d74b78c4d091d70bbebee93",
"gitiles_ref:refs/heads/master",
"scheduler_invocation_id:9062347661843419920",
"scheduler_job_id:chromium/ToTLinuxASan",
"swarming_hostname:chromium-swarm.appspot.com",
"swarming_tag:log_location:logdog://logs.chromium.org/chromium/buildbucket/cr-buildbucket.appspot.com/8896917598434095408/+/annotations",
"swarming_tag:luci_project:chromium",
"swarming_tag:os:Linux",
"swarming_tag:recipe_name:chromium",
"swarming_tag:recipe_package:infra/recipe_bundles/chromium.googlesource.com/chromium/tools/build",
"swarming_task_id:487cc95ea3d7ba10",
"user_agent:luci-scheduler"
],
"updated_ts": "1573643367617212",
"url": "https://ci.chromium.org/b/8896917598434095408",
"utcnow_ts": "1573643368542208"
}
}
[11:09:28.557] Invocation finished in 2h15m57.794360224s with status FAILED