[16:41:46.377] New invocation is queued and will start shortly
[16:41:47.575] Starting the invocation (attempt 1)
[16:41:47.702] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[16:41:47.702] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[16:41:47.702] Buildbucket request:
{
"bucket": "luci.chromium.ci",
"client_operation_id": "9071649689014744432",
"parameters_json": "{\"builder_name\":\"ToTLinuxASanLibfuzzer\",\"properties\":{\"branch\":\"refs/heads/master\",\"repository\":\"https://chromium.googlesource.com/chromium/src.git\",\"revision\":\"9b6a00d3d1a0bb857b7acc0b85c57919da372aee\"}}",
"pubsub_callback": {
"auth_token": "...",
"topic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
},
"tags": [
"builder:ToTLinuxASanLibfuzzer",
"scheduler_invocation_id:9071649689014744432",
"scheduler_job_id:chromium/ToTLinuxASanLibfuzzer",
"user_agent:luci-scheduler",
"buildset:commit/git/9b6a00d3d1a0bb857b7acc0b85c57919da372aee",
"buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/9b6a00d3d1a0bb857b7acc0b85c57919da372aee",
"gitiles_ref:refs/heads/master"
]
}
[16:41:49.045] Failed to add buildbucket build - googleapi: got HTTP response code 502 with body: <!DOCTYPE html>
<html lang=en>
<meta charset=utf-8>
<meta name=viewport content="initial-scale=1, minimum-scale=1, width=device-width">
<title>Error 502 (Server Error)!!1</title>
<style>
*{margin:0;padding:0}html,code{font:15px/22px arial,sans-serif}html{background:#fff;color:#222;padding:15px}body{margin:7% auto 0;max-width:390px;min-height:180px;padding:30px 0 15px}* > body{background:url(//www.google.com/images/errors/robot.png) 100% 5px no-repeat;padding-right:205px}p{margin:11px 0 22px;overflow:hidden}ins{color:#777;text-decoration:none}a img{border:0}@media screen and (max-width:772px){body{background:none;margin-top:0;max-width:none;padding-right:0}}#logo{background:url(//www.google.com/images/branding/googlelogo/1x/googlelogo_color_150x54dp.png) no-repeat;margin-left:-5px}@media only screen and (min-resolution:192dpi){#logo{background:url(//www.google.com/images/branding/googlelogo/2x/googlelogo_color_150x54dp.png) no-repeat 0% 0%/100% 100%;-moz-border-image:url(//www.google.com/images/branding/googlelogo/2x/googlelogo_color_150x54dp.png) 0}}@media only screen and (-webkit-min-device-pixel-ratio:2){#logo{background:url(//www.google.com/images/branding/googlelogo/2x/googlelogo_color_150x54dp.png) no-repeat;-webkit-background-size:100% 100%}}#logo{display:inline-block;height:54px;width:150px}
</style>
<a href=//www.google.com/><span id=logo aria-label=Google></span></a>
<p><b>502.</b> <ins>That’s an error.</ins>
<p>The server encountered a temporary error and could not complete your request.<p>Please try again in 30 seconds. <ins>That’s all we know.</ins>
[16:41:49.045] The invocation will be retried
[16:41:54.163] Starting the invocation (attempt 2)
[16:41:54.251] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[16:41:54.251] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[16:41:54.251] Buildbucket request:
{
"bucket": "luci.chromium.ci",
"client_operation_id": "9071649689014744432",
"parameters_json": "{\"builder_name\":\"ToTLinuxASanLibfuzzer\",\"properties\":{\"branch\":\"refs/heads/master\",\"repository\":\"https://chromium.googlesource.com/chromium/src.git\",\"revision\":\"9b6a00d3d1a0bb857b7acc0b85c57919da372aee\"}}",
"pubsub_callback": {
"auth_token": "...",
"topic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
},
"tags": [
"builder:ToTLinuxASanLibfuzzer",
"scheduler_invocation_id:9071649689014744432",
"scheduler_job_id:chromium/ToTLinuxASanLibfuzzer",
"user_agent:luci-scheduler",
"buildset:commit/git/9b6a00d3d1a0bb857b7acc0b85c57919da372aee",
"buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/9b6a00d3d1a0bb857b7acc0b85c57919da372aee",
"gitiles_ref:refs/heads/master"
]
}
[16:41:56.505] Buildbucket response:
{
"build": {
"bucket": "luci.chromium.ci",
"canary_preference": "PROD",
"created_by": "project:chromium",
"created_ts": "1564764115519795",
"id": "8906219618764136784",
"parameters_json": "{\"builder_name\": \"ToTLinuxASanLibfuzzer\", \"properties\": {\"branch\": \"refs/heads/master\", \"repository\": \"https://chromium.googlesource.com/chromium/src.git\", \"revision\": \"9b6a00d3d1a0bb857b7acc0b85c57919da372aee\"}}",
"project": "chromium",
"result_details_json": "{\"properties\": {}}",
"service_account": "chromium-ci-builder@chops-service-accounts.iam.gserviceaccount.com",
"status": "SCHEDULED",
"status_changed_ts": "1564764116294927",
"tags": [
"build_address:luci.chromium.ci/ToTLinuxASanLibfuzzer/4537",
"builder:ToTLinuxASanLibfuzzer",
"buildset:commit/git/9b6a00d3d1a0bb857b7acc0b85c57919da372aee",
"buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/9b6a00d3d1a0bb857b7acc0b85c57919da372aee",
"gitiles_ref:refs/heads/master",
"scheduler_invocation_id:9071649689014744432",
"scheduler_job_id:chromium/ToTLinuxASanLibfuzzer",
"swarming_hostname:chromium-swarm.appspot.com",
"swarming_tag:log_location:logdog://logs.chromium.org/chromium/buildbucket/cr-buildbucket.appspot.com/8906219618764136784/+/annotations",
"swarming_tag:luci_project:chromium",
"swarming_tag:recipe_name:chromium",
"swarming_tag:recipe_package:infra/recipe_bundles/chromium.googlesource.com/chromium/tools/build",
"swarming_task_id:",
"user_agent:luci-scheduler"
],
"updated_ts": "1564764116295044",
"url": "https://ci.chromium.org/b/8906219618764136784",
"utcnow_ts": "1564764116495865"
}
}
[16:41:56.505] Task URL: https://ci.chromium.org/b/8906219618764136784
[16:41:56.505] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASanLibfuzzer:9071649689014744432:5:0) after 1m0s
[16:42:50.882] Received PubSub notification, asking Buildbucket for the build status
[16:42:53.706] Build 8906219618764136784: status "STARTED", result "", failure_reason "", cancelation_reason ""
[16:42:56.689] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASanLibfuzzer:9071649689014744432:5:0)
[16:42:56.689] Timer tick, asking Buildbucket for the build status
[16:42:57.266] Build 8906219618764136784: status "STARTED", result "", failure_reason "", cancelation_reason ""
[16:42:57.266] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASanLibfuzzer:9071649689014744432:7:0) after 1m0s
[16:43:57.361] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASanLibfuzzer:9071649689014744432:7:0)
[16:43:57.361] Timer tick, asking Buildbucket for the build status
[16:43:59.044] Build 8906219618764136784: status "STARTED", result "", failure_reason "", cancelation_reason ""
[16:43:59.044] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASanLibfuzzer:9071649689014744432:8:0) after 1m0s
[16:44:59.069] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASanLibfuzzer:9071649689014744432:8:0)
[16:44:59.069] Timer tick, asking Buildbucket for the build status
[16:45:00.147] Build 8906219618764136784: status "STARTED", result "", failure_reason "", cancelation_reason ""
[16:45:00.147] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASanLibfuzzer:9071649689014744432:9:0) after 1m0s
[16:46:00.173] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASanLibfuzzer:9071649689014744432:9:0)
[16:46:00.173] Timer tick, asking Buildbucket for the build status
[16:46:03.223] Build 8906219618764136784: status "STARTED", result "", failure_reason "", cancelation_reason ""
[16:46:03.223] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASanLibfuzzer:9071649689014744432:10:0) after 1m0s
[16:47:03.285] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASanLibfuzzer:9071649689014744432:10:0)
[16:47:03.285] Timer tick, asking Buildbucket for the build status
[16:47:05.201] Build 8906219618764136784: status "STARTED", result "", failure_reason "", cancelation_reason ""
[16:47:05.201] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASanLibfuzzer:9071649689014744432:11:0) after 1m0s
[16:48:05.374] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASanLibfuzzer:9071649689014744432:11:0)
[16:48:05.374] Timer tick, asking Buildbucket for the build status
[16:48:05.814] Build 8906219618764136784: status "STARTED", result "", failure_reason "", cancelation_reason ""
[16:48:05.814] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASanLibfuzzer:9071649689014744432:12:0) after 1m0s
[16:49:05.970] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASanLibfuzzer:9071649689014744432:12:0)
[16:49:05.970] Timer tick, asking Buildbucket for the build status
[16:49:06.704] Build 8906219618764136784: status "STARTED", result "", failure_reason "", cancelation_reason ""
[16:49:06.704] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASanLibfuzzer:9071649689014744432:13:0) after 1m0s
[16:50:06.772] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASanLibfuzzer:9071649689014744432:13:0)
[16:50:06.772] Timer tick, asking Buildbucket for the build status
[16:50:09.908] Build 8906219618764136784: status "STARTED", result "", failure_reason "", cancelation_reason ""
[16:50:09.908] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASanLibfuzzer:9071649689014744432:14:0) after 1m0s
[16:51:09.933] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASanLibfuzzer:9071649689014744432:14:0)
[16:51:09.933] Timer tick, asking Buildbucket for the build status
[16:51:12.545] Build 8906219618764136784: status "STARTED", result "", failure_reason "", cancelation_reason ""
[16:51:12.545] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASanLibfuzzer:9071649689014744432:15:0) after 1m0s
[16:52:10.359] Received PubSub notification, asking Buildbucket for the build status
[16:52:11.229] Build 8906219618764136784: status "COMPLETED", result "FAILURE", failure_reason "BUILD_FAILURE", cancelation_reason ""
[16:52:11.229] Buildbucket build:
{
"build": {
"bucket": "luci.chromium.ci",
"canary_preference": "PROD",
"completed_ts": "1564764729904405",
"created_by": "project:chromium",
"created_ts": "1564764115519795",
"failure_reason": "BUILD_FAILURE",
"id": "8906219618764136784",
"parameters_json": "{\"builder_name\": \"ToTLinuxASanLibfuzzer\", \"properties\": {\"branch\": \"refs/heads/master\", \"repository\": \"https://chromium.googlesource.com/chromium/src.git\", \"revision\": \"9b6a00d3d1a0bb857b7acc0b85c57919da372aee\"}}",
"project": "chromium",
"result": "FAILURE",
"result_details_json": "{\"error\": {\"message\": \"Step('gclient runhooks') (retcode: 2)\"}, \"properties\": {\"$recipe_engine/path\": {\"cache_dir\": \"/b/s/w/ir/cache\", \"temp_dir\": \"/b/s/w/ir/tmp/rt\"}, \"$recipe_engine/runtime\": {\"is_experimental\": false, \"is_luci\": true}, \"bot_id\": \"luci-chromium-ci-xenial-32-2-14ly\", \"branch\": \"refs/heads/master\", \"buildername\": \"ToTLinuxASanLibfuzzer\", \"buildnumber\": 4537, \"got_angle_revision\": \"825233007c7d4473d33da4907614e4b90959a7c5\", \"got_dawn_revision\": \"54b4df706968359c8c5a332e06de3dc3d372e2c8\", \"got_nacl_revision\": \"058a26f57015051953a727add26e7e26348b9558\", \"got_revision\": \"9b6a00d3d1a0bb857b7acc0b85c57919da372aee\", \"got_revision_cp\": \"refs/heads/master@{#683630}\", \"got_swarming_client_revision\": \"96f125709acfd0b48fc1e5dae7d6ea42291726ac\", \"got_v8_revision\": \"b43eb88ba8c08a54cc419d88ef6f5ba7c6478a00\", \"got_v8_revision_cp\": \"refs/heads/7.8.56@{#1}\", \"got_webrtc_revision\": \"054e3bbbe7921b8b84213ecbbb58f68cd5712f6d\", \"got_webrtc_revision_cp\": \"refs/heads/master@{#28746}\", \"mastername\": \"chromium.clang\", \"path_config\": \"generic\", \"perf_dashboard_machine_group\": \"ChromiumClang\", \"recipe\": \"chromium\", \"repository\": \"https://chromium.googlesource.com/chromium/src.git\", \"revision\": \"9b6a00d3d1a0bb857b7acc0b85c57919da372aee\"}, \"swarming\": {\"bot_dimensions\": {\"builderless\": [\"1\"], \"caches\": [\"builder_924a2904afcfcbbd328cfdc1142e002c0741d79827cb236e881001489d34b9e2_v2\", \"git\", \"vpython\"], \"cores\": [\"32\"], \"cpu\": [\"x86\", \"x86-64\", \"x86-64-Broadwell_GCE\", \"x86-64-avx2\"], \"gce\": [\"1\"], \"gpu\": [\"none\"], \"id\": [\"luci-chromium-ci-xenial-32-2-14ly\"], \"image\": [\"chrome-xenial-19052201-9cb74617499\"], \"inside_docker\": [\"0\"], \"kvm\": [\"1\"], \"locale\": [\"en_US.UTF-8\"], \"machine_type\": [\"n1-standard-32\"], \"os\": [\"Linux\", \"Ubuntu\", \"Ubuntu-16.04\"], \"pool\": [\"luci.chromium.ci\"], \"python\": [\"2.7.12\"], \"server_version\": [\"4382-5929880\"], \"ssd\": [\"0\"], \"zone\": [\"us\", \"us-west\", \"us-west1\", \"us-west1-c\"]}}, \"ui\": {\"info\": \"Step('gclient runhooks') (retcode: 2)\"}}",
"service_account": "chromium-ci-builder@chops-service-accounts.iam.gserviceaccount.com",
"started_ts": "1564764167460674",
"status": "COMPLETED",
"status_changed_ts": "1564764169647275",
"tags": [
"build_address:luci.chromium.ci/ToTLinuxASanLibfuzzer/4537",
"builder:ToTLinuxASanLibfuzzer",
"buildset:commit/git/9b6a00d3d1a0bb857b7acc0b85c57919da372aee",
"buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/9b6a00d3d1a0bb857b7acc0b85c57919da372aee",
"gitiles_ref:refs/heads/master",
"scheduler_invocation_id:9071649689014744432",
"scheduler_job_id:chromium/ToTLinuxASanLibfuzzer",
"swarming_hostname:chromium-swarm.appspot.com",
"swarming_tag:log_location:logdog://logs.chromium.org/chromium/buildbucket/cr-buildbucket.appspot.com/8906219618764136784/+/annotations",
"swarming_tag:luci_project:chromium",
"swarming_tag:os:Linux",
"swarming_tag:recipe_name:chromium",
"swarming_tag:recipe_package:infra/recipe_bundles/chromium.googlesource.com/chromium/tools/build",
"swarming_task_id:466c072e55eca810",
"user_agent:luci-scheduler"
],
"updated_ts": "1564764730060674",
"url": "https://ci.chromium.org/b/8906219618764136784",
"utcnow_ts": "1564764731219451"
}
}
[16:52:11.229] Invocation finished in 10m24.870400543s with status FAILED