Status: FAILED
Triggered by: -
Duration: 38 minutes
Actions:

Definition (rev 835dd06986af6863f902c628becb4df908d0fc20)

buildbucket: <
  server: "cr-buildbucket.appspot.com"
  bucket: "luci.chromium.ci"
  builder: "ToTAndroid64"
>

Incoming triggers

Incoming properties

{
  "branch": "refs/heads/master",
  "repository": "https://chromium.googlesource.com/chromium/src",
  "revision": "003792e60cc170a5820efbfd6366cd100f47726f"
}

Incoming tags

  • buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/003792e60cc170a5820efbfd6366cd100f47726f
  • gitiles_ref:refs/heads/master

Debug log (UTC)

[18:17:44.978] New invocation is queued and will start shortly
[18:17:46.099] Starting the invocation (attempt 1)
[18:17:46.133] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[18:17:46.133] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[18:17:46.133] Buildbucket request:
{
  "bucket": "luci.chromium.ci",
  "client_operation_id": "9017647858706491920",
  "parameters_json": "{\"builder_name\":\"ToTAndroid64\",\"properties\":{\"branch\":\"refs/heads/master\",\"repository\":\"https://chromium.googlesource.com/chromium/src\",\"revision\":\"003792e60cc170a5820efbfd6366cd100f47726f\"}}",
  "pubsub_callback": {
    "auth_token": "...",
    "topic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
  },
  "tags": [
    "builder:ToTAndroid64",
    "scheduler_invocation_id:9017647858706491920",
    "scheduler_job_id:chromium/ToTAndroid64",
    "user_agent:luci-scheduler",
    "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/003792e60cc170a5820efbfd6366cd100f47726f",
    "gitiles_ref:refs/heads/master"
  ]
}
[18:17:46.780] Buildbucket response:
{
  "build": {
    "bucket": "luci.chromium.ci",
    "canary_preference": "PROD",
    "created_by": "project:chromium",
    "created_ts": "1616264266295114",
    "id": "8852217796663551424",
    "parameters_json": "{\"builder_name\": \"ToTAndroid64\", \"properties\": {\"branch\": \"refs/heads/master\", \"repository\": \"https://chromium.googlesource.com/chromium/src\", \"revision\": \"003792e60cc170a5820efbfd6366cd100f47726f\"}}",
    "project": "chromium",
    "result_details_json": "{\"properties\": {}}",
    "service_account": "chromium-ci-builder@chops-service-accounts.iam.gserviceaccount.com",
    "status": "SCHEDULED",
    "status_changed_ts": "1616264266581995",
    "tags": [
      "build_address:luci.chromium.ci/ToTAndroid64/10785",
      "builder:ToTAndroid64",
      "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/003792e60cc170a5820efbfd6366cd100f47726f",
      "gitiles_ref:refs/heads/master",
      "scheduler_invocation_id:9017647858706491920",
      "scheduler_job_id:chromium/ToTAndroid64",
      "swarming_hostname:chromium-swarm.appspot.com",
      "swarming_tag:log_location:logdog://logs.chromium.org/chromium/buildbucket/cr-buildbucket.appspot.com/8852217796663551424/+/annotations",
      "swarming_tag:luci_project:chromium",
      "swarming_tag:recipe_name:chromium",
      "swarming_tag:recipe_package:infra/recipe_bundles/chromium.googlesource.com/chromium/tools/build",
      "swarming_task_id:",
      "user_agent:luci-scheduler"
    ],
    "updated_ts": "1616264266582105",
    "url": "https://ci.chromium.org/b/8852217796663551424",
    "utcnow_ts": "1616264266774412"
  }
}
[18:17:46.780] Task URL: https://ci.chromium.org/b/8852217796663551424
[18:17:46.780] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:9017647858706491920:2:0) after 1m0s
[18:18:46.802] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:9017647858706491920:2:0)
[18:18:46.828] Build status: SCHEDULED
[18:18:46.828] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:9017647858706491920:3:0) after 2m44s
[18:18:59.099] Received PubSub notification, asking Buildbucket for the build status
[18:18:59.146] Build status: STARTED
[18:21:30.844] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:9017647858706491920:3:0)
[18:21:30.844] Timer tick, asking Buildbucket for the build status
[18:21:31.202] Build 8852217796663551424: status "STARTED", result "", failure_reason "", cancelation_reason ""
[18:21:31.203] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:9017647858706491920:5:0) after 1m0s
[18:22:31.218] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:9017647858706491920:5:0)
[18:22:31.248] Build status: STARTED
[18:22:31.248] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:9017647858706491920:6:0) after 1m22s
[18:23:53.265] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:9017647858706491920:6:0)
[18:23:53.301] Build status: STARTED
[18:23:53.301] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:9017647858706491920:7:0) after 4m33s
[18:28:26.304] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:9017647858706491920:7:0)
[18:28:26.304] Timer tick, asking Buildbucket for the build status
[18:28:26.375] Build 8852217796663551424: status "STARTED", result "", failure_reason "", cancelation_reason ""
[18:28:26.375] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:9017647858706491920:8:0) after 1m0s
[18:29:26.392] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:9017647858706491920:8:0)
[18:29:26.392] Timer tick, asking Buildbucket for the build status
[18:29:26.516] Build 8852217796663551424: status "STARTED", result "", failure_reason "", cancelation_reason ""
[18:29:26.516] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:9017647858706491920:9:0) after 1m0s
[18:30:26.587] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:9017647858706491920:9:0)
[18:30:26.615] Build status: STARTED
[18:30:26.615] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:9017647858706491920:10:0) after 3m9s
[18:33:35.741] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:9017647858706491920:10:0)
[18:33:35.741] Timer tick, asking Buildbucket for the build status
[18:33:35.832] Build 8852217796663551424: status "STARTED", result "", failure_reason "", cancelation_reason ""
[18:33:35.832] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:9017647858706491920:11:0) after 1m0s
[18:34:35.967] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:9017647858706491920:11:0)
[18:34:35.994] Build status: STARTED
[18:34:35.994] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:9017647858706491920:12:0) after 7m7s
[18:41:43.053] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:9017647858706491920:12:0)
[18:41:43.087] Build status: STARTED
[18:41:43.087] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:9017647858706491920:13:0) after 6m40s
[18:48:23.211] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:9017647858706491920:13:0)
[18:48:23.211] Timer tick, asking Buildbucket for the build status
[18:48:23.302] Build 8852217796663551424: status "STARTED", result "", failure_reason "", cancelation_reason ""
[18:48:23.302] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:9017647858706491920:14:0) after 1m0s
[18:49:23.319] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:9017647858706491920:14:0)
[18:49:23.319] Timer tick, asking Buildbucket for the build status
[18:49:23.505] Build 8852217796663551424: status "STARTED", result "", failure_reason "", cancelation_reason ""
[18:49:23.505] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:9017647858706491920:15:0) after 1m0s
[18:50:23.592] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:9017647858706491920:15:0)
[18:50:23.627] Build status: STARTED
[18:50:23.627] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:9017647858706491920:16:0) after 1m28s
[18:51:51.640] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:9017647858706491920:16:0)
[18:51:51.667] Build status: STARTED
[18:51:51.667] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid64:9017647858706491920:17:0) after 5m59s
[18:56:20.983] Received PubSub notification, asking Buildbucket for the build status
[18:56:21.083] Build 8852217796663551424: status "COMPLETED", result "FAILURE", failure_reason "BUILD_FAILURE", cancelation_reason ""
[18:56:21.083] Buildbucket build:
{
  "build": {
    "bucket": "luci.chromium.ci",
    "canary_preference": "PROD",
    "completed_ts": "1616266580573426",
    "created_by": "project:chromium",
    "created_ts": "1616264266295114",
    "failure_reason": "BUILD_FAILURE",
    "id": "8852217796663551424",
    "parameters_json": "{\"builder_name\": \"ToTAndroid64\", \"properties\": {\"branch\": \"refs/heads/master\", \"repository\": \"https://chromium.googlesource.com/chromium/src\", \"revision\": \"003792e60cc170a5820efbfd6366cd100f47726f\"}}",
    "project": "chromium",
    "result": "FAILURE",
    "result_details_json": "{\"error\": {\"message\": \"#### Step _compile_ failed. Error logs are shown below:\\n```\\n[287/151960] SOLINK_MODULE ./libbase_profiler_test_support_library.so\\nFAILED: libbase_profiler_test_support_library.so lib.unstripped/libbase_profiler_test_support_library.so\\n../../third_party/llvm-build/Release+Asserts/bin/clang++ -shared -fuse-ld=lld -Wl,--fatal-warnings -...(too long)\\nld.lld: error: unable to find library -lgcc\\nld.lld: error: unable to find library -lgcc\\nclang-13: error: linker command failed with exit code 1 (use -v to see invocation)\\n[288/151960] SOLINK ./libimmediate_crash_test_helper.so\\nFAILED: libimmediate_crash_test_helper.so libimmediate_crash_test_helper.so.TOC lib.unstripped/libimmediate_crash_test_helper.so\\n```\\n##### ...The message was too long...\\n#### More information in raw_io.output[failure_summary]\"}, \"properties\": {\"$build/goma\": {\"use_luci_auth\": true}, \"$recipe_engine/isolated\": {\"server\": \"https://isolateserver.appspot.com\"}, \"$recipe_engine/milo/blamelist_pins\": [{\"host\": \"chromium.googlesource.com\", \"id\": \"003792e60cc170a5820efbfd6366cd100f47726f\", \"project\": \"chromium/src\"}], \"$recipe_engine/path\": {\"cache_dir\": \"/b/s/w/ir/cache\", \"temp_dir\": \"/b/s/w/ir/tmp/rt\"}, \"$recipe_engine/runtime\": {\"is_experimental\": false, \"is_luci\": true}, \"bot_id\": \"luci-chromium-ci-xenial-32-4-9rhm\", \"branch\": \"refs/heads/master\", \"builder_group\": \"chromium.clang\", \"buildername\": \"ToTAndroid64\", \"buildnumber\": 10785, \"clang_revision\": \"llvmorg-13-init-5046-g188405bc-0\", \"got_angle_revision\": \"135385a1ae86bf857be37475f927dcf78c9476b4\", \"got_dawn_revision\": \"853b5d765e715fc11ea28c1d3754e48d38c283b1\", \"got_nacl_revision\": \"abf3277f295c6c87f0b103f291ed5e3e73933b76\", \"got_revision\": \"003792e60cc170a5820efbfd6366cd100f47726f\", \"got_revision_cp\": \"refs/heads/master@{#864962}\", \"got_swarming_client_revision\": \"a32a1607f6093d338f756c7e7c7b4333b0c50c9c\", \"got_swiftshader_revision\": \"a98fb3f8380a3a5c9ae3e0175634ba88c85a434f\", \"got_v8_revision\": \"6092f990f654f2d7a4534ee8c5bbb5c4fb800bdc\", \"got_v8_revision_cp\": \"refs/heads/9.1.170@{#1}\", \"got_webrtc_revision\": \"2bab0efee4d9d163841b6d060c690c381e1768ac\", \"got_webrtc_revision_cp\": \"refs/heads/master@{#33511}\", \"is_cached\": true, \"path_config\": \"generic\", \"perf_dashboard_machine_group\": \"ChromiumClang\", \"recipe\": \"chromium\", \"repository\": \"https://chromium.googlesource.com/chromium/src\", \"revision\": \"003792e60cc170a5820efbfd6366cd100f47726f\"}, \"swarming\": {\"bot_dimensions\": {\"builderless\": [\"1\"], \"caches\": [\"builder_61e4d25dfd74628f421fe7d90da475349672e571b4dfd9a5326b66319dc94b9e_v2\", \"builder_9fdc5a29922d525ac71344d8edaed852039a0b05963327c23a19e46eae86874d_v2\", \"builder_d3d2610b5230a0e8818d022113159013c6345fba0843daf9ae715f6a2f1da36d_v2\", \"git\", \"goma_v2\", \"vpython\"], \"cores\": [\"32\"], \"cpu\": [\"x86\", \"x86-64\", \"x86-64-Broadwell_GCE\", \"x86-64-avx2\"], \"gce\": [\"1\"], \"gcp\": [\"google.com:chromecompute\"], \"gpu\": [\"none\"], \"id\": [\"luci-chromium-ci-xenial-32-4-9rhm\"], \"image\": [\"chrome-xenial-21011100-9488e34e558\"], \"inside_docker\": [\"0\"], \"kvm\": [\"1\"], \"locale\": [\"en_US.UTF-8\"], \"machine_type\": [\"n1-standard-32\"], \"os\": [\"Linux\", \"Ubuntu\", \"Ubuntu-16\", \"Ubuntu-16.04\", \"Ubuntu-16.04.6\"], \"pool\": [\"luci.chromium.ci\"], \"python\": [\"2\", \"2.7\", \"2.7.12\"], \"server_version\": [\"5776-cb9e157\"], \"ssd\": [\"0\"], \"zone\": [\"us\", \"us-west\", \"us-west1\", \"us-west1-c\"]}}, \"ui\": {\"info\": \"#### Step _compile_ failed. Error logs are shown below:\\n```\\n[287/151960] SOLINK_MODULE ./libbase_profiler_test_support_library.so\\nFAILED: libbase_profiler_test_support_library.so lib.unstripped/libbase_profiler_test_support_library.so\\n../../third_party/llvm-build/Release+Asserts/bin/clang++ -shared -fuse-ld=lld -Wl,--fatal-warnings -...(too long)\\nld.lld: error: unable to find library -lgcc\\nld.lld: error: unable to find library -lgcc\\nclang-13: error: linker command failed with exit code 1 (use -v to see invocation)\\n[288/151960] SOLINK ./libimmediate_crash_test_helper.so\\nFAILED: libimmediate_crash_test_helper.so libimmediate_crash_test_helper.so.TOC lib.unstripped/libimmediate_crash_test_helper.so\\n```\\n##### ...The message was too long...\\n#### More information in raw_io.output[failure_summary]\"}}",
    "service_account": "chromium-ci-builder@chops-service-accounts.iam.gserviceaccount.com",
    "started_ts": "1616264338271684",
    "status": "COMPLETED",
    "status_changed_ts": "1616264338889386",
    "tags": [
      "build_address:luci.chromium.ci/ToTAndroid64/10785",
      "builder:ToTAndroid64",
      "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/003792e60cc170a5820efbfd6366cd100f47726f",
      "gitiles_ref:refs/heads/master",
      "scheduler_invocation_id:9017647858706491920",
      "scheduler_job_id:chromium/ToTAndroid64",
      "swarming_hostname:chromium-swarm.appspot.com",
      "swarming_tag:log_location:logdog://logs.chromium.org/chromium/buildbucket/cr-buildbucket.appspot.com/8852217796663551424/+/annotations",
      "swarming_tag:luci_project:chromium",
      "swarming_tag:os:Linux",
      "swarming_tag:recipe_name:chromium",
      "swarming_tag:recipe_package:infra/recipe_bundles/chromium.googlesource.com/chromium/tools/build",
      "swarming_task_id:5269ad0de7560b10",
      "user_agent:luci-scheduler"
    ],
    "updated_ts": "1616266580573811",
    "url": "https://ci.chromium.org/b/8852217796663551424",
    "utcnow_ts": "1616266581076391"
  }
}
[18:56:21.083] Invocation finished in 38m36.120054896s with status FAILED