[20:46:52.388] New invocation is queued and will start shortly
[20:46:53.773] Starting the invocation (attempt 1)
[20:46:53.820] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[20:46:53.820] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[20:46:53.821] Buildbucket request:
{
"bucket": "luci.celab.ci",
"client_operation_id": "9073899192815202800",
"parameters_json": "{\"builder_name\":\"Windows\",\"properties\":{\"$recipe_engine/scheduler\":{\"hostname\":\"luci-scheduler.appspot.com\",\"triggers\":[{\"gitiles\":{\"ref\":\"refs/heads/master\",\"repo\":\"https://chromium.googlesource.com/enterprise/cel.git\",\"revision\":\"31b4fb937a2462373fac1ecf2489ad142db477bd\"},\"id\":\"https://chromium.googlesource.com/enterprise/cel.git/+/refs/heads/master@31b4fb937a2462373fac1ecf2489ad142db477bd\",\"title\":\"31b4fb937a2462373fac1ecf2489ad142db477bd\",\"url\":\"https://chromium.googlesource.com/enterprise/cel.git/+/31b4fb937a2462373fac1ecf2489ad142db477bd\"}]},\"branch\":\"refs/heads/master\",\"repository\":\"https://chromium.googlesource.com/enterprise/cel.git\",\"revision\":\"31b4fb937a2462373fac1ecf2489ad142db477bd\"}}",
"pubsub_callback": {
"auth_token": "...",
"topic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
},
"tags": [
"builder:Windows",
"scheduler_invocation_id:9073899192815202800",
"scheduler_job_id:celab/Windows",
"user_agent:luci-scheduler",
"buildset:commit/git/31b4fb937a2462373fac1ecf2489ad142db477bd",
"buildset:commit/gitiles/chromium.googlesource.com/enterprise/cel/+/31b4fb937a2462373fac1ecf2489ad142db477bd",
"gitiles_ref:refs/heads/master"
]
}
[20:46:54.467] Buildbucket response:
{
"build": {
"bucket": "luci.celab.ci",
"canary_preference": "PROD",
"created_by": "project:celab",
"created_ts": "1562618813969133",
"id": "8908469130482031232",
"parameters_json": "{\"builder_name\": \"Windows\", \"properties\": {\"$recipe_engine/scheduler\": {\"hostname\": \"luci-scheduler.appspot.com\", \"triggers\": [{\"gitiles\": {\"ref\": \"refs/heads/master\", \"repo\": \"https://chromium.googlesource.com/enterprise/cel.git\", \"revision\": \"31b4fb937a2462373fac1ecf2489ad142db477bd\"}, \"id\": \"https://chromium.googlesource.com/enterprise/cel.git/+/refs/heads/master@31b4fb937a2462373fac1ecf2489ad142db477bd\", \"title\": \"31b4fb937a2462373fac1ecf2489ad142db477bd\", \"url\": \"https://chromium.googlesource.com/enterprise/cel.git/+/31b4fb937a2462373fac1ecf2489ad142db477bd\"}]}, \"branch\": \"refs/heads/master\", \"repository\": \"https://chromium.googlesource.com/enterprise/cel.git\", \"revision\": \"31b4fb937a2462373fac1ecf2489ad142db477bd\"}}",
"project": "celab",
"result_details_json": "{\"properties\": {}}",
"service_account": "celab-ci-builder@chops-service-accounts.iam.gserviceaccount.com",
"status": "SCHEDULED",
"status_changed_ts": "1562618814266780",
"tags": [
"builder:Windows",
"buildset:commit/git/31b4fb937a2462373fac1ecf2489ad142db477bd",
"buildset:commit/gitiles/chromium.googlesource.com/enterprise/cel/+/31b4fb937a2462373fac1ecf2489ad142db477bd",
"gitiles_ref:refs/heads/master",
"scheduler_invocation_id:9073899192815202800",
"scheduler_job_id:celab/Windows",
"swarming_hostname:chromium-swarm.appspot.com",
"swarming_tag:log_location:logdog://logs.chromium.org/celab/buildbucket/cr-buildbucket.appspot.com/8908469130482031232/+/annotations",
"swarming_tag:luci_project:celab",
"swarming_tag:recipe_name:celab",
"swarming_tag:recipe_package:infra/recipe_bundles/chromium.googlesource.com/chromium/tools/build",
"swarming_task_id:",
"user_agent:luci-scheduler"
],
"updated_ts": "1562618814266905",
"url": "https://ci.chromium.org/b/8908469130482031232",
"utcnow_ts": "1562618814456539"
}
}
[20:46:54.467] Task URL: https://ci.chromium.org/b/8908469130482031232
[20:46:54.467] Scheduling timer "check-buildbucket-build-status" (celab/Windows:9073899192815202800:2:0) after 1m0s
[20:47:54.518] Handling timer "check-buildbucket-build-status" (celab/Windows:9073899192815202800:2:0)
[20:47:54.518] Timer tick, asking Buildbucket for the build status
[20:47:54.822] Build 8908469130482031232: status "SCHEDULED", result "", failure_reason "", cancelation_reason ""
[20:47:54.822] Scheduling timer "check-buildbucket-build-status" (celab/Windows:9073899192815202800:3:0) after 1m0s
[20:48:54.943] Handling timer "check-buildbucket-build-status" (celab/Windows:9073899192815202800:3:0)
[20:48:54.943] Timer tick, asking Buildbucket for the build status
[20:48:55.008] Build 8908469130482031232: status "SCHEDULED", result "", failure_reason "", cancelation_reason ""
[20:48:55.008] Scheduling timer "check-buildbucket-build-status" (celab/Windows:9073899192815202800:4:0) after 1m0s
[20:49:22.784] Received PubSub notification, asking Buildbucket for the build status
[20:49:22.865] Build 8908469130482031232: status "STARTED", result "", failure_reason "", cancelation_reason ""
[20:49:55.087] Handling timer "check-buildbucket-build-status" (celab/Windows:9073899192815202800:4:0)
[20:49:55.087] Timer tick, asking Buildbucket for the build status
[20:49:55.475] Build 8908469130482031232: status "STARTED", result "", failure_reason "", cancelation_reason ""
[20:49:55.475] Scheduling timer "check-buildbucket-build-status" (celab/Windows:9073899192815202800:6:0) after 1m0s
[20:50:55.529] Handling timer "check-buildbucket-build-status" (celab/Windows:9073899192815202800:6:0)
[20:50:55.529] Timer tick, asking Buildbucket for the build status
[20:50:55.967] Build 8908469130482031232: status "STARTED", result "", failure_reason "", cancelation_reason ""
[20:50:55.967] Scheduling timer "check-buildbucket-build-status" (celab/Windows:9073899192815202800:7:0) after 1m0s
[20:51:56.095] Handling timer "check-buildbucket-build-status" (celab/Windows:9073899192815202800:7:0)
[20:51:56.095] Timer tick, asking Buildbucket for the build status
[20:51:56.389] Build 8908469130482031232: status "STARTED", result "", failure_reason "", cancelation_reason ""
[20:51:56.389] Scheduling timer "check-buildbucket-build-status" (celab/Windows:9073899192815202800:8:0) after 1m0s
[20:52:56.511] Handling timer "check-buildbucket-build-status" (celab/Windows:9073899192815202800:8:0)
[20:52:56.511] Timer tick, asking Buildbucket for the build status
[20:52:56.670] Build 8908469130482031232: status "STARTED", result "", failure_reason "", cancelation_reason ""
[20:52:56.670] Scheduling timer "check-buildbucket-build-status" (celab/Windows:9073899192815202800:9:0) after 1m0s
[20:53:56.710] Handling timer "check-buildbucket-build-status" (celab/Windows:9073899192815202800:9:0)
[20:53:56.710] Timer tick, asking Buildbucket for the build status
[20:53:56.807] Build 8908469130482031232: status "STARTED", result "", failure_reason "", cancelation_reason ""
[20:53:56.807] Scheduling timer "check-buildbucket-build-status" (celab/Windows:9073899192815202800:10:0) after 1m0s
[20:54:56.884] Handling timer "check-buildbucket-build-status" (celab/Windows:9073899192815202800:10:0)
[20:54:56.884] Timer tick, asking Buildbucket for the build status
[20:54:57.034] Build 8908469130482031232: status "STARTED", result "", failure_reason "", cancelation_reason ""
[20:54:57.034] Scheduling timer "check-buildbucket-build-status" (celab/Windows:9073899192815202800:11:0) after 1m0s
[20:55:57.096] Handling timer "check-buildbucket-build-status" (celab/Windows:9073899192815202800:11:0)
[20:55:57.096] Timer tick, asking Buildbucket for the build status
[20:55:57.185] Build 8908469130482031232: status "STARTED", result "", failure_reason "", cancelation_reason ""
[20:55:57.185] Scheduling timer "check-buildbucket-build-status" (celab/Windows:9073899192815202800:12:0) after 1m0s
[20:56:57.347] Handling timer "check-buildbucket-build-status" (celab/Windows:9073899192815202800:12:0)
[20:56:57.347] Timer tick, asking Buildbucket for the build status
[20:56:57.431] Build 8908469130482031232: status "STARTED", result "", failure_reason "", cancelation_reason ""
[20:56:57.431] Scheduling timer "check-buildbucket-build-status" (celab/Windows:9073899192815202800:13:0) after 1m0s
[20:57:57.487] Handling timer "check-buildbucket-build-status" (celab/Windows:9073899192815202800:13:0)
[20:57:57.487] Timer tick, asking Buildbucket for the build status
[20:57:57.627] Build 8908469130482031232: status "STARTED", result "", failure_reason "", cancelation_reason ""
[20:57:57.627] Scheduling timer "check-buildbucket-build-status" (celab/Windows:9073899192815202800:14:0) after 1m0s
[20:58:57.848] Handling timer "check-buildbucket-build-status" (celab/Windows:9073899192815202800:14:0)
[20:58:57.848] Timer tick, asking Buildbucket for the build status
[20:58:58.185] Build 8908469130482031232: status "STARTED", result "", failure_reason "", cancelation_reason ""
[20:58:58.185] Scheduling timer "check-buildbucket-build-status" (celab/Windows:9073899192815202800:15:0) after 1m0s
[20:59:58.242] Handling timer "check-buildbucket-build-status" (celab/Windows:9073899192815202800:15:0)
[20:59:58.242] Timer tick, asking Buildbucket for the build status
[20:59:58.430] Build 8908469130482031232: status "STARTED", result "", failure_reason "", cancelation_reason ""
[20:59:58.430] Scheduling timer "check-buildbucket-build-status" (celab/Windows:9073899192815202800:16:0) after 1m0s
[21:00:58.559] Handling timer "check-buildbucket-build-status" (celab/Windows:9073899192815202800:16:0)
[21:00:58.559] Timer tick, asking Buildbucket for the build status
[21:00:58.638] Build 8908469130482031232: status "STARTED", result "", failure_reason "", cancelation_reason ""
[21:00:58.638] Scheduling timer "check-buildbucket-build-status" (celab/Windows:9073899192815202800:17:0) after 1m0s
[21:01:58.708] Handling timer "check-buildbucket-build-status" (celab/Windows:9073899192815202800:17:0)
[21:01:58.708] Timer tick, asking Buildbucket for the build status
[21:01:58.839] Build 8908469130482031232: status "STARTED", result "", failure_reason "", cancelation_reason ""
[21:01:58.839] Scheduling timer "check-buildbucket-build-status" (celab/Windows:9073899192815202800:18:0) after 1m0s
[21:02:58.829] Handling timer "check-buildbucket-build-status" (celab/Windows:9073899192815202800:18:0)
[21:02:58.829] Timer tick, asking Buildbucket for the build status
[21:02:59.043] Build 8908469130482031232: status "STARTED", result "", failure_reason "", cancelation_reason ""
[21:02:59.043] Scheduling timer "check-buildbucket-build-status" (celab/Windows:9073899192815202800:19:0) after 1m0s
[21:03:59.158] Handling timer "check-buildbucket-build-status" (celab/Windows:9073899192815202800:19:0)
[21:03:59.158] Timer tick, asking Buildbucket for the build status
[21:03:59.482] Build 8908469130482031232: status "STARTED", result "", failure_reason "", cancelation_reason ""
[21:03:59.482] Scheduling timer "check-buildbucket-build-status" (celab/Windows:9073899192815202800:20:0) after 1m0s
[21:04:59.565] Handling timer "check-buildbucket-build-status" (celab/Windows:9073899192815202800:20:0)
[21:04:59.565] Timer tick, asking Buildbucket for the build status
[21:04:59.692] Build 8908469130482031232: status "STARTED", result "", failure_reason "", cancelation_reason ""
[21:04:59.692] Scheduling timer "check-buildbucket-build-status" (celab/Windows:9073899192815202800:21:0) after 1m0s
[21:05:59.743] Handling timer "check-buildbucket-build-status" (celab/Windows:9073899192815202800:21:0)
[21:05:59.743] Timer tick, asking Buildbucket for the build status
[21:06:00.129] Build 8908469130482031232: status "STARTED", result "", failure_reason "", cancelation_reason ""
[21:06:00.129] Scheduling timer "check-buildbucket-build-status" (celab/Windows:9073899192815202800:22:0) after 1m0s
[21:07:00.222] Handling timer "check-buildbucket-build-status" (celab/Windows:9073899192815202800:22:0)
[21:07:00.222] Timer tick, asking Buildbucket for the build status
[21:07:00.315] Build 8908469130482031232: status "STARTED", result "", failure_reason "", cancelation_reason ""
[21:07:00.315] Scheduling timer "check-buildbucket-build-status" (celab/Windows:9073899192815202800:23:0) after 1m0s
[21:08:00.396] Handling timer "check-buildbucket-build-status" (celab/Windows:9073899192815202800:23:0)
[21:08:00.396] Timer tick, asking Buildbucket for the build status
[21:08:00.842] Build 8908469130482031232: status "STARTED", result "", failure_reason "", cancelation_reason ""
[21:08:00.842] Scheduling timer "check-buildbucket-build-status" (celab/Windows:9073899192815202800:24:0) after 1m0s
[21:09:00.832] Handling timer "check-buildbucket-build-status" (celab/Windows:9073899192815202800:24:0)
[21:09:00.832] Timer tick, asking Buildbucket for the build status
[21:09:01.053] Build 8908469130482031232: status "STARTED", result "", failure_reason "", cancelation_reason ""
[21:09:01.053] Scheduling timer "check-buildbucket-build-status" (celab/Windows:9073899192815202800:25:0) after 1m0s
[21:10:01.078] Handling timer "check-buildbucket-build-status" (celab/Windows:9073899192815202800:25:0)
[21:10:01.078] Timer tick, asking Buildbucket for the build status
[21:10:01.486] Build 8908469130482031232: status "STARTED", result "", failure_reason "", cancelation_reason ""
[21:10:01.486] Scheduling timer "check-buildbucket-build-status" (celab/Windows:9073899192815202800:26:0) after 1m0s
[21:11:01.510] Handling timer "check-buildbucket-build-status" (celab/Windows:9073899192815202800:26:0)
[21:11:01.510] Timer tick, asking Buildbucket for the build status
[21:11:02.513] Build 8908469130482031232: status "STARTED", result "", failure_reason "", cancelation_reason ""
[21:11:02.513] Scheduling timer "check-buildbucket-build-status" (celab/Windows:9073899192815202800:27:0) after 1m0s
[21:12:02.497] Handling timer "check-buildbucket-build-status" (celab/Windows:9073899192815202800:27:0)
[21:12:02.497] Timer tick, asking Buildbucket for the build status
[21:12:02.800] Build 8908469130482031232: status "STARTED", result "", failure_reason "", cancelation_reason ""
[21:12:02.800] Scheduling timer "check-buildbucket-build-status" (celab/Windows:9073899192815202800:28:0) after 1m0s
[21:13:02.840] Handling timer "check-buildbucket-build-status" (celab/Windows:9073899192815202800:28:0)
[21:13:02.840] Timer tick, asking Buildbucket for the build status
[21:13:02.938] Build 8908469130482031232: status "STARTED", result "", failure_reason "", cancelation_reason ""
[21:13:02.938] Scheduling timer "check-buildbucket-build-status" (celab/Windows:9073899192815202800:29:0) after 1m0s
[21:14:03.024] Handling timer "check-buildbucket-build-status" (celab/Windows:9073899192815202800:29:0)
[21:14:03.024] Timer tick, asking Buildbucket for the build status
[21:14:03.138] Build 8908469130482031232: status "STARTED", result "", failure_reason "", cancelation_reason ""
[21:14:03.138] Scheduling timer "check-buildbucket-build-status" (celab/Windows:9073899192815202800:30:0) after 1m0s
[21:15:03.296] Handling timer "check-buildbucket-build-status" (celab/Windows:9073899192815202800:30:0)
[21:15:03.296] Timer tick, asking Buildbucket for the build status
[21:15:03.539] Build 8908469130482031232: status "STARTED", result "", failure_reason "", cancelation_reason ""
[21:15:03.539] Scheduling timer "check-buildbucket-build-status" (celab/Windows:9073899192815202800:31:0) after 1m0s
[21:16:03.562] Handling timer "check-buildbucket-build-status" (celab/Windows:9073899192815202800:31:0)
[21:16:03.562] Timer tick, asking Buildbucket for the build status
[21:16:03.688] Build 8908469130482031232: status "STARTED", result "", failure_reason "", cancelation_reason ""
[21:16:03.688] Scheduling timer "check-buildbucket-build-status" (celab/Windows:9073899192815202800:32:0) after 1m0s
[21:16:52.117] Received PubSub notification, asking Buildbucket for the build status
[21:16:52.175] Build 8908469130482031232: status "COMPLETED", result "FAILURE", failure_reason "BUILD_FAILURE", cancelation_reason ""
[21:16:52.175] Buildbucket build:
{
"build": {
"bucket": "luci.celab.ci",
"canary_preference": "PROD",
"completed_ts": "1562620611408163",
"created_by": "project:celab",
"created_ts": "1562618813969133",
"failure_reason": "BUILD_FAILURE",
"id": "8908469130482031232",
"parameters_json": "{\"builder_name\": \"Windows\", \"properties\": {\"$recipe_engine/scheduler\": {\"hostname\": \"luci-scheduler.appspot.com\", \"triggers\": [{\"gitiles\": {\"ref\": \"refs/heads/master\", \"repo\": \"https://chromium.googlesource.com/enterprise/cel.git\", \"revision\": \"31b4fb937a2462373fac1ecf2489ad142db477bd\"}, \"id\": \"https://chromium.googlesource.com/enterprise/cel.git/+/refs/heads/master@31b4fb937a2462373fac1ecf2489ad142db477bd\", \"title\": \"31b4fb937a2462373fac1ecf2489ad142db477bd\", \"url\": \"https://chromium.googlesource.com/enterprise/cel.git/+/31b4fb937a2462373fac1ecf2489ad142db477bd\"}]}, \"branch\": \"refs/heads/master\", \"repository\": \"https://chromium.googlesource.com/enterprise/cel.git\", \"revision\": \"31b4fb937a2462373fac1ecf2489ad142db477bd\"}}",
"project": "celab",
"result": "FAILURE",
"result_details_json": "{\"error\": {\"message\": \"Step('run all tests') (retcode: 1)\"}, \"properties\": {\"$recipe_engine/path\": {\"cache_dir\": \"C:\\\\b\\\\s\\\\w\\\\ir\\\\cache\", \"temp_dir\": \"C:\\\\b\\\\s\\\\w\\\\ir\\\\tmp\\\\rt\"}, \"$recipe_engine/runtime\": {\"is_experimental\": false, \"is_luci\": true}, \"$recipe_engine/scheduler\": {\"hostname\": \"luci-scheduler.appspot.com\", \"triggers\": [{\"gitiles\": {\"ref\": \"refs/heads/master\", \"repo\": \"https://chromium.googlesource.com/enterprise/cel.git\", \"revision\": \"31b4fb937a2462373fac1ecf2489ad142db477bd\"}, \"id\": \"https://chromium.googlesource.com/enterprise/cel.git/+/refs/heads/master@31b4fb937a2462373fac1ecf2489ad142db477bd\", \"title\": \"31b4fb937a2462373fac1ecf2489ad142db477bd\", \"url\": \"https://chromium.googlesource.com/enterprise/cel.git/+/31b4fb937a2462373fac1ecf2489ad142db477bd\"}]}, \"bot_id\": \"luci-flex-ci-win10-3-f3ll\", \"branch\": \"refs/heads/master\", \"buildername\": \"Windows\", \"got_revision\": \"31b4fb937a2462373fac1ecf2489ad142db477bd\", \"path_config\": \"generic\", \"pool_name\": \"celab-ci\", \"pool_size\": 5.0, \"recipe\": \"celab\", \"repository\": \"https://chromium.googlesource.com/enterprise/cel.git\", \"revision\": \"31b4fb937a2462373fac1ecf2489ad142db477bd\", \"target_cpu\": \"x64\", \"tests\": \"chrome_ent_test.tests.machine_registry.MachineRegistryTest;chrome_ent_test.tests.iis_sites.IISNTLMTest\"}, \"swarming\": {\"bot_dimensions\": {\"caches\": [\"builder_23ff26200028d7bde7345cab65d04757fe67757f8bc3f28b160fc290713a8aba_v2\", \"builder_257566082b52a5de38f0a9c65d209a5141f99872012143c81ec22d983df47a11_v2\", \"builder_5ea9dd34d37b61e3cbbd43243995de8ca48bf4e0b2536f92161f88cdc4dfcffa_v2\", \"git\", \"goma_v2\", \"infra_gclient_with_go\", \"vpython\", \"win_toolchain\"], \"cores\": [\"8\"], \"cpu\": [\"x86\", \"x86-64\", \"x86-64-Broadwell_GCE\"], \"gce\": [\"1\"], \"gpu\": [\"none\"], \"id\": [\"luci-flex-ci-win10-3-f3ll\"], \"image\": [\"chrome-win10-1703-2018-04-20-61acaf8983f\"], \"integrity\": [\"high\"], \"locale\": [\"en_US.cp1252\"], \"machine_type\": [\"n1-standard-8\"], \"os\": [\"Windows\", \"Windows-10\", \"Windows-10-15063\"], \"pool\": [\"luci.flex.ci\"], \"python\": [\"2.7.13\"], \"server_version\": [\"4365-1559751\"], \"ssd\": [\"0\"], \"zone\": [\"us\", \"us-west\", \"us-west1\", \"us-west1-c\"]}}, \"ui\": {\"info\": \"Step('run all tests') (retcode: 1)\"}}",
"service_account": "celab-ci-builder@chops-service-accounts.iam.gserviceaccount.com",
"started_ts": "1562618961514212",
"status": "COMPLETED",
"status_changed_ts": "1562618962322987",
"tags": [
"builder:Windows",
"buildset:commit/git/31b4fb937a2462373fac1ecf2489ad142db477bd",
"buildset:commit/gitiles/chromium.googlesource.com/enterprise/cel/+/31b4fb937a2462373fac1ecf2489ad142db477bd",
"gitiles_ref:refs/heads/master",
"scheduler_invocation_id:9073899192815202800",
"scheduler_job_id:celab/Windows",
"swarming_hostname:chromium-swarm.appspot.com",
"swarming_tag:log_location:logdog://logs.chromium.org/celab/buildbucket/cr-buildbucket.appspot.com/8908469130482031232/+/annotations",
"swarming_tag:luci_project:celab",
"swarming_tag:os:Windows",
"swarming_tag:recipe_name:celab",
"swarming_tag:recipe_package:infra/recipe_bundles/chromium.googlesource.com/chromium/tools/build",
"swarming_task_id:45ec2a93720ce110",
"user_agent:luci-scheduler"
],
"updated_ts": "1562620611492424",
"url": "https://ci.chromium.org/b/8908469130482031232",
"utcnow_ts": "1562620612167106"
}
}
[21:16:52.175] Invocation finished in 29m59.815446454s with status FAILED