[17:26:01.280] New invocation is queued and will start shortly
[17:26:03.868] Starting the invocation (attempt 1)
[17:26:03.900] Popped buildset tag "buildset:commit/gitiles/llvm.googlesource.com/llvm-project/+/714f6b03bc89bff766ae628092cd059fd8aa0aa1"
[17:26:03.900] Popped gitiles commit info from properties and tags
[17:26:03.900] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[17:26:03.900] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[17:26:03.901] Buildbucket request:
{
"requestId": "8870159251872694352",
"builder": {
"project": "fuchsia",
"bucket": "toolchain.ci",
"builder": "clang-mac-arm64"
},
"properties": {
"$recipe_engine/scheduler": {
"hostname": "luci-scheduler.appspot.com",
"invocation": "8870159251872694352",
"job": "fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5",
"triggers": [
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://llvm.googlesource.com/llvm-project",
"revision": "fee17b3a96c29ddef59103bd7c02568f748e37ab"
},
"id": "https://llvm.googlesource.com/llvm-project/+/refs/heads/main@fee17b3a96c29ddef59103bd7c02568f748e37ab",
"title": "fee17b3a96c29ddef59103bd7c02568f748e37ab",
"url": "https://llvm.googlesource.com/llvm-project/+/fee17b3a96c29ddef59103bd7c02568f748e37ab"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://llvm.googlesource.com/llvm-project",
"revision": "7d6e72f11033685af069e40697cd9fc0bad0a682"
},
"id": "https://llvm.googlesource.com/llvm-project/+/refs/heads/main@7d6e72f11033685af069e40697cd9fc0bad0a682",
"title": "7d6e72f11033685af069e40697cd9fc0bad0a682",
"url": "https://llvm.googlesource.com/llvm-project/+/7d6e72f11033685af069e40697cd9fc0bad0a682"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://llvm.googlesource.com/llvm-project",
"revision": "d91a5c33df2e53c757c68b0a893d4654993fa3a5"
},
"id": "https://llvm.googlesource.com/llvm-project/+/refs/heads/main@d91a5c33df2e53c757c68b0a893d4654993fa3a5",
"title": "d91a5c33df2e53c757c68b0a893d4654993fa3a5",
"url": "https://llvm.googlesource.com/llvm-project/+/d91a5c33df2e53c757c68b0a893d4654993fa3a5"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://llvm.googlesource.com/llvm-project",
"revision": "bad2036c6ef13e4b44fdea527c3f6ea49033358d"
},
"id": "https://llvm.googlesource.com/llvm-project/+/refs/heads/main@bad2036c6ef13e4b44fdea527c3f6ea49033358d",
"title": "bad2036c6ef13e4b44fdea527c3f6ea49033358d",
"url": "https://llvm.googlesource.com/llvm-project/+/bad2036c6ef13e4b44fdea527c3f6ea49033358d"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://llvm.googlesource.com/llvm-project",
"revision": "527c8ff11e4b05e3502a46a5ad52bb7f0da5ed2a"
},
"id": "https://llvm.googlesource.com/llvm-project/+/refs/heads/main@527c8ff11e4b05e3502a46a5ad52bb7f0da5ed2a",
"title": "527c8ff11e4b05e3502a46a5ad52bb7f0da5ed2a",
"url": "https://llvm.googlesource.com/llvm-project/+/527c8ff11e4b05e3502a46a5ad52bb7f0da5ed2a"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://llvm.googlesource.com/llvm-project",
"revision": "e75f054d18c426b421d7d4cc58342fcb60047cfc"
},
"id": "https://llvm.googlesource.com/llvm-project/+/refs/heads/main@e75f054d18c426b421d7d4cc58342fcb60047cfc",
"title": "e75f054d18c426b421d7d4cc58342fcb60047cfc",
"url": "https://llvm.googlesource.com/llvm-project/+/e75f054d18c426b421d7d4cc58342fcb60047cfc"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://llvm.googlesource.com/llvm-project",
"revision": "df9965cb5a116c4f8c07bff8349d9bf342d9c96f"
},
"id": "https://llvm.googlesource.com/llvm-project/+/refs/heads/main@df9965cb5a116c4f8c07bff8349d9bf342d9c96f",
"title": "df9965cb5a116c4f8c07bff8349d9bf342d9c96f",
"url": "https://llvm.googlesource.com/llvm-project/+/df9965cb5a116c4f8c07bff8349d9bf342d9c96f"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://llvm.googlesource.com/llvm-project",
"revision": "1b130e3fc011443ac3700bd4d76f61aa5e4cd467"
},
"id": "https://llvm.googlesource.com/llvm-project/+/refs/heads/main@1b130e3fc011443ac3700bd4d76f61aa5e4cd467",
"title": "1b130e3fc011443ac3700bd4d76f61aa5e4cd467",
"url": "https://llvm.googlesource.com/llvm-project/+/1b130e3fc011443ac3700bd4d76f61aa5e4cd467"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://llvm.googlesource.com/llvm-project",
"revision": "c9ca354d383dc4a2843c9f89d9317c8a21fd0bf8"
},
"id": "https://llvm.googlesource.com/llvm-project/+/refs/heads/main@c9ca354d383dc4a2843c9f89d9317c8a21fd0bf8",
"title": "c9ca354d383dc4a2843c9f89d9317c8a21fd0bf8",
"url": "https://llvm.googlesource.com/llvm-project/+/c9ca354d383dc4a2843c9f89d9317c8a21fd0bf8"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://llvm.googlesource.com/llvm-project",
"revision": "55ec6373f99c23f70ea27cd96280b929e81503ac"
},
"id": "https://llvm.googlesource.com/llvm-project/+/refs/heads/main@55ec6373f99c23f70ea27cd96280b929e81503ac",
"title": "55ec6373f99c23f70ea27cd96280b929e81503ac",
"url": "https://llvm.googlesource.com/llvm-project/+/55ec6373f99c23f70ea27cd96280b929e81503ac"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://llvm.googlesource.com/llvm-project",
"revision": "5545a92079012b5e501e5d7a5cbe1105a5dec9a4"
},
"id": "https://llvm.googlesource.com/llvm-project/+/refs/heads/main@5545a92079012b5e501e5d7a5cbe1105a5dec9a4",
"title": "5545a92079012b5e501e5d7a5cbe1105a5dec9a4",
"url": "https://llvm.googlesource.com/llvm-project/+/5545a92079012b5e501e5d7a5cbe1105a5dec9a4"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://llvm.googlesource.com/llvm-project",
"revision": "3b3fc701d8f83d4ca30ee1c818fb7687336ac178"
},
"id": "https://llvm.googlesource.com/llvm-project/+/refs/heads/main@3b3fc701d8f83d4ca30ee1c818fb7687336ac178",
"title": "3b3fc701d8f83d4ca30ee1c818fb7687336ac178",
"url": "https://llvm.googlesource.com/llvm-project/+/3b3fc701d8f83d4ca30ee1c818fb7687336ac178"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://llvm.googlesource.com/llvm-project",
"revision": "688d12ca09b1b434b5e22f7e2a6bee1dcd79050f"
},
"id": "https://llvm.googlesource.com/llvm-project/+/refs/heads/main@688d12ca09b1b434b5e22f7e2a6bee1dcd79050f",
"title": "688d12ca09b1b434b5e22f7e2a6bee1dcd79050f",
"url": "https://llvm.googlesource.com/llvm-project/+/688d12ca09b1b434b5e22f7e2a6bee1dcd79050f"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://llvm.googlesource.com/llvm-project",
"revision": "6e65e6a31356bdac8c81376f2b8b32ececd3c76a"
},
"id": "https://llvm.googlesource.com/llvm-project/+/refs/heads/main@6e65e6a31356bdac8c81376f2b8b32ececd3c76a",
"title": "6e65e6a31356bdac8c81376f2b8b32ececd3c76a",
"url": "https://llvm.googlesource.com/llvm-project/+/6e65e6a31356bdac8c81376f2b8b32ececd3c76a"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://llvm.googlesource.com/llvm-project",
"revision": "9c7727c62af0b366358df9e030f5cde659422eb2"
},
"id": "https://llvm.googlesource.com/llvm-project/+/refs/heads/main@9c7727c62af0b366358df9e030f5cde659422eb2",
"title": "9c7727c62af0b366358df9e030f5cde659422eb2",
"url": "https://llvm.googlesource.com/llvm-project/+/9c7727c62af0b366358df9e030f5cde659422eb2"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://llvm.googlesource.com/llvm-project",
"revision": "303bea8e6350bb2ff0c29d4aaf9621569918d836"
},
"id": "https://llvm.googlesource.com/llvm-project/+/refs/heads/main@303bea8e6350bb2ff0c29d4aaf9621569918d836",
"title": "303bea8e6350bb2ff0c29d4aaf9621569918d836",
"url": "https://llvm.googlesource.com/llvm-project/+/303bea8e6350bb2ff0c29d4aaf9621569918d836"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://llvm.googlesource.com/llvm-project",
"revision": "c5a141bb8b5dfc4be06bb165d88e724e66bf5c4c"
},
"id": "https://llvm.googlesource.com/llvm-project/+/refs/heads/main@c5a141bb8b5dfc4be06bb165d88e724e66bf5c4c",
"title": "c5a141bb8b5dfc4be06bb165d88e724e66bf5c4c",
"url": "https://llvm.googlesource.com/llvm-project/+/c5a141bb8b5dfc4be06bb165d88e724e66bf5c4c"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://llvm.googlesource.com/llvm-project",
"revision": "96b1dfb57fc822ea69bf75a8f0a69eb168776faa"
},
"id": "https://llvm.googlesource.com/llvm-project/+/refs/heads/main@96b1dfb57fc822ea69bf75a8f0a69eb168776faa",
"title": "96b1dfb57fc822ea69bf75a8f0a69eb168776faa",
"url": "https://llvm.googlesource.com/llvm-project/+/96b1dfb57fc822ea69bf75a8f0a69eb168776faa"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://llvm.googlesource.com/llvm-project",
"revision": "f5006e043143717e2e8ade9a009e1209b4a3563b"
},
"id": "https://llvm.googlesource.com/llvm-project/+/refs/heads/main@f5006e043143717e2e8ade9a009e1209b4a3563b",
"title": "f5006e043143717e2e8ade9a009e1209b4a3563b",
"url": "https://llvm.googlesource.com/llvm-project/+/f5006e043143717e2e8ade9a009e1209b4a3563b"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://llvm.googlesource.com/llvm-project",
"revision": "714f6b03bc89bff766ae628092cd059fd8aa0aa1"
},
"id": "https://llvm.googlesource.com/llvm-project/+/refs/heads/main@714f6b03bc89bff766ae628092cd059fd8aa0aa1",
"title": "714f6b03bc89bff766ae628092cd059fd8aa0aa1",
"url": "https://llvm.googlesource.com/llvm-project/+/714f6b03bc89bff766ae628092cd059fd8aa0aa1"
}
]
}
},
"gitilesCommit": {
"host": "llvm.googlesource.com",
"project": "llvm-project",
"id": "714f6b03bc89bff766ae628092cd059fd8aa0aa1",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8870159251872694352"
},
{
"key": "scheduler_job_id",
"value": "fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[17:26:04.423] Scheduled build:
{
"id": "8704729188402696289",
"builder": {
"project": "fuchsia",
"bucket": "toolchain.ci",
"builder": "clang-mac-arm64"
},
"createdBy": "project:fuchsia",
"createTime": "2025-09-03T17:26:03.956124166Z",
"updateTime": "2025-09-03T17:26:03.956124166Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "llvm.googlesource.com",
"project": "llvm-project",
"id": "714f6b03bc89bff766ae628092cd059fd8aa0aa1",
"ref": "refs/heads/main"
}
}
}
[17:26:04.423] Task URL: https://cr-buildbucket.appspot.com/build/8704729188402696289
[17:26:04.423] Scheduling timer "check-buildbucket-build-status" (fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5:8870159251872694352:2:0) after 6m6s
[17:26:05.353] Received PubSub notification, asking Buildbucket for the build status
[17:26:05.381] Build status: SCHEDULED
[17:26:08.809] Received PubSub notification, asking Buildbucket for the build status
[17:26:08.832] Build status: STARTED
[17:32:10.440] Handling timer "check-buildbucket-build-status" (fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5:8870159251872694352:2:0)
[17:32:10.559] Build status: STARTED
[17:32:10.559] Scheduling timer "check-buildbucket-build-status" (fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5:8870159251872694352:5:0) after 8m59s
[17:41:09.609] Handling timer "check-buildbucket-build-status" (fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5:8870159251872694352:5:0)
[17:41:09.675] Build status: STARTED
[17:41:09.675] Scheduling timer "check-buildbucket-build-status" (fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5:8870159251872694352:6:0) after 3m36s
[17:44:45.716] Handling timer "check-buildbucket-build-status" (fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5:8870159251872694352:6:0)
[17:44:45.885] Build status: STARTED
[17:44:45.885] Scheduling timer "check-buildbucket-build-status" (fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5:8870159251872694352:7:0) after 8m42s
[17:53:27.903] Handling timer "check-buildbucket-build-status" (fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5:8870159251872694352:7:0)
[17:53:27.922] Build status: STARTED
[17:53:27.922] Scheduling timer "check-buildbucket-build-status" (fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5:8870159251872694352:8:0) after 8m18s
[18:01:46.004] Handling timer "check-buildbucket-build-status" (fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5:8870159251872694352:8:0)
[18:01:46.246] Build status: STARTED
[18:01:46.246] Scheduling timer "check-buildbucket-build-status" (fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5:8870159251872694352:9:0) after 4m0s
[18:05:46.357] Handling timer "check-buildbucket-build-status" (fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5:8870159251872694352:9:0)
[18:05:46.376] Build status: STARTED
[18:05:46.376] Scheduling timer "check-buildbucket-build-status" (fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5:8870159251872694352:10:0) after 2m26s
[18:08:12.493] Handling timer "check-buildbucket-build-status" (fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5:8870159251872694352:10:0)
[18:08:12.510] Build status: STARTED
[18:08:12.510] Scheduling timer "check-buildbucket-build-status" (fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5:8870159251872694352:11:0) after 9m7s
[18:17:19.696] Handling timer "check-buildbucket-build-status" (fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5:8870159251872694352:11:0)
[18:17:19.711] Build status: STARTED
[18:17:19.711] Scheduling timer "check-buildbucket-build-status" (fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5:8870159251872694352:12:0) after 9m12s
[18:26:31.767] Handling timer "check-buildbucket-build-status" (fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5:8870159251872694352:12:0)
[18:26:31.798] Build status: STARTED
[18:26:31.798] Scheduling timer "check-buildbucket-build-status" (fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5:8870159251872694352:13:0) after 8m33s
[18:35:04.819] Handling timer "check-buildbucket-build-status" (fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5:8870159251872694352:13:0)
[18:35:04.839] Build status: STARTED
[18:35:04.839] Scheduling timer "check-buildbucket-build-status" (fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5:8870159251872694352:14:0) after 9m52s
[18:44:56.901] Handling timer "check-buildbucket-build-status" (fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5:8870159251872694352:14:0)
[18:44:56.920] Build status: STARTED
[18:44:56.920] Scheduling timer "check-buildbucket-build-status" (fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5:8870159251872694352:15:0) after 9m23s
[18:54:20.036] Handling timer "check-buildbucket-build-status" (fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5:8870159251872694352:15:0)
[18:54:20.058] Build status: STARTED
[18:54:20.058] Scheduling timer "check-buildbucket-build-status" (fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5:8870159251872694352:16:0) after 9m59s
[19:04:19.073] Handling timer "check-buildbucket-build-status" (fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5:8870159251872694352:16:0)
[19:04:19.118] Build status: STARTED
[19:04:19.118] Scheduling timer "check-buildbucket-build-status" (fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5:8870159251872694352:17:0) after 2m40s
[19:06:59.278] Handling timer "check-buildbucket-build-status" (fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5:8870159251872694352:17:0)
[19:06:59.395] Build status: STARTED
[19:06:59.395] Scheduling timer "check-buildbucket-build-status" (fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5:8870159251872694352:18:0) after 5m44s
[19:12:43.520] Handling timer "check-buildbucket-build-status" (fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5:8870159251872694352:18:0)
[19:12:43.541] Build status: STARTED
[19:12:43.541] Scheduling timer "check-buildbucket-build-status" (fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5:8870159251872694352:19:0) after 3m36s
[19:15:04.742] Received PubSub notification, asking Buildbucket for the build status
[19:15:04.764] Build:
{
"id": "8704729188402696289",
"builder": {
"project": "fuchsia",
"bucket": "toolchain.ci",
"builder": "clang-mac-arm64"
},
"createdBy": "project:fuchsia",
"createTime": "2025-09-03T17:26:03.956124166Z",
"startTime": "2025-09-03T17:26:08.634369977Z",
"endTime": "2025-09-03T19:15:04.292256053Z",
"updateTime": "2025-09-03T19:15:04.292256053Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "llvm.googlesource.com",
"project": "llvm-project",
"id": "714f6b03bc89bff766ae628092cd059fd8aa0aa1",
"ref": "refs/heads/main"
}
}
}
[19:15:04.764] Invocation finished in 1h49m3.500376755s with status FAILED