[15:21:40.227] New invocation is queued and will start shortly
[15:21:41.306] Starting the invocation (attempt 1)
[15:21:41.331] Popped buildset tag "buildset:commit/gitiles/llvm.googlesource.com/llvm-project/+/9ef0a886e621eb4202f82054983c383fa82aff9a"
[15:21:41.331] Popped gitiles commit info from properties and tags
[15:21:41.331] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[15:21:41.331] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[15:21:41.332] Buildbucket request:
{
"requestId": "8875149908497765488",
"builder": {
"project": "fuchsia",
"bucket": "toolchain.ci",
"builder": "clang-mac-arm64"
},
"properties": {
"$recipe_engine/scheduler": {
"hostname": "luci-scheduler.appspot.com",
"invocation": "8875149908497765488",
"job": "fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5",
"triggers": [
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://llvm.googlesource.com/llvm-project",
"revision": "d14aa0cd46c652e417b5a777fe5a05c2a4df8364"
},
"id": "https://llvm.googlesource.com/llvm-project/+/refs/heads/main@d14aa0cd46c652e417b5a777fe5a05c2a4df8364",
"title": "d14aa0cd46c652e417b5a777fe5a05c2a4df8364",
"url": "https://llvm.googlesource.com/llvm-project/+/d14aa0cd46c652e417b5a777fe5a05c2a4df8364"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://llvm.googlesource.com/llvm-project",
"revision": "498aeada7b8e079f5bc59bf4e9bb0c8630ee6d32"
},
"id": "https://llvm.googlesource.com/llvm-project/+/refs/heads/main@498aeada7b8e079f5bc59bf4e9bb0c8630ee6d32",
"title": "498aeada7b8e079f5bc59bf4e9bb0c8630ee6d32",
"url": "https://llvm.googlesource.com/llvm-project/+/498aeada7b8e079f5bc59bf4e9bb0c8630ee6d32"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://llvm.googlesource.com/llvm-project",
"revision": "d801b54bcd971f9415da2cce397d12d2129ea1b0"
},
"id": "https://llvm.googlesource.com/llvm-project/+/refs/heads/main@d801b54bcd971f9415da2cce397d12d2129ea1b0",
"title": "d801b54bcd971f9415da2cce397d12d2129ea1b0",
"url": "https://llvm.googlesource.com/llvm-project/+/d801b54bcd971f9415da2cce397d12d2129ea1b0"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://llvm.googlesource.com/llvm-project",
"revision": "13ead00049e2faea57dac2d9a43f2aef5bbe3370"
},
"id": "https://llvm.googlesource.com/llvm-project/+/refs/heads/main@13ead00049e2faea57dac2d9a43f2aef5bbe3370",
"title": "13ead00049e2faea57dac2d9a43f2aef5bbe3370",
"url": "https://llvm.googlesource.com/llvm-project/+/13ead00049e2faea57dac2d9a43f2aef5bbe3370"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://llvm.googlesource.com/llvm-project",
"revision": "466357ab51609bceaf40daa04e2a4a9fe409939e"
},
"id": "https://llvm.googlesource.com/llvm-project/+/refs/heads/main@466357ab51609bceaf40daa04e2a4a9fe409939e",
"title": "466357ab51609bceaf40daa04e2a4a9fe409939e",
"url": "https://llvm.googlesource.com/llvm-project/+/466357ab51609bceaf40daa04e2a4a9fe409939e"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://llvm.googlesource.com/llvm-project",
"revision": "18627e995c361124087480c199169e2ce000ad49"
},
"id": "https://llvm.googlesource.com/llvm-project/+/refs/heads/main@18627e995c361124087480c199169e2ce000ad49",
"title": "18627e995c361124087480c199169e2ce000ad49",
"url": "https://llvm.googlesource.com/llvm-project/+/18627e995c361124087480c199169e2ce000ad49"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://llvm.googlesource.com/llvm-project",
"revision": "5954e9c1a56fc313394b9dcc21f20c20c058f83d"
},
"id": "https://llvm.googlesource.com/llvm-project/+/refs/heads/main@5954e9c1a56fc313394b9dcc21f20c20c058f83d",
"title": "5954e9c1a56fc313394b9dcc21f20c20c058f83d",
"url": "https://llvm.googlesource.com/llvm-project/+/5954e9c1a56fc313394b9dcc21f20c20c058f83d"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://llvm.googlesource.com/llvm-project",
"revision": "763db3841dba8f88f95e63e718dffea64b32044a"
},
"id": "https://llvm.googlesource.com/llvm-project/+/refs/heads/main@763db3841dba8f88f95e63e718dffea64b32044a",
"title": "763db3841dba8f88f95e63e718dffea64b32044a",
"url": "https://llvm.googlesource.com/llvm-project/+/763db3841dba8f88f95e63e718dffea64b32044a"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://llvm.googlesource.com/llvm-project",
"revision": "1409e1a5e5f878b55441c72cb1ef384405d953c7"
},
"id": "https://llvm.googlesource.com/llvm-project/+/refs/heads/main@1409e1a5e5f878b55441c72cb1ef384405d953c7",
"title": "1409e1a5e5f878b55441c72cb1ef384405d953c7",
"url": "https://llvm.googlesource.com/llvm-project/+/1409e1a5e5f878b55441c72cb1ef384405d953c7"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://llvm.googlesource.com/llvm-project",
"revision": "154de3e1bdd83ccaf7be51bb876db4593a064607"
},
"id": "https://llvm.googlesource.com/llvm-project/+/refs/heads/main@154de3e1bdd83ccaf7be51bb876db4593a064607",
"title": "154de3e1bdd83ccaf7be51bb876db4593a064607",
"url": "https://llvm.googlesource.com/llvm-project/+/154de3e1bdd83ccaf7be51bb876db4593a064607"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://llvm.googlesource.com/llvm-project",
"revision": "f56b6ecf088ef46fe8008f294fff456805b33a07"
},
"id": "https://llvm.googlesource.com/llvm-project/+/refs/heads/main@f56b6ecf088ef46fe8008f294fff456805b33a07",
"title": "f56b6ecf088ef46fe8008f294fff456805b33a07",
"url": "https://llvm.googlesource.com/llvm-project/+/f56b6ecf088ef46fe8008f294fff456805b33a07"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://llvm.googlesource.com/llvm-project",
"revision": "362d5ffa8d2f521fc2912665270eba15f3c1bf56"
},
"id": "https://llvm.googlesource.com/llvm-project/+/refs/heads/main@362d5ffa8d2f521fc2912665270eba15f3c1bf56",
"title": "362d5ffa8d2f521fc2912665270eba15f3c1bf56",
"url": "https://llvm.googlesource.com/llvm-project/+/362d5ffa8d2f521fc2912665270eba15f3c1bf56"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://llvm.googlesource.com/llvm-project",
"revision": "a2c0ac06ff69f37a42845217b9a8ae1cdbacd674"
},
"id": "https://llvm.googlesource.com/llvm-project/+/refs/heads/main@a2c0ac06ff69f37a42845217b9a8ae1cdbacd674",
"title": "a2c0ac06ff69f37a42845217b9a8ae1cdbacd674",
"url": "https://llvm.googlesource.com/llvm-project/+/a2c0ac06ff69f37a42845217b9a8ae1cdbacd674"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://llvm.googlesource.com/llvm-project",
"revision": "0227aef688f39c27ba50af2829a9805d62e74e32"
},
"id": "https://llvm.googlesource.com/llvm-project/+/refs/heads/main@0227aef688f39c27ba50af2829a9805d62e74e32",
"title": "0227aef688f39c27ba50af2829a9805d62e74e32",
"url": "https://llvm.googlesource.com/llvm-project/+/0227aef688f39c27ba50af2829a9805d62e74e32"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://llvm.googlesource.com/llvm-project",
"revision": "c8c0e90233787dba9f069d8f559dffeb31f8e357"
},
"id": "https://llvm.googlesource.com/llvm-project/+/refs/heads/main@c8c0e90233787dba9f069d8f559dffeb31f8e357",
"title": "c8c0e90233787dba9f069d8f559dffeb31f8e357",
"url": "https://llvm.googlesource.com/llvm-project/+/c8c0e90233787dba9f069d8f559dffeb31f8e357"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://llvm.googlesource.com/llvm-project",
"revision": "9b0ae6ccd6bc9c4fe05064b6e1bb192f189e8f3b"
},
"id": "https://llvm.googlesource.com/llvm-project/+/refs/heads/main@9b0ae6ccd6bc9c4fe05064b6e1bb192f189e8f3b",
"title": "9b0ae6ccd6bc9c4fe05064b6e1bb192f189e8f3b",
"url": "https://llvm.googlesource.com/llvm-project/+/9b0ae6ccd6bc9c4fe05064b6e1bb192f189e8f3b"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://llvm.googlesource.com/llvm-project",
"revision": "86320e0a8f2d88877775ca685ae3d70ac954faf3"
},
"id": "https://llvm.googlesource.com/llvm-project/+/refs/heads/main@86320e0a8f2d88877775ca685ae3d70ac954faf3",
"title": "86320e0a8f2d88877775ca685ae3d70ac954faf3",
"url": "https://llvm.googlesource.com/llvm-project/+/86320e0a8f2d88877775ca685ae3d70ac954faf3"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://llvm.googlesource.com/llvm-project",
"revision": "f96492221d2bf272053bca6660fc4bdd86592478"
},
"id": "https://llvm.googlesource.com/llvm-project/+/refs/heads/main@f96492221d2bf272053bca6660fc4bdd86592478",
"title": "f96492221d2bf272053bca6660fc4bdd86592478",
"url": "https://llvm.googlesource.com/llvm-project/+/f96492221d2bf272053bca6660fc4bdd86592478"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://llvm.googlesource.com/llvm-project",
"revision": "4453792e8dbd861a5857b3bbe56fa73d2fdbbe39"
},
"id": "https://llvm.googlesource.com/llvm-project/+/refs/heads/main@4453792e8dbd861a5857b3bbe56fa73d2fdbbe39",
"title": "4453792e8dbd861a5857b3bbe56fa73d2fdbbe39",
"url": "https://llvm.googlesource.com/llvm-project/+/4453792e8dbd861a5857b3bbe56fa73d2fdbbe39"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://llvm.googlesource.com/llvm-project",
"revision": "9ef0a886e621eb4202f82054983c383fa82aff9a"
},
"id": "https://llvm.googlesource.com/llvm-project/+/refs/heads/main@9ef0a886e621eb4202f82054983c383fa82aff9a",
"title": "9ef0a886e621eb4202f82054983c383fa82aff9a",
"url": "https://llvm.googlesource.com/llvm-project/+/9ef0a886e621eb4202f82054983c383fa82aff9a"
}
]
}
},
"gitilesCommit": {
"host": "llvm.googlesource.com",
"project": "llvm-project",
"id": "9ef0a886e621eb4202f82054983c383fa82aff9a",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8875149908497765488"
},
{
"key": "scheduler_job_id",
"value": "fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[15:21:41.799] Scheduled build:
{
"id": "8709719846608046817",
"builder": {
"project": "fuchsia",
"bucket": "toolchain.ci",
"builder": "clang-mac-arm64"
},
"createdBy": "project:fuchsia",
"createTime": "2025-07-10T15:21:41.404220075Z",
"updateTime": "2025-07-10T15:21:41.404220075Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "llvm.googlesource.com",
"project": "llvm-project",
"id": "9ef0a886e621eb4202f82054983c383fa82aff9a",
"ref": "refs/heads/main"
}
}
}
[15:21:41.799] Task URL: https://cr-buildbucket.appspot.com/build/8709719846608046817
[15:21:41.799] Scheduling timer "check-buildbucket-build-status" (fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5:8875149908497765488:2:0) after 8m37s
[15:21:45.127] Received PubSub notification, asking Buildbucket for the build status
[15:21:45.178] Build status: STARTED
[15:21:47.747] Received PubSub notification, asking Buildbucket for the build status
[15:21:47.776] Build status: STARTED
[15:30:18.925] Handling timer "check-buildbucket-build-status" (fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5:8875149908497765488:2:0)
[15:30:19.041] Build status: STARTED
[15:30:19.041] Scheduling timer "check-buildbucket-build-status" (fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5:8875149908497765488:5:0) after 4m24s
[15:34:43.016] Handling timer "check-buildbucket-build-status" (fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5:8875149908497765488:5:0)
[15:34:43.044] Build status: STARTED
[15:34:43.045] Scheduling timer "check-buildbucket-build-status" (fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5:8875149908497765488:6:0) after 6m23s
[15:41:06.145] Handling timer "check-buildbucket-build-status" (fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5:8875149908497765488:6:0)
[15:41:06.177] Build status: STARTED
[15:41:06.177] Scheduling timer "check-buildbucket-build-status" (fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5:8875149908497765488:7:0) after 9m12s
[15:50:18.293] Handling timer "check-buildbucket-build-status" (fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5:8875149908497765488:7:0)
[15:50:18.322] Build status: STARTED
[15:50:18.322] Scheduling timer "check-buildbucket-build-status" (fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5:8875149908497765488:8:0) after 1m1s
[15:51:19.315] Handling timer "check-buildbucket-build-status" (fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5:8875149908497765488:8:0)
[15:51:19.336] Build status: STARTED
[15:51:19.336] Scheduling timer "check-buildbucket-build-status" (fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5:8875149908497765488:9:0) after 5m26s
[15:56:45.355] Handling timer "check-buildbucket-build-status" (fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5:8875149908497765488:9:0)
[15:56:45.391] Build status: STARTED
[15:56:45.391] Scheduling timer "check-buildbucket-build-status" (fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5:8875149908497765488:10:0) after 5m58s
[16:02:43.460] Handling timer "check-buildbucket-build-status" (fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5:8875149908497765488:10:0)
[16:02:43.493] Build status: STARTED
[16:02:43.493] Scheduling timer "check-buildbucket-build-status" (fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5:8875149908497765488:11:0) after 5m2s
[16:07:45.513] Handling timer "check-buildbucket-build-status" (fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5:8875149908497765488:11:0)
[16:07:45.604] Build status: STARTED
[16:07:45.604] Scheduling timer "check-buildbucket-build-status" (fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5:8875149908497765488:12:0) after 8m38s
[16:16:23.683] Handling timer "check-buildbucket-build-status" (fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5:8875149908497765488:12:0)
[16:16:23.720] Build status: STARTED
[16:16:23.720] Scheduling timer "check-buildbucket-build-status" (fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5:8875149908497765488:13:0) after 9m18s
[16:25:41.756] Handling timer "check-buildbucket-build-status" (fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5:8875149908497765488:13:0)
[16:25:41.770] Build status: STARTED
[16:25:41.770] Scheduling timer "check-buildbucket-build-status" (fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5:8875149908497765488:14:0) after 7m24s
[16:33:05.809] Handling timer "check-buildbucket-build-status" (fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5:8875149908497765488:14:0)
[16:33:05.829] Build status: STARTED
[16:33:05.829] Scheduling timer "check-buildbucket-build-status" (fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5:8875149908497765488:15:0) after 4m26s
[16:37:31.904] Handling timer "check-buildbucket-build-status" (fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5:8875149908497765488:15:0)
[16:37:31.927] Build status: STARTED
[16:37:31.927] Scheduling timer "check-buildbucket-build-status" (fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5:8875149908497765488:16:0) after 1m6s
[16:38:38.040] Handling timer "check-buildbucket-build-status" (fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5:8875149908497765488:16:0)
[16:38:38.108] Build status: STARTED
[16:38:38.108] Scheduling timer "check-buildbucket-build-status" (fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5:8875149908497765488:17:0) after 1m5s
[16:39:43.233] Handling timer "check-buildbucket-build-status" (fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5:8875149908497765488:17:0)
[16:39:43.253] Build status: STARTED
[16:39:43.253] Scheduling timer "check-buildbucket-build-status" (fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5:8875149908497765488:18:0) after 6m11s
[16:45:54.327] Handling timer "check-buildbucket-build-status" (fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5:8875149908497765488:18:0)
[16:45:54.348] Build status: STARTED
[16:45:54.348] Scheduling timer "check-buildbucket-build-status" (fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5:8875149908497765488:19:0) after 3m12s
[16:49:06.426] Handling timer "check-buildbucket-build-status" (fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5:8875149908497765488:19:0)
[16:49:06.440] Build status: STARTED
[16:49:06.440] Scheduling timer "check-buildbucket-build-status" (fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5:8875149908497765488:20:0) after 3m50s
[16:52:56.463] Handling timer "check-buildbucket-build-status" (fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5:8875149908497765488:20:0)
[16:52:56.484] Build status: STARTED
[16:52:56.484] Scheduling timer "check-buildbucket-build-status" (fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5:8875149908497765488:21:0) after 9m23s
[17:02:19.506] Handling timer "check-buildbucket-build-status" (fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5:8875149908497765488:21:0)
[17:02:19.525] Build status: STARTED
[17:02:19.525] Scheduling timer "check-buildbucket-build-status" (fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5:8875149908497765488:22:0) after 1m38s
[17:03:57.551] Handling timer "check-buildbucket-build-status" (fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5:8875149908497765488:22:0)
[17:03:57.613] Build status: STARTED
[17:03:57.613] Scheduling timer "check-buildbucket-build-status" (fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5:8875149908497765488:23:0) after 1m35s
[17:05:32.642] Handling timer "check-buildbucket-build-status" (fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5:8875149908497765488:23:0)
[17:05:32.738] Build status: STARTED
[17:05:32.738] Scheduling timer "check-buildbucket-build-status" (fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5:8875149908497765488:24:0) after 1m45s
[17:07:17.763] Handling timer "check-buildbucket-build-status" (fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5:8875149908497765488:24:0)
[17:07:17.785] Build status: STARTED
[17:07:17.785] Scheduling timer "check-buildbucket-build-status" (fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5:8875149908497765488:25:0) after 3m57s
[17:11:14.907] Handling timer "check-buildbucket-build-status" (fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5:8875149908497765488:25:0)
[17:11:14.937] Build status: STARTED
[17:11:14.937] Scheduling timer "check-buildbucket-build-status" (fuchsia/toolchain.ci-clang-mac-arm64-40be1bb5:8875149908497765488:26:0) after 3m2s
[17:14:09.189] Received PubSub notification, asking Buildbucket for the build status
[17:14:09.233] Build:
{
"id": "8709719846608046817",
"builder": {
"project": "fuchsia",
"bucket": "toolchain.ci",
"builder": "clang-mac-arm64"
},
"createdBy": "project:fuchsia",
"createTime": "2025-07-10T15:21:41.404220075Z",
"startTime": "2025-07-10T15:21:44.617871231Z",
"endTime": "2025-07-10T17:14:08.798374282Z",
"updateTime": "2025-07-10T17:14:08.798374282Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "llvm.googlesource.com",
"project": "llvm-project",
"id": "9ef0a886e621eb4202f82054983c383fa82aff9a",
"ref": "refs/heads/main"
}
}
}
[17:14:09.233] Invocation finished in 1h52m29.014976415s with status FAILED