[00:10:32.086] New invocation is queued and will start shortly
[00:10:33.143] Starting the invocation (attempt 1)
[00:10:33.171] Popped buildset tag "buildset:commit/gitiles/fuchsia.googlesource.com/integration/+/fa273ed09cac4fe0ad759a24797f6d593724f35f"
[00:10:33.171] Popped gitiles commit info from properties and tags
[00:10:33.171] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[00:10:33.172] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[00:10:33.172] Buildbucket request:
{
"requestId": "8854188735987226432",
"builder": {
"project": "fuchsia",
"bucket": "global.ci",
"builder": "core.arm64-hwasan"
},
"properties": {
"$recipe_engine/scheduler": {
"hostname": "luci-scheduler.appspot.com",
"invocation": "8854188735987226432",
"job": "fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f",
"triggers": [
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "5065c2d4f8136e01cd1dfb24b99dae8689f7220a"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@5065c2d4f8136e01cd1dfb24b99dae8689f7220a",
"title": "5065c2d4f8136e01cd1dfb24b99dae8689f7220a",
"url": "https://fuchsia.googlesource.com/integration/+/5065c2d4f8136e01cd1dfb24b99dae8689f7220a"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "61f2af9d122d147013e64bdad2f2cce5425d0728"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@61f2af9d122d147013e64bdad2f2cce5425d0728",
"title": "61f2af9d122d147013e64bdad2f2cce5425d0728",
"url": "https://fuchsia.googlesource.com/integration/+/61f2af9d122d147013e64bdad2f2cce5425d0728"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "ed183d5328e6e86d61b32362913ca708d95b7eca"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@ed183d5328e6e86d61b32362913ca708d95b7eca",
"title": "ed183d5328e6e86d61b32362913ca708d95b7eca",
"url": "https://fuchsia.googlesource.com/integration/+/ed183d5328e6e86d61b32362913ca708d95b7eca"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "2a53442a09a5aaeed4d7cdc864ec9868d742dcb7"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@2a53442a09a5aaeed4d7cdc864ec9868d742dcb7",
"title": "2a53442a09a5aaeed4d7cdc864ec9868d742dcb7",
"url": "https://fuchsia.googlesource.com/integration/+/2a53442a09a5aaeed4d7cdc864ec9868d742dcb7"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "2526224356c80f3864d19f1428a2b7aa8cc82a75"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@2526224356c80f3864d19f1428a2b7aa8cc82a75",
"title": "2526224356c80f3864d19f1428a2b7aa8cc82a75",
"url": "https://fuchsia.googlesource.com/integration/+/2526224356c80f3864d19f1428a2b7aa8cc82a75"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "2e18b96e5c777ecace841217c5922078b3ad8b6e"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@2e18b96e5c777ecace841217c5922078b3ad8b6e",
"title": "2e18b96e5c777ecace841217c5922078b3ad8b6e",
"url": "https://fuchsia.googlesource.com/integration/+/2e18b96e5c777ecace841217c5922078b3ad8b6e"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "834e17e7919573bf7c73e472133af35532960337"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@834e17e7919573bf7c73e472133af35532960337",
"title": "834e17e7919573bf7c73e472133af35532960337",
"url": "https://fuchsia.googlesource.com/integration/+/834e17e7919573bf7c73e472133af35532960337"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "a8945bd2a558e74a973f94df5e8479e3173adc80"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@a8945bd2a558e74a973f94df5e8479e3173adc80",
"title": "a8945bd2a558e74a973f94df5e8479e3173adc80",
"url": "https://fuchsia.googlesource.com/integration/+/a8945bd2a558e74a973f94df5e8479e3173adc80"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "58ddd28e54f494697c3e4ed30cfd75b3bb9bd5d6"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@58ddd28e54f494697c3e4ed30cfd75b3bb9bd5d6",
"title": "58ddd28e54f494697c3e4ed30cfd75b3bb9bd5d6",
"url": "https://fuchsia.googlesource.com/integration/+/58ddd28e54f494697c3e4ed30cfd75b3bb9bd5d6"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "ca20a6ad3203b567b2b6a20941b72723ec6db95e"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@ca20a6ad3203b567b2b6a20941b72723ec6db95e",
"title": "ca20a6ad3203b567b2b6a20941b72723ec6db95e",
"url": "https://fuchsia.googlesource.com/integration/+/ca20a6ad3203b567b2b6a20941b72723ec6db95e"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "66cebdf05ea4ad42d3d3c2386658f4a8fece80b3"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@66cebdf05ea4ad42d3d3c2386658f4a8fece80b3",
"title": "66cebdf05ea4ad42d3d3c2386658f4a8fece80b3",
"url": "https://fuchsia.googlesource.com/integration/+/66cebdf05ea4ad42d3d3c2386658f4a8fece80b3"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "562e84d4a58ad3514068423814aa9494844963aa"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@562e84d4a58ad3514068423814aa9494844963aa",
"title": "562e84d4a58ad3514068423814aa9494844963aa",
"url": "https://fuchsia.googlesource.com/integration/+/562e84d4a58ad3514068423814aa9494844963aa"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "bfa40091788969a1cdc6f9c73b5cb7716081a305"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@bfa40091788969a1cdc6f9c73b5cb7716081a305",
"title": "bfa40091788969a1cdc6f9c73b5cb7716081a305",
"url": "https://fuchsia.googlesource.com/integration/+/bfa40091788969a1cdc6f9c73b5cb7716081a305"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "e361da4d64d7f0bb521583d98b43c1eb5115fe60"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@e361da4d64d7f0bb521583d98b43c1eb5115fe60",
"title": "e361da4d64d7f0bb521583d98b43c1eb5115fe60",
"url": "https://fuchsia.googlesource.com/integration/+/e361da4d64d7f0bb521583d98b43c1eb5115fe60"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "41f695bf60a5bc85c58569733beaeed8052f3c30"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@41f695bf60a5bc85c58569733beaeed8052f3c30",
"title": "41f695bf60a5bc85c58569733beaeed8052f3c30",
"url": "https://fuchsia.googlesource.com/integration/+/41f695bf60a5bc85c58569733beaeed8052f3c30"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "d7714daf466e2774ae05bcd77be1c5043a1fd611"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@d7714daf466e2774ae05bcd77be1c5043a1fd611",
"title": "d7714daf466e2774ae05bcd77be1c5043a1fd611",
"url": "https://fuchsia.googlesource.com/integration/+/d7714daf466e2774ae05bcd77be1c5043a1fd611"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "fa273ed09cac4fe0ad759a24797f6d593724f35f"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@fa273ed09cac4fe0ad759a24797f6d593724f35f",
"title": "fa273ed09cac4fe0ad759a24797f6d593724f35f",
"url": "https://fuchsia.googlesource.com/integration/+/fa273ed09cac4fe0ad759a24797f6d593724f35f"
}
]
}
},
"gitilesCommit": {
"host": "fuchsia.googlesource.com",
"project": "integration",
"id": "fa273ed09cac4fe0ad759a24797f6d593724f35f",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8854188735987226432"
},
{
"key": "scheduler_job_id",
"value": "fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[00:10:33.543] Scheduled build:
{
"id": "8688758674149812673",
"builder": {
"project": "fuchsia",
"bucket": "global.ci",
"builder": "core.arm64-hwasan"
},
"createdBy": "project:fuchsia",
"createTime": "2026-02-27T00:10:33.219217031Z",
"updateTime": "2026-02-27T00:10:33.219217031Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "fuchsia.googlesource.com",
"project": "integration",
"id": "fa273ed09cac4fe0ad759a24797f6d593724f35f",
"ref": "refs/heads/main"
}
}
}
[00:10:33.543] Task URL: https://cr-buildbucket.appspot.com/build/8688758674149812673
[00:10:33.543] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8854188735987226432:2:0) after 1m7s
[00:10:34.601] Received PubSub notification, asking Buildbucket for the build status
[00:10:34.618] Build status: SCHEDULED
[00:11:40.560] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8854188735987226432:2:0)
[00:11:40.575] Build status: SCHEDULED
[00:11:40.575] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8854188735987226432:4:0) after 2m53s
[00:14:33.613] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8854188735987226432:4:0)
[00:14:33.633] Build status: SCHEDULED
[00:14:33.633] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8854188735987226432:5:0) after 6m13s
[00:14:44.788] Received PubSub notification, asking Buildbucket for the build status
[00:14:44.813] Build status: STARTED
[00:20:46.816] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8854188735987226432:5:0)
[00:20:46.882] Build status: STARTED
[00:20:46.882] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8854188735987226432:7:0) after 1m20s
[00:22:06.903] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8854188735987226432:7:0)
[00:22:06.919] Build status: STARTED
[00:22:06.919] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8854188735987226432:8:0) after 9m42s
[00:31:48.977] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8854188735987226432:8:0)
[00:31:48.997] Build status: STARTED
[00:31:48.997] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8854188735987226432:9:0) after 1m45s
[00:33:34.077] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8854188735987226432:9:0)
[00:33:34.099] Build status: STARTED
[00:33:34.099] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8854188735987226432:10:0) after 3m13s
[00:36:47.203] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8854188735987226432:10:0)
[00:36:47.217] Build status: STARTED
[00:36:47.217] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8854188735987226432:11:0) after 9m21s
[00:46:08.347] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8854188735987226432:11:0)
[00:46:08.364] Build status: STARTED
[00:46:08.364] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8854188735987226432:12:0) after 3m14s
[00:49:22.492] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8854188735987226432:12:0)
[00:49:22.506] Build status: STARTED
[00:49:22.506] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8854188735987226432:13:0) after 3m27s
[00:52:49.626] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8854188735987226432:13:0)
[00:52:49.640] Build status: STARTED
[00:52:49.641] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8854188735987226432:14:0) after 5m0s
[00:57:49.710] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8854188735987226432:14:0)
[00:57:49.727] Build status: STARTED
[00:57:49.727] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8854188735987226432:15:0) after 5m1s
[01:02:50.744] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8854188735987226432:15:0)
[01:02:50.768] Build status: STARTED
[01:02:50.768] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8854188735987226432:16:0) after 3m11s
[01:06:01.783] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8854188735987226432:16:0)
[01:06:01.801] Build status: STARTED
[01:06:01.801] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8854188735987226432:17:0) after 8m39s
[01:14:40.927] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8854188735987226432:17:0)
[01:14:40.946] Build status: STARTED
[01:14:40.946] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8854188735987226432:18:0) after 4m43s
[01:19:23.967] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8854188735987226432:18:0)
[01:19:23.986] Build status: STARTED
[01:19:23.986] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8854188735987226432:19:0) after 3m38s
[01:21:48.036] Received PubSub notification, asking Buildbucket for the build status
[01:21:48.054] Build:
{
"id": "8688758674149812673",
"builder": {
"project": "fuchsia",
"bucket": "global.ci",
"builder": "core.arm64-hwasan"
},
"createdBy": "project:fuchsia",
"createTime": "2026-02-27T00:10:33.219217031Z",
"startTime": "2026-02-27T00:14:44.411670865Z",
"endTime": "2026-02-27T01:21:47.263336276Z",
"updateTime": "2026-02-27T01:21:47.263336276Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "fuchsia.googlesource.com",
"project": "integration",
"id": "fa273ed09cac4fe0ad759a24797f6d593724f35f",
"ref": "refs/heads/main"
}
}
}
[01:21:48.054] Invocation finished in 1h11m15.970749804s with status FAILED