[20:37:58.560] New invocation is queued and will start shortly
[20:38:01.128] Starting the invocation (attempt 1)
[20:38:01.154] Popped buildset tag "buildset:commit/gitiles/fuchsia.googlesource.com/integration/+/221013a029f1eac15574e9b5721254e1db63876e"
[20:38:01.154] Popped gitiles commit info from properties and tags
[20:38:01.155] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[20:38:01.155] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[20:38:01.155] Buildbucket request:
{
"requestId": "8835992118786138720",
"builder": {
"project": "fuchsia",
"bucket": "global.ci",
"builder": "core.arm64-hwasan"
},
"properties": {
"$recipe_engine/scheduler": {
"hostname": "luci-scheduler.appspot.com",
"invocation": "8835992118786138720",
"job": "fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f",
"triggers": [
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "a5d42e43843cab78a4a1ecd41618a1ad3611d7c2"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@a5d42e43843cab78a4a1ecd41618a1ad3611d7c2",
"title": "a5d42e43843cab78a4a1ecd41618a1ad3611d7c2",
"url": "https://fuchsia.googlesource.com/integration/+/a5d42e43843cab78a4a1ecd41618a1ad3611d7c2"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "d03df1c0493a0d26fcff91158fe91506398bfc0d"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@d03df1c0493a0d26fcff91158fe91506398bfc0d",
"title": "d03df1c0493a0d26fcff91158fe91506398bfc0d",
"url": "https://fuchsia.googlesource.com/integration/+/d03df1c0493a0d26fcff91158fe91506398bfc0d"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "dc6490eb11b510804e3e076f5e93578b18e45020"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@dc6490eb11b510804e3e076f5e93578b18e45020",
"title": "dc6490eb11b510804e3e076f5e93578b18e45020",
"url": "https://fuchsia.googlesource.com/integration/+/dc6490eb11b510804e3e076f5e93578b18e45020"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "dbf5b64cd6daffd992645cd965ba4df16ea91ad6"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@dbf5b64cd6daffd992645cd965ba4df16ea91ad6",
"title": "dbf5b64cd6daffd992645cd965ba4df16ea91ad6",
"url": "https://fuchsia.googlesource.com/integration/+/dbf5b64cd6daffd992645cd965ba4df16ea91ad6"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "3c5f03ebabb35a1a5aa41e83134a055247d3b587"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@3c5f03ebabb35a1a5aa41e83134a055247d3b587",
"title": "3c5f03ebabb35a1a5aa41e83134a055247d3b587",
"url": "https://fuchsia.googlesource.com/integration/+/3c5f03ebabb35a1a5aa41e83134a055247d3b587"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "985fc1f6dcdb04425245e8726c1fdfb9ee136585"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@985fc1f6dcdb04425245e8726c1fdfb9ee136585",
"title": "985fc1f6dcdb04425245e8726c1fdfb9ee136585",
"url": "https://fuchsia.googlesource.com/integration/+/985fc1f6dcdb04425245e8726c1fdfb9ee136585"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "c094029fa32169c48019e06510c9fd8f57c703ff"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@c094029fa32169c48019e06510c9fd8f57c703ff",
"title": "c094029fa32169c48019e06510c9fd8f57c703ff",
"url": "https://fuchsia.googlesource.com/integration/+/c094029fa32169c48019e06510c9fd8f57c703ff"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "e2142029903ad8cb7e7e8b5b27ecf3b926124bde"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@e2142029903ad8cb7e7e8b5b27ecf3b926124bde",
"title": "e2142029903ad8cb7e7e8b5b27ecf3b926124bde",
"url": "https://fuchsia.googlesource.com/integration/+/e2142029903ad8cb7e7e8b5b27ecf3b926124bde"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "24e8996979a24af8550df37b839a2f272131fc9d"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@24e8996979a24af8550df37b839a2f272131fc9d",
"title": "24e8996979a24af8550df37b839a2f272131fc9d",
"url": "https://fuchsia.googlesource.com/integration/+/24e8996979a24af8550df37b839a2f272131fc9d"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "c752ccfcfc1b81cbd92504b8dae435d963745442"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@c752ccfcfc1b81cbd92504b8dae435d963745442",
"title": "c752ccfcfc1b81cbd92504b8dae435d963745442",
"url": "https://fuchsia.googlesource.com/integration/+/c752ccfcfc1b81cbd92504b8dae435d963745442"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "01cebf5212cb7216e8cdffaa299cec6b813711c1"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@01cebf5212cb7216e8cdffaa299cec6b813711c1",
"title": "01cebf5212cb7216e8cdffaa299cec6b813711c1",
"url": "https://fuchsia.googlesource.com/integration/+/01cebf5212cb7216e8cdffaa299cec6b813711c1"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "bdc1e550682b2f1be7fe34dd14b047ea726a2bdb"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@bdc1e550682b2f1be7fe34dd14b047ea726a2bdb",
"title": "bdc1e550682b2f1be7fe34dd14b047ea726a2bdb",
"url": "https://fuchsia.googlesource.com/integration/+/bdc1e550682b2f1be7fe34dd14b047ea726a2bdb"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "6bf6a0444b79fbe61062f3c21f53746a8afc18db"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@6bf6a0444b79fbe61062f3c21f53746a8afc18db",
"title": "6bf6a0444b79fbe61062f3c21f53746a8afc18db",
"url": "https://fuchsia.googlesource.com/integration/+/6bf6a0444b79fbe61062f3c21f53746a8afc18db"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "221013a029f1eac15574e9b5721254e1db63876e"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@221013a029f1eac15574e9b5721254e1db63876e",
"title": "221013a029f1eac15574e9b5721254e1db63876e",
"url": "https://fuchsia.googlesource.com/integration/+/221013a029f1eac15574e9b5721254e1db63876e"
}
]
}
},
"gitilesCommit": {
"host": "fuchsia.googlesource.com",
"project": "integration",
"id": "221013a029f1eac15574e9b5721254e1db63876e",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8835992118786138720"
},
{
"key": "scheduler_job_id",
"value": "fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[20:38:01.545] Scheduled build:
{
"id": "8670562055333878833",
"builder": {
"project": "fuchsia",
"bucket": "global.ci",
"builder": "core.arm64-hwasan"
},
"createdBy": "project:fuchsia",
"createTime": "2026-09-15T20:38:01.229555532Z",
"updateTime": "2026-09-15T20:38:01.229555532Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "fuchsia.googlesource.com",
"project": "integration",
"id": "221013a029f1eac15574e9b5721254e1db63876e",
"ref": "refs/heads/main"
}
}
}
[20:38:01.545] Task URL: https://cr-buildbucket.appspot.com/build/8670562055333878833
[20:38:01.545] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8835992118786138720:2:0) after 8m19s
[20:38:02.850] Received PubSub notification, asking Buildbucket for the build status
[20:38:02.869] Build status: SCHEDULED
[20:38:12.991] Received PubSub notification, asking Buildbucket for the build status
[20:38:13.018] Build status: STARTED
[20:46:20.568] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8835992118786138720:2:0)
[20:46:20.590] Build status: STARTED
[20:46:20.590] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8835992118786138720:5:0) after 3m6s
[20:49:26.823] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8835992118786138720:5:0)
[20:49:26.886] Build status: STARTED
[20:49:26.886] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8835992118786138720:6:0) after 6m32s
[20:55:59.221] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8835992118786138720:6:0)
[20:55:59.267] Build status: STARTED
[20:55:59.267] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8835992118786138720:7:0) after 6m43s
[21:02:42.365] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8835992118786138720:7:0)
[21:02:42.390] Build status: STARTED
[21:02:42.390] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8835992118786138720:8:0) after 2m10s
[21:04:52.475] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8835992118786138720:8:0)
[21:04:52.497] Build status: STARTED
[21:04:52.497] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8835992118786138720:9:0) after 5m7s
[21:09:59.713] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8835992118786138720:9:0)
[21:09:59.738] Build status: STARTED
[21:09:59.738] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8835992118786138720:10:0) after 6m52s
[21:16:51.882] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8835992118786138720:10:0)
[21:16:51.954] Build status: STARTED
[21:16:51.954] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8835992118786138720:11:0) after 9m56s
[21:26:48.069] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8835992118786138720:11:0)
[21:26:48.949] Build status: STARTED
[21:26:48.949] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8835992118786138720:12:0) after 6m32s
[21:33:21.015] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8835992118786138720:12:0)
[21:33:21.066] Build status: STARTED
[21:33:21.066] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8835992118786138720:13:0) after 4m6s
[21:37:27.050] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8835992118786138720:13:0)
[21:37:27.069] Build status: STARTED
[21:37:27.070] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8835992118786138720:14:0) after 6m53s
[21:44:20.063] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8835992118786138720:14:0)
[21:44:20.097] Build status: STARTED
[21:44:20.097] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8835992118786138720:15:0) after 5m28s
[21:49:48.084] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8835992118786138720:15:0)
[21:49:48.101] Build status: STARTED
[21:49:48.101] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8835992118786138720:16:0) after 9m30s
[21:59:18.174] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8835992118786138720:16:0)
[21:59:18.199] Build status: STARTED
[21:59:18.200] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8835992118786138720:17:0) after 7m17s
[22:06:35.262] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8835992118786138720:17:0)
[22:06:35.291] Build status: STARTED
[22:06:35.291] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8835992118786138720:18:0) after 3m48s
[22:10:23.419] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8835992118786138720:18:0)
[22:10:23.452] Build status: STARTED
[22:10:23.452] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8835992118786138720:19:0) after 7m28s
[22:17:51.581] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8835992118786138720:19:0)
[22:17:51.607] Build status: STARTED
[22:17:51.607] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8835992118786138720:20:0) after 4m5s
[22:21:56.766] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8835992118786138720:20:0)
[22:21:56.815] Build status: STARTED
[22:21:56.815] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8835992118786138720:21:0) after 4m28s
[22:26:25.085] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8835992118786138720:21:0)
[22:26:25.108] Build status: STARTED
[22:26:25.108] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8835992118786138720:22:0) after 4m44s
[22:31:09.215] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8835992118786138720:22:0)
[22:31:09.259] Build status: STARTED
[22:31:09.259] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8835992118786138720:23:0) after 3m55s
[22:31:58.947] Received PubSub notification, asking Buildbucket for the build status
[22:31:58.975] Build:
{
"id": "8670562055333878833",
"builder": {
"project": "fuchsia",
"bucket": "global.ci",
"builder": "core.arm64-hwasan"
},
"createdBy": "project:fuchsia",
"createTime": "2026-09-15T20:38:01.229555532Z",
"startTime": "2026-09-15T20:38:12.820220705Z",
"endTime": "2026-09-15T22:31:58.195728759Z",
"updateTime": "2026-09-15T22:31:58.195728759Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "fuchsia.googlesource.com",
"project": "integration",
"id": "221013a029f1eac15574e9b5721254e1db63876e",
"ref": "refs/heads/main"
}
}
}
[22:31:58.975] Invocation finished in 1h54m0.422054333s with status FAILED