[19:17:07.327] New invocation is queued and will start shortly
[19:17:10.164] Starting the invocation (attempt 1)
[19:17:10.187] Popped buildset tag "buildset:commit/gitiles/fuchsia.googlesource.com/integration/+/59d2a4743d4bd5a3ba62f06f30739b0892ce0d50"
[19:17:10.187] Popped gitiles commit info from properties and tags
[19:17:10.187] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[19:17:10.187] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[19:17:10.188] Buildbucket request:
{
"requestId": "8853029435356964544",
"builder": {
"project": "fuchsia",
"bucket": "global.ci",
"builder": "core.arm64-hwasan"
},
"properties": {
"$recipe_engine/scheduler": {
"hostname": "luci-scheduler.appspot.com",
"invocation": "8853029435356964544",
"job": "fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f",
"triggers": [
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "cacf2b0fdc96988d6870debc1ec121ccb19a61fd"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@cacf2b0fdc96988d6870debc1ec121ccb19a61fd",
"title": "cacf2b0fdc96988d6870debc1ec121ccb19a61fd",
"url": "https://fuchsia.googlesource.com/integration/+/cacf2b0fdc96988d6870debc1ec121ccb19a61fd"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "18b965a35854a3bda5e00fa41a50fa0c34251614"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@18b965a35854a3bda5e00fa41a50fa0c34251614",
"title": "18b965a35854a3bda5e00fa41a50fa0c34251614",
"url": "https://fuchsia.googlesource.com/integration/+/18b965a35854a3bda5e00fa41a50fa0c34251614"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "bc11df57736daccc6f18874be17e3799dad8051c"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@bc11df57736daccc6f18874be17e3799dad8051c",
"title": "bc11df57736daccc6f18874be17e3799dad8051c",
"url": "https://fuchsia.googlesource.com/integration/+/bc11df57736daccc6f18874be17e3799dad8051c"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "ebcc356cddc28cb42e288d85f0717b1719cf088b"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@ebcc356cddc28cb42e288d85f0717b1719cf088b",
"title": "ebcc356cddc28cb42e288d85f0717b1719cf088b",
"url": "https://fuchsia.googlesource.com/integration/+/ebcc356cddc28cb42e288d85f0717b1719cf088b"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "fb05cc0735ecbc3a0b09a34f06755be02305add2"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@fb05cc0735ecbc3a0b09a34f06755be02305add2",
"title": "fb05cc0735ecbc3a0b09a34f06755be02305add2",
"url": "https://fuchsia.googlesource.com/integration/+/fb05cc0735ecbc3a0b09a34f06755be02305add2"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "5d4e307dec2dbcc2aef840d0496ab0cdae70c48c"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@5d4e307dec2dbcc2aef840d0496ab0cdae70c48c",
"title": "5d4e307dec2dbcc2aef840d0496ab0cdae70c48c",
"url": "https://fuchsia.googlesource.com/integration/+/5d4e307dec2dbcc2aef840d0496ab0cdae70c48c"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "301ecdab11f89013568bec7071f97e53f8c2975b"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@301ecdab11f89013568bec7071f97e53f8c2975b",
"title": "301ecdab11f89013568bec7071f97e53f8c2975b",
"url": "https://fuchsia.googlesource.com/integration/+/301ecdab11f89013568bec7071f97e53f8c2975b"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "6123060f02cdfe2c2e7a465952891ad4669dc93f"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@6123060f02cdfe2c2e7a465952891ad4669dc93f",
"title": "6123060f02cdfe2c2e7a465952891ad4669dc93f",
"url": "https://fuchsia.googlesource.com/integration/+/6123060f02cdfe2c2e7a465952891ad4669dc93f"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "dc8825eacfa1dd9c1d61d7485963b5276bab1816"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@dc8825eacfa1dd9c1d61d7485963b5276bab1816",
"title": "dc8825eacfa1dd9c1d61d7485963b5276bab1816",
"url": "https://fuchsia.googlesource.com/integration/+/dc8825eacfa1dd9c1d61d7485963b5276bab1816"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "a8fe22b4fe6599146a67854acc7eb03bf4e0251c"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@a8fe22b4fe6599146a67854acc7eb03bf4e0251c",
"title": "a8fe22b4fe6599146a67854acc7eb03bf4e0251c",
"url": "https://fuchsia.googlesource.com/integration/+/a8fe22b4fe6599146a67854acc7eb03bf4e0251c"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "24693cc190212fd3f655ee18935ad926b6b07620"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@24693cc190212fd3f655ee18935ad926b6b07620",
"title": "24693cc190212fd3f655ee18935ad926b6b07620",
"url": "https://fuchsia.googlesource.com/integration/+/24693cc190212fd3f655ee18935ad926b6b07620"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "5ba9df6d5fd134cdda34ff41554294010235dc2b"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@5ba9df6d5fd134cdda34ff41554294010235dc2b",
"title": "5ba9df6d5fd134cdda34ff41554294010235dc2b",
"url": "https://fuchsia.googlesource.com/integration/+/5ba9df6d5fd134cdda34ff41554294010235dc2b"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "2a65399b8af310628936edd0b0c433b2d5287767"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@2a65399b8af310628936edd0b0c433b2d5287767",
"title": "2a65399b8af310628936edd0b0c433b2d5287767",
"url": "https://fuchsia.googlesource.com/integration/+/2a65399b8af310628936edd0b0c433b2d5287767"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "21c5ef9b64dcc362446b93e6db7b24331895f8e5"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@21c5ef9b64dcc362446b93e6db7b24331895f8e5",
"title": "21c5ef9b64dcc362446b93e6db7b24331895f8e5",
"url": "https://fuchsia.googlesource.com/integration/+/21c5ef9b64dcc362446b93e6db7b24331895f8e5"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "1146153360129f086f3a88f64520bf62ebc0babd"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@1146153360129f086f3a88f64520bf62ebc0babd",
"title": "1146153360129f086f3a88f64520bf62ebc0babd",
"url": "https://fuchsia.googlesource.com/integration/+/1146153360129f086f3a88f64520bf62ebc0babd"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "59d2a4743d4bd5a3ba62f06f30739b0892ce0d50"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@59d2a4743d4bd5a3ba62f06f30739b0892ce0d50",
"title": "59d2a4743d4bd5a3ba62f06f30739b0892ce0d50",
"url": "https://fuchsia.googlesource.com/integration/+/59d2a4743d4bd5a3ba62f06f30739b0892ce0d50"
}
]
}
},
"gitilesCommit": {
"host": "fuchsia.googlesource.com",
"project": "integration",
"id": "59d2a4743d4bd5a3ba62f06f30739b0892ce0d50",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8853029435356964544"
},
{
"key": "scheduler_job_id",
"value": "fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[19:17:10.667] Scheduled build:
{
"id": "8687599371644738241",
"builder": {
"project": "fuchsia",
"bucket": "global.ci",
"builder": "core.arm64-hwasan"
},
"createdBy": "project:fuchsia",
"createTime": "2026-03-11T19:17:10.243742592Z",
"updateTime": "2026-03-11T19:17:10.243742592Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "fuchsia.googlesource.com",
"project": "integration",
"id": "59d2a4743d4bd5a3ba62f06f30739b0892ce0d50",
"ref": "refs/heads/main"
}
}
}
[19:17:10.667] Task URL: https://cr-buildbucket.appspot.com/build/8687599371644738241
[19:17:10.667] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8853029435356964544:2:0) after 3m0s
[19:17:11.451] Received PubSub notification, asking Buildbucket for the build status
[19:17:11.480] Build status: SCHEDULED
[19:20:10.721] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8853029435356964544:2:0)
[19:20:10.743] Build status: SCHEDULED
[19:20:10.743] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8853029435356964544:4:0) after 5m45s
[19:20:38.766] Received PubSub notification, asking Buildbucket for the build status
[19:20:38.790] Build status: STARTED
[19:25:55.812] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8853029435356964544:4:0)
[19:25:55.846] Build status: STARTED
[19:25:55.846] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8853029435356964544:6:0) after 3m54s
[19:29:49.861] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8853029435356964544:6:0)
[19:29:49.937] Build status: STARTED
[19:29:49.937] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8853029435356964544:7:0) after 7m42s
[19:37:31.953] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8853029435356964544:7:0)
[19:37:31.986] Build status: STARTED
[19:37:31.986] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8853029435356964544:8:0) after 7m40s
[19:45:12.199] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8853029435356964544:8:0)
[19:45:12.262] Build status: STARTED
[19:45:12.262] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8853029435356964544:9:0) after 8m48s
[19:54:00.325] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8853029435356964544:9:0)
[19:54:00.350] Build status: STARTED
[19:54:00.350] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8853029435356964544:10:0) after 3m40s
[19:57:40.385] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8853029435356964544:10:0)
[19:57:40.459] Build status: STARTED
[19:57:40.459] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8853029435356964544:11:0) after 9m7s
[20:06:47.477] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8853029435356964544:11:0)
[20:06:47.499] Build status: STARTED
[20:06:47.499] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8853029435356964544:12:0) after 2m40s
[20:09:27.516] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8853029435356964544:12:0)
[20:09:27.545] Build status: STARTED
[20:09:27.545] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8853029435356964544:13:0) after 2m55s
[20:12:22.552] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8853029435356964544:13:0)
[20:12:22.568] Build status: STARTED
[20:12:22.568] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8853029435356964544:14:0) after 9m50s
[20:22:12.581] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8853029435356964544:14:0)
[20:22:12.603] Build status: STARTED
[20:22:12.603] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8853029435356964544:15:0) after 3m56s
[20:26:08.581] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8853029435356964544:15:0)
[20:26:08.604] Build status: STARTED
[20:26:08.604] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8853029435356964544:16:0) after 2m33s
[20:28:41.635] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8853029435356964544:16:0)
[20:28:41.653] Build status: STARTED
[20:28:41.653] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8853029435356964544:17:0) after 4m22s
[20:33:03.658] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8853029435356964544:17:0)
[20:33:03.676] Build status: STARTED
[20:33:03.676] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8853029435356964544:18:0) after 4m46s
[20:37:49.788] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8853029435356964544:18:0)
[20:37:49.805] Build status: STARTED
[20:37:49.805] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8853029435356964544:19:0) after 7m48s
[20:45:37.821] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8853029435356964544:19:0)
[20:45:37.837] Build status: STARTED
[20:45:37.837] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-hwasan-e5a0ec7f:8853029435356964544:20:0) after 6m2s
[20:46:35.107] Received PubSub notification, asking Buildbucket for the build status
[20:46:35.123] Build:
{
"id": "8687599371644738241",
"builder": {
"project": "fuchsia",
"bucket": "global.ci",
"builder": "core.arm64-hwasan"
},
"createdBy": "project:fuchsia",
"createTime": "2026-03-11T19:17:10.243742592Z",
"startTime": "2026-03-11T19:20:37.725554303Z",
"endTime": "2026-03-11T20:46:13.283112150Z",
"updateTime": "2026-03-11T20:46:13.283112150Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "fuchsia.googlesource.com",
"project": "integration",
"id": "59d2a4743d4bd5a3ba62f06f30739b0892ce0d50",
"ref": "refs/heads/main"
}
}
}
[20:46:35.123] Invocation finished in 1h29m27.803637214s with status FAILED