[02:05:49.099] New invocation is queued and will start shortly
[02:05:50.189] Starting the invocation (attempt 1)
[02:05:50.212] Popped buildset tag "buildset:commit/gitiles/fuchsia.googlesource.com/integration/+/0432e8eb19b14624689d2eff8a132454d107fbe0"
[02:05:50.212] Popped gitiles commit info from properties and tags
[02:05:50.212] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[02:05:50.212] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[02:05:50.213] Buildbucket request:
{
"requestId": "8852369543657163968",
"builder": {
"project": "fuchsia",
"bucket": "global.ci",
"builder": "minimal.riscv64-coverage"
},
"properties": {
"$recipe_engine/scheduler": {
"hostname": "luci-scheduler.appspot.com",
"invocation": "8852369543657163968",
"job": "fuchsia/global.ci-minimal.riscv64-coverage-e5a0ec7f",
"triggers": [
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "2c8dcef9730952b8c64f7bea352300ef32ab694d"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@2c8dcef9730952b8c64f7bea352300ef32ab694d",
"title": "2c8dcef9730952b8c64f7bea352300ef32ab694d",
"url": "https://fuchsia.googlesource.com/integration/+/2c8dcef9730952b8c64f7bea352300ef32ab694d"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "d78969d63f58edd43707f7a48d4c268f2d67e23e"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@d78969d63f58edd43707f7a48d4c268f2d67e23e",
"title": "d78969d63f58edd43707f7a48d4c268f2d67e23e",
"url": "https://fuchsia.googlesource.com/integration/+/d78969d63f58edd43707f7a48d4c268f2d67e23e"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "533af6e2ff45bb37805d800e093be8137141887b"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@533af6e2ff45bb37805d800e093be8137141887b",
"title": "533af6e2ff45bb37805d800e093be8137141887b",
"url": "https://fuchsia.googlesource.com/integration/+/533af6e2ff45bb37805d800e093be8137141887b"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "efbc6cf1b7c915fd2989697573a702a102003dfe"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@efbc6cf1b7c915fd2989697573a702a102003dfe",
"title": "efbc6cf1b7c915fd2989697573a702a102003dfe",
"url": "https://fuchsia.googlesource.com/integration/+/efbc6cf1b7c915fd2989697573a702a102003dfe"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "685627134f382b56e744bde10f68a1c654348c93"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@685627134f382b56e744bde10f68a1c654348c93",
"title": "685627134f382b56e744bde10f68a1c654348c93",
"url": "https://fuchsia.googlesource.com/integration/+/685627134f382b56e744bde10f68a1c654348c93"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "3c891bc9fd40d4aed9bd2d00b10bded5f57d586b"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@3c891bc9fd40d4aed9bd2d00b10bded5f57d586b",
"title": "3c891bc9fd40d4aed9bd2d00b10bded5f57d586b",
"url": "https://fuchsia.googlesource.com/integration/+/3c891bc9fd40d4aed9bd2d00b10bded5f57d586b"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "6ec94004753f3c37559f4e09dc1ce96f0a0995dd"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@6ec94004753f3c37559f4e09dc1ce96f0a0995dd",
"title": "6ec94004753f3c37559f4e09dc1ce96f0a0995dd",
"url": "https://fuchsia.googlesource.com/integration/+/6ec94004753f3c37559f4e09dc1ce96f0a0995dd"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "03b04460e14dbfada97085dee74ca70b78730e83"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@03b04460e14dbfada97085dee74ca70b78730e83",
"title": "03b04460e14dbfada97085dee74ca70b78730e83",
"url": "https://fuchsia.googlesource.com/integration/+/03b04460e14dbfada97085dee74ca70b78730e83"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "a9223afabcf7ac3d2b61f594773ae2802e3972e5"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@a9223afabcf7ac3d2b61f594773ae2802e3972e5",
"title": "a9223afabcf7ac3d2b61f594773ae2802e3972e5",
"url": "https://fuchsia.googlesource.com/integration/+/a9223afabcf7ac3d2b61f594773ae2802e3972e5"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "d5d08296c439c855ff2fb9551a99466cd74f4abf"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@d5d08296c439c855ff2fb9551a99466cd74f4abf",
"title": "d5d08296c439c855ff2fb9551a99466cd74f4abf",
"url": "https://fuchsia.googlesource.com/integration/+/d5d08296c439c855ff2fb9551a99466cd74f4abf"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "ae0cd987d4586fdfbb50121d0fbcfd0efd08b2be"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@ae0cd987d4586fdfbb50121d0fbcfd0efd08b2be",
"title": "ae0cd987d4586fdfbb50121d0fbcfd0efd08b2be",
"url": "https://fuchsia.googlesource.com/integration/+/ae0cd987d4586fdfbb50121d0fbcfd0efd08b2be"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "cd1323aa9dfeb99a0c194a9094bcd1b1e069402d"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@cd1323aa9dfeb99a0c194a9094bcd1b1e069402d",
"title": "cd1323aa9dfeb99a0c194a9094bcd1b1e069402d",
"url": "https://fuchsia.googlesource.com/integration/+/cd1323aa9dfeb99a0c194a9094bcd1b1e069402d"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "381128b7e67853067b0d570253d866c10b742cd9"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@381128b7e67853067b0d570253d866c10b742cd9",
"title": "381128b7e67853067b0d570253d866c10b742cd9",
"url": "https://fuchsia.googlesource.com/integration/+/381128b7e67853067b0d570253d866c10b742cd9"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "553aad903b7945ad2c9bb8aba187878ef2aa7e0c"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@553aad903b7945ad2c9bb8aba187878ef2aa7e0c",
"title": "553aad903b7945ad2c9bb8aba187878ef2aa7e0c",
"url": "https://fuchsia.googlesource.com/integration/+/553aad903b7945ad2c9bb8aba187878ef2aa7e0c"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "61e092d6f90c6b28c62b63c5028a9f8fe2c14a8d"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@61e092d6f90c6b28c62b63c5028a9f8fe2c14a8d",
"title": "61e092d6f90c6b28c62b63c5028a9f8fe2c14a8d",
"url": "https://fuchsia.googlesource.com/integration/+/61e092d6f90c6b28c62b63c5028a9f8fe2c14a8d"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "de3d93606d75bcb513bdb5ef281f819f343625ae"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@de3d93606d75bcb513bdb5ef281f819f343625ae",
"title": "de3d93606d75bcb513bdb5ef281f819f343625ae",
"url": "https://fuchsia.googlesource.com/integration/+/de3d93606d75bcb513bdb5ef281f819f343625ae"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "e836f063c5a44f324f4ae7b888ed8831a80bf985"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@e836f063c5a44f324f4ae7b888ed8831a80bf985",
"title": "e836f063c5a44f324f4ae7b888ed8831a80bf985",
"url": "https://fuchsia.googlesource.com/integration/+/e836f063c5a44f324f4ae7b888ed8831a80bf985"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "2106af757d0d8d7980ce19596ec4bf019455c6da"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@2106af757d0d8d7980ce19596ec4bf019455c6da",
"title": "2106af757d0d8d7980ce19596ec4bf019455c6da",
"url": "https://fuchsia.googlesource.com/integration/+/2106af757d0d8d7980ce19596ec4bf019455c6da"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "e0b13bac9bcaf45c0b247dbda30dde8abc032631"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@e0b13bac9bcaf45c0b247dbda30dde8abc032631",
"title": "e0b13bac9bcaf45c0b247dbda30dde8abc032631",
"url": "https://fuchsia.googlesource.com/integration/+/e0b13bac9bcaf45c0b247dbda30dde8abc032631"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "e248d111cbfb4bd2e09074692174f85a03b38b51"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@e248d111cbfb4bd2e09074692174f85a03b38b51",
"title": "e248d111cbfb4bd2e09074692174f85a03b38b51",
"url": "https://fuchsia.googlesource.com/integration/+/e248d111cbfb4bd2e09074692174f85a03b38b51"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "0432e8eb19b14624689d2eff8a132454d107fbe0"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@0432e8eb19b14624689d2eff8a132454d107fbe0",
"title": "0432e8eb19b14624689d2eff8a132454d107fbe0",
"url": "https://fuchsia.googlesource.com/integration/+/0432e8eb19b14624689d2eff8a132454d107fbe0"
}
]
}
},
"gitilesCommit": {
"host": "fuchsia.googlesource.com",
"project": "integration",
"id": "0432e8eb19b14624689d2eff8a132454d107fbe0",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8852369543657163968"
},
{
"key": "scheduler_job_id",
"value": "fuchsia/global.ci-minimal.riscv64-coverage-e5a0ec7f"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[02:05:50.554] Scheduled build:
{
"id": "8686939481776503057",
"builder": {
"project": "fuchsia",
"bucket": "global.ci",
"builder": "minimal.riscv64-coverage"
},
"createdBy": "project:fuchsia",
"createTime": "2026-03-19T02:05:50.262160587Z",
"updateTime": "2026-03-19T02:05:50.262160587Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "fuchsia.googlesource.com",
"project": "integration",
"id": "0432e8eb19b14624689d2eff8a132454d107fbe0",
"ref": "refs/heads/main"
}
},
"canary": true
}
[02:05:50.554] Task URL: https://cr-buildbucket.appspot.com/build/8686939481776503057
[02:05:50.554] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-coverage-e5a0ec7f:8852369543657163968:2:0) after 4m43s
[02:05:51.504] Received PubSub notification, asking Buildbucket for the build status
[02:05:51.575] Build status: SCHEDULED
[02:06:39.270] Received PubSub notification, asking Buildbucket for the build status
[02:06:39.295] Build status: STARTED
[02:10:33.570] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-coverage-e5a0ec7f:8852369543657163968:2:0)
[02:10:33.776] Build status: STARTED
[02:10:33.776] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-coverage-e5a0ec7f:8852369543657163968:5:0) after 4m42s
[02:15:15.791] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-coverage-e5a0ec7f:8852369543657163968:5:0)
[02:15:15.803] Build status: STARTED
[02:15:15.803] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-coverage-e5a0ec7f:8852369543657163968:6:0) after 2m16s
[02:17:31.817] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-coverage-e5a0ec7f:8852369543657163968:6:0)
[02:17:31.854] Build status: STARTED
[02:17:31.854] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-coverage-e5a0ec7f:8852369543657163968:7:0) after 2m17s
[02:19:48.867] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-coverage-e5a0ec7f:8852369543657163968:7:0)
[02:19:48.881] Build status: STARTED
[02:19:48.881] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-coverage-e5a0ec7f:8852369543657163968:8:0) after 1m49s
[02:21:37.953] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-coverage-e5a0ec7f:8852369543657163968:8:0)
[02:21:37.974] Build status: STARTED
[02:21:37.974] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-coverage-e5a0ec7f:8852369543657163968:9:0) after 2m48s
[02:24:26.098] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-coverage-e5a0ec7f:8852369543657163968:9:0)
[02:24:26.114] Build status: STARTED
[02:24:26.114] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-coverage-e5a0ec7f:8852369543657163968:10:0) after 8m2s
[02:32:28.144] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-coverage-e5a0ec7f:8852369543657163968:10:0)
[02:32:28.158] Build status: STARTED
[02:32:28.158] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-coverage-e5a0ec7f:8852369543657163968:11:0) after 7m52s
[02:40:20.265] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-coverage-e5a0ec7f:8852369543657163968:11:0)
[02:40:20.283] Build status: STARTED
[02:40:20.283] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-coverage-e5a0ec7f:8852369543657163968:12:0) after 6m29s
[02:46:49.398] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-coverage-e5a0ec7f:8852369543657163968:12:0)
[02:46:49.551] Build status: STARTED
[02:46:49.551] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-coverage-e5a0ec7f:8852369543657163968:13:0) after 6m14s
[02:53:03.619] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-coverage-e5a0ec7f:8852369543657163968:13:0)
[02:53:03.638] Build status: STARTED
[02:53:03.638] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-coverage-e5a0ec7f:8852369543657163968:14:0) after 9m59s
[03:03:02.654] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-coverage-e5a0ec7f:8852369543657163968:14:0)
[03:03:02.674] Build status: STARTED
[03:03:02.674] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-coverage-e5a0ec7f:8852369543657163968:15:0) after 4m54s
[03:07:56.687] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-coverage-e5a0ec7f:8852369543657163968:15:0)
[03:07:56.746] Build status: STARTED
[03:07:56.746] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-coverage-e5a0ec7f:8852369543657163968:16:0) after 2m4s
[03:10:00.760] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-coverage-e5a0ec7f:8852369543657163968:16:0)
[03:10:00.777] Build status: STARTED
[03:10:00.777] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-coverage-e5a0ec7f:8852369543657163968:17:0) after 1m21s
[03:11:21.751] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-coverage-e5a0ec7f:8852369543657163968:17:0)
[03:11:21.769] Build status: STARTED
[03:11:21.769] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-coverage-e5a0ec7f:8852369543657163968:18:0) after 4m43s
[03:16:04.747] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-coverage-e5a0ec7f:8852369543657163968:18:0)
[03:16:04.777] Build status: STARTED
[03:16:04.777] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-coverage-e5a0ec7f:8852369543657163968:19:0) after 9m23s
[03:25:27.790] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-coverage-e5a0ec7f:8852369543657163968:19:0)
[03:25:29.818] Build status: STARTED
[03:25:29.818] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-coverage-e5a0ec7f:8852369543657163968:20:0) after 3m4s
[03:28:33.833] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-coverage-e5a0ec7f:8852369543657163968:20:0)
[03:28:33.871] Build status: STARTED
[03:28:33.871] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-coverage-e5a0ec7f:8852369543657163968:21:0) after 2m49s
[03:31:22.932] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-coverage-e5a0ec7f:8852369543657163968:21:0)
[03:31:22.955] Build status: STARTED
[03:31:22.955] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-coverage-e5a0ec7f:8852369543657163968:22:0) after 1m16s
[03:32:39.097] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-coverage-e5a0ec7f:8852369543657163968:22:0)
[03:32:39.114] Build status: STARTED
[03:32:39.114] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-coverage-e5a0ec7f:8852369543657163968:23:0) after 4m9s
[03:36:48.190] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-coverage-e5a0ec7f:8852369543657163968:23:0)
[03:36:48.229] Build status: STARTED
[03:36:48.230] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-coverage-e5a0ec7f:8852369543657163968:24:0) after 5m12s
[03:42:00.239] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-coverage-e5a0ec7f:8852369543657163968:24:0)
[03:42:00.255] Build status: STARTED
[03:42:00.255] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-minimal.riscv64-coverage-e5a0ec7f:8852369543657163968:25:0) after 8m18s
[03:47:30.865] Received PubSub notification, asking Buildbucket for the build status
[03:47:30.885] Build:
{
"id": "8686939481776503057",
"builder": {
"project": "fuchsia",
"bucket": "global.ci",
"builder": "minimal.riscv64-coverage"
},
"createdBy": "project:fuchsia",
"createTime": "2026-03-19T02:05:50.262160587Z",
"startTime": "2026-03-19T02:06:39.127567665Z",
"endTime": "2026-03-19T03:47:30.547549668Z",
"updateTime": "2026-03-19T03:47:30.547549668Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "fuchsia.googlesource.com",
"project": "integration",
"id": "0432e8eb19b14624689d2eff8a132454d107fbe0",
"ref": "refs/heads/main"
}
},
"canary": true
}
[03:47:30.885] Invocation finished in 1h41m41.799369062s with status FAILED