[23:30:21.089] New invocation is queued and will start shortly
[23:30:22.399] Starting the invocation (attempt 1)
[23:30:22.431] Popped buildset tag "buildset:commit/gitiles/fuchsia.googlesource.com/integration/+/834e17e7919573bf7c73e472133af35532960337"
[23:30:22.431] Popped gitiles commit info from properties and tags
[23:30:22.431] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[23:30:22.431] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[23:30:22.432] Buildbucket request:
{
"requestId": "8854191264101996144",
"builder": {
"project": "fuchsia",
"bucket": "global.ci",
"builder": "core.arm64-asan"
},
"properties": {
"$recipe_engine/scheduler": {
"hostname": "luci-scheduler.appspot.com",
"invocation": "8854191264101996144",
"job": "fuchsia/global.ci-core.arm64-asan-e5a0ec7f",
"triggers": [
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "23abd620d8a55d97396bc01577ab695e644f4978"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@23abd620d8a55d97396bc01577ab695e644f4978",
"title": "23abd620d8a55d97396bc01577ab695e644f4978",
"url": "https://fuchsia.googlesource.com/integration/+/23abd620d8a55d97396bc01577ab695e644f4978"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "6a129c47c0c2b52c7f6a9a20595b004e402e5ee9"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@6a129c47c0c2b52c7f6a9a20595b004e402e5ee9",
"title": "6a129c47c0c2b52c7f6a9a20595b004e402e5ee9",
"url": "https://fuchsia.googlesource.com/integration/+/6a129c47c0c2b52c7f6a9a20595b004e402e5ee9"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "aa17c95fb0e9e72468597bb4161b14365b74e7f3"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@aa17c95fb0e9e72468597bb4161b14365b74e7f3",
"title": "aa17c95fb0e9e72468597bb4161b14365b74e7f3",
"url": "https://fuchsia.googlesource.com/integration/+/aa17c95fb0e9e72468597bb4161b14365b74e7f3"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "4ef5d5fd370ab97b722e25cfecd0a27660aa472f"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@4ef5d5fd370ab97b722e25cfecd0a27660aa472f",
"title": "4ef5d5fd370ab97b722e25cfecd0a27660aa472f",
"url": "https://fuchsia.googlesource.com/integration/+/4ef5d5fd370ab97b722e25cfecd0a27660aa472f"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "79fa99e92d396dfa399458ea60a995c42d4d03ab"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@79fa99e92d396dfa399458ea60a995c42d4d03ab",
"title": "79fa99e92d396dfa399458ea60a995c42d4d03ab",
"url": "https://fuchsia.googlesource.com/integration/+/79fa99e92d396dfa399458ea60a995c42d4d03ab"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "3f9d3f4e29a9f63e8c06a44b3d457e335c3171b1"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@3f9d3f4e29a9f63e8c06a44b3d457e335c3171b1",
"title": "3f9d3f4e29a9f63e8c06a44b3d457e335c3171b1",
"url": "https://fuchsia.googlesource.com/integration/+/3f9d3f4e29a9f63e8c06a44b3d457e335c3171b1"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "d5db31765575e59f3543a916dfbfc3c84576798e"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@d5db31765575e59f3543a916dfbfc3c84576798e",
"title": "d5db31765575e59f3543a916dfbfc3c84576798e",
"url": "https://fuchsia.googlesource.com/integration/+/d5db31765575e59f3543a916dfbfc3c84576798e"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "5065c2d4f8136e01cd1dfb24b99dae8689f7220a"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@5065c2d4f8136e01cd1dfb24b99dae8689f7220a",
"title": "5065c2d4f8136e01cd1dfb24b99dae8689f7220a",
"url": "https://fuchsia.googlesource.com/integration/+/5065c2d4f8136e01cd1dfb24b99dae8689f7220a"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "61f2af9d122d147013e64bdad2f2cce5425d0728"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@61f2af9d122d147013e64bdad2f2cce5425d0728",
"title": "61f2af9d122d147013e64bdad2f2cce5425d0728",
"url": "https://fuchsia.googlesource.com/integration/+/61f2af9d122d147013e64bdad2f2cce5425d0728"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "ed183d5328e6e86d61b32362913ca708d95b7eca"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@ed183d5328e6e86d61b32362913ca708d95b7eca",
"title": "ed183d5328e6e86d61b32362913ca708d95b7eca",
"url": "https://fuchsia.googlesource.com/integration/+/ed183d5328e6e86d61b32362913ca708d95b7eca"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "2a53442a09a5aaeed4d7cdc864ec9868d742dcb7"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@2a53442a09a5aaeed4d7cdc864ec9868d742dcb7",
"title": "2a53442a09a5aaeed4d7cdc864ec9868d742dcb7",
"url": "https://fuchsia.googlesource.com/integration/+/2a53442a09a5aaeed4d7cdc864ec9868d742dcb7"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "2526224356c80f3864d19f1428a2b7aa8cc82a75"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@2526224356c80f3864d19f1428a2b7aa8cc82a75",
"title": "2526224356c80f3864d19f1428a2b7aa8cc82a75",
"url": "https://fuchsia.googlesource.com/integration/+/2526224356c80f3864d19f1428a2b7aa8cc82a75"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "2e18b96e5c777ecace841217c5922078b3ad8b6e"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@2e18b96e5c777ecace841217c5922078b3ad8b6e",
"title": "2e18b96e5c777ecace841217c5922078b3ad8b6e",
"url": "https://fuchsia.googlesource.com/integration/+/2e18b96e5c777ecace841217c5922078b3ad8b6e"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "834e17e7919573bf7c73e472133af35532960337"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@834e17e7919573bf7c73e472133af35532960337",
"title": "834e17e7919573bf7c73e472133af35532960337",
"url": "https://fuchsia.googlesource.com/integration/+/834e17e7919573bf7c73e472133af35532960337"
}
]
}
},
"gitilesCommit": {
"host": "fuchsia.googlesource.com",
"project": "integration",
"id": "834e17e7919573bf7c73e472133af35532960337",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8854191264101996144"
},
{
"key": "scheduler_job_id",
"value": "fuchsia/global.ci-core.arm64-asan-e5a0ec7f"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[23:30:22.791] Scheduled build:
{
"id": "8688761201990756657",
"builder": {
"project": "fuchsia",
"bucket": "global.ci",
"builder": "core.arm64-asan"
},
"createdBy": "project:fuchsia",
"createTime": "2026-02-26T23:30:22.482895100Z",
"updateTime": "2026-02-26T23:30:22.482895100Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "fuchsia.googlesource.com",
"project": "integration",
"id": "834e17e7919573bf7c73e472133af35532960337",
"ref": "refs/heads/main"
}
}
}
[23:30:22.791] Task URL: https://cr-buildbucket.appspot.com/build/8688761201990756657
[23:30:22.791] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-asan-e5a0ec7f:8854191264101996144:2:0) after 5m55s
[23:30:23.835] Received PubSub notification, asking Buildbucket for the build status
[23:30:23.865] Build status: SCHEDULED
[23:33:17.405] Received PubSub notification, asking Buildbucket for the build status
[23:33:17.427] Build status: STARTED
[23:36:17.899] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-asan-e5a0ec7f:8854191264101996144:2:0)
[23:36:17.917] Build status: STARTED
[23:36:17.917] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-asan-e5a0ec7f:8854191264101996144:5:0) after 2m24s
[23:38:41.960] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-asan-e5a0ec7f:8854191264101996144:5:0)
[23:38:41.974] Build status: STARTED
[23:38:41.974] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-asan-e5a0ec7f:8854191264101996144:6:0) after 3m36s
[23:42:18.074] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-asan-e5a0ec7f:8854191264101996144:6:0)
[23:42:18.122] Build status: STARTED
[23:42:18.122] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-asan-e5a0ec7f:8854191264101996144:7:0) after 1m3s
[23:43:21.135] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-asan-e5a0ec7f:8854191264101996144:7:0)
[23:43:21.165] Build status: STARTED
[23:43:21.165] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-asan-e5a0ec7f:8854191264101996144:8:0) after 3m34s
[23:46:55.261] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-asan-e5a0ec7f:8854191264101996144:8:0)
[23:46:55.285] Build status: STARTED
[23:46:55.285] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-asan-e5a0ec7f:8854191264101996144:9:0) after 1m4s
[23:47:59.309] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-asan-e5a0ec7f:8854191264101996144:9:0)
[23:47:59.326] Build status: STARTED
[23:47:59.326] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-asan-e5a0ec7f:8854191264101996144:10:0) after 6m26s
[23:54:25.342] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-asan-e5a0ec7f:8854191264101996144:10:0)
[23:54:25.358] Build status: STARTED
[23:54:25.358] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-asan-e5a0ec7f:8854191264101996144:11:0) after 1m26s
[23:55:51.576] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-asan-e5a0ec7f:8854191264101996144:11:0)
[23:55:51.631] Build status: STARTED
[23:55:51.631] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-asan-e5a0ec7f:8854191264101996144:12:0) after 1m57s
[23:57:48.650] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-asan-e5a0ec7f:8854191264101996144:12:0)
[23:57:48.681] Build status: STARTED
[23:57:48.681] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-asan-e5a0ec7f:8854191264101996144:13:0) after 7m35s
[00:05:23.912] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-asan-e5a0ec7f:8854191264101996144:13:0)
[00:05:23.938] Build status: STARTED
[00:05:23.939] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-asan-e5a0ec7f:8854191264101996144:14:0) after 7m34s
[00:12:58.012] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-asan-e5a0ec7f:8854191264101996144:14:0)
[00:12:58.032] Build status: STARTED
[00:12:58.032] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-asan-e5a0ec7f:8854191264101996144:15:0) after 5m50s
[00:18:48.090] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-asan-e5a0ec7f:8854191264101996144:15:0)
[00:18:48.109] Build status: STARTED
[00:18:48.109] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-asan-e5a0ec7f:8854191264101996144:16:0) after 6m35s
[00:25:23.178] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-asan-e5a0ec7f:8854191264101996144:16:0)
[00:25:23.201] Build status: STARTED
[00:25:23.201] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-asan-e5a0ec7f:8854191264101996144:17:0) after 2m37s
[00:28:00.173] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-asan-e5a0ec7f:8854191264101996144:17:0)
[00:28:00.191] Build status: STARTED
[00:28:00.191] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-asan-e5a0ec7f:8854191264101996144:18:0) after 7m42s
[00:35:42.268] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-asan-e5a0ec7f:8854191264101996144:18:0)
[00:35:42.302] Build status: STARTED
[00:35:42.302] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-asan-e5a0ec7f:8854191264101996144:19:0) after 6m47s
[00:42:29.448] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-asan-e5a0ec7f:8854191264101996144:19:0)
[00:42:29.463] Build status: STARTED
[00:42:29.463] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-asan-e5a0ec7f:8854191264101996144:20:0) after 7m49s
[00:50:18.479] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-asan-e5a0ec7f:8854191264101996144:20:0)
[00:50:18.500] Build status: STARTED
[00:50:18.500] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-asan-e5a0ec7f:8854191264101996144:21:0) after 1m33s
[00:51:51.581] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-asan-e5a0ec7f:8854191264101996144:21:0)
[00:51:51.599] Build status: STARTED
[00:51:51.599] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-asan-e5a0ec7f:8854191264101996144:22:0) after 4m43s
[00:56:34.668] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-asan-e5a0ec7f:8854191264101996144:22:0)
[00:56:34.694] Build status: STARTED
[00:56:34.694] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-asan-e5a0ec7f:8854191264101996144:23:0) after 1m3s
[00:57:37.709] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-asan-e5a0ec7f:8854191264101996144:23:0)
[00:57:37.803] Build status: STARTED
[00:57:37.803] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-asan-e5a0ec7f:8854191264101996144:24:0) after 3m32s
[01:01:09.852] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-asan-e5a0ec7f:8854191264101996144:24:0)
[01:01:09.870] Build status: STARTED
[01:01:09.870] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.arm64-asan-e5a0ec7f:8854191264101996144:25:0) after 9m54s
[01:10:28.326] Received PubSub notification, asking Buildbucket for the build status
[01:10:28.343] Build:
{
"id": "8688761201990756657",
"builder": {
"project": "fuchsia",
"bucket": "global.ci",
"builder": "core.arm64-asan"
},
"createdBy": "project:fuchsia",
"createTime": "2026-02-26T23:30:22.482895100Z",
"startTime": "2026-02-26T23:33:17.223919133Z",
"endTime": "2026-02-27T01:10:28.008954167Z",
"updateTime": "2026-02-27T01:10:28.008954167Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "fuchsia.googlesource.com",
"project": "integration",
"id": "834e17e7919573bf7c73e472133af35532960337",
"ref": "refs/heads/main"
}
}
}
[01:10:28.343] Invocation finished in 1h40m7.257788021s with status FAILED