[21:46:20.427] New invocation is queued and will start shortly
[21:46:21.596] Starting the invocation (attempt 1)
[21:46:21.634] Popped buildset tag "buildset:commit/gitiles/fuchsia.googlesource.com/integration/+/02646d1dfd6fc00a96ebe15b439d0b3824338cbf"
[21:46:21.634] Popped gitiles commit info from properties and tags
[21:46:21.634] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[21:46:21.634] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[21:46:21.634] Buildbucket request:
{
"requestId": "8867153174110930944",
"builder": {
"project": "fuchsia",
"bucket": "global.ci",
"builder": "core.x64-kubsan"
},
"properties": {
"$recipe_engine/scheduler": {
"hostname": "luci-scheduler.appspot.com",
"invocation": "8867153174110930944",
"job": "fuchsia/global.ci-core.x64-kubsan-e5a0ec7f",
"triggers": [
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "bf5d97ca3ee6f631288609cb4ccc5aac1e549734"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@bf5d97ca3ee6f631288609cb4ccc5aac1e549734",
"title": "bf5d97ca3ee6f631288609cb4ccc5aac1e549734",
"url": "https://fuchsia.googlesource.com/integration/+/bf5d97ca3ee6f631288609cb4ccc5aac1e549734"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "dd58982c943d42182735fd8e96705e68184c02d3"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@dd58982c943d42182735fd8e96705e68184c02d3",
"title": "dd58982c943d42182735fd8e96705e68184c02d3",
"url": "https://fuchsia.googlesource.com/integration/+/dd58982c943d42182735fd8e96705e68184c02d3"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "e3de976861dc9dce68dbdd346a0c688a1301a680"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@e3de976861dc9dce68dbdd346a0c688a1301a680",
"title": "e3de976861dc9dce68dbdd346a0c688a1301a680",
"url": "https://fuchsia.googlesource.com/integration/+/e3de976861dc9dce68dbdd346a0c688a1301a680"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "053ff3c48bb54e9874045c9681892c41ab76a668"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@053ff3c48bb54e9874045c9681892c41ab76a668",
"title": "053ff3c48bb54e9874045c9681892c41ab76a668",
"url": "https://fuchsia.googlesource.com/integration/+/053ff3c48bb54e9874045c9681892c41ab76a668"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "8b23d20e15930c68d17313e3202d02bfbe3379fe"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@8b23d20e15930c68d17313e3202d02bfbe3379fe",
"title": "8b23d20e15930c68d17313e3202d02bfbe3379fe",
"url": "https://fuchsia.googlesource.com/integration/+/8b23d20e15930c68d17313e3202d02bfbe3379fe"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "9b05873bd67de9c32e0983aff108862e5600b735"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@9b05873bd67de9c32e0983aff108862e5600b735",
"title": "9b05873bd67de9c32e0983aff108862e5600b735",
"url": "https://fuchsia.googlesource.com/integration/+/9b05873bd67de9c32e0983aff108862e5600b735"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "d2e1ece80625ae79a844fad1bbf3618dc7b5a0cd"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@d2e1ece80625ae79a844fad1bbf3618dc7b5a0cd",
"title": "d2e1ece80625ae79a844fad1bbf3618dc7b5a0cd",
"url": "https://fuchsia.googlesource.com/integration/+/d2e1ece80625ae79a844fad1bbf3618dc7b5a0cd"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "e67a2493d8bb2dec1b6e86fde0d8016f68520d34"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@e67a2493d8bb2dec1b6e86fde0d8016f68520d34",
"title": "e67a2493d8bb2dec1b6e86fde0d8016f68520d34",
"url": "https://fuchsia.googlesource.com/integration/+/e67a2493d8bb2dec1b6e86fde0d8016f68520d34"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "bb2dd2f11d4e031b0ebbef0d16e286bab3b0dbf2"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@bb2dd2f11d4e031b0ebbef0d16e286bab3b0dbf2",
"title": "bb2dd2f11d4e031b0ebbef0d16e286bab3b0dbf2",
"url": "https://fuchsia.googlesource.com/integration/+/bb2dd2f11d4e031b0ebbef0d16e286bab3b0dbf2"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "9af9b24427f48878467f61dc3a6a22936f1d6a92"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@9af9b24427f48878467f61dc3a6a22936f1d6a92",
"title": "9af9b24427f48878467f61dc3a6a22936f1d6a92",
"url": "https://fuchsia.googlesource.com/integration/+/9af9b24427f48878467f61dc3a6a22936f1d6a92"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "d03154ea70f066224be54f0866cda82eb3f10e5a"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@d03154ea70f066224be54f0866cda82eb3f10e5a",
"title": "d03154ea70f066224be54f0866cda82eb3f10e5a",
"url": "https://fuchsia.googlesource.com/integration/+/d03154ea70f066224be54f0866cda82eb3f10e5a"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "320806de13605652fd88c5c85fb9c6b705bbaf7e"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@320806de13605652fd88c5c85fb9c6b705bbaf7e",
"title": "320806de13605652fd88c5c85fb9c6b705bbaf7e",
"url": "https://fuchsia.googlesource.com/integration/+/320806de13605652fd88c5c85fb9c6b705bbaf7e"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "5d083431eadbb0a854ba35be2ceba9577b9e5e50"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@5d083431eadbb0a854ba35be2ceba9577b9e5e50",
"title": "5d083431eadbb0a854ba35be2ceba9577b9e5e50",
"url": "https://fuchsia.googlesource.com/integration/+/5d083431eadbb0a854ba35be2ceba9577b9e5e50"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "ed13728958550dc40787c03a6e3d848071b0d4a8"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@ed13728958550dc40787c03a6e3d848071b0d4a8",
"title": "ed13728958550dc40787c03a6e3d848071b0d4a8",
"url": "https://fuchsia.googlesource.com/integration/+/ed13728958550dc40787c03a6e3d848071b0d4a8"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "1380aa3186f0e6a4bc0fc8c6f7ed4296a0a38f24"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@1380aa3186f0e6a4bc0fc8c6f7ed4296a0a38f24",
"title": "1380aa3186f0e6a4bc0fc8c6f7ed4296a0a38f24",
"url": "https://fuchsia.googlesource.com/integration/+/1380aa3186f0e6a4bc0fc8c6f7ed4296a0a38f24"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "f3748ebb0ca203abb69091fd4349f19b72f364c1"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@f3748ebb0ca203abb69091fd4349f19b72f364c1",
"title": "f3748ebb0ca203abb69091fd4349f19b72f364c1",
"url": "https://fuchsia.googlesource.com/integration/+/f3748ebb0ca203abb69091fd4349f19b72f364c1"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "22fb44a9c36238533163c2a05102d86371c6be43"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@22fb44a9c36238533163c2a05102d86371c6be43",
"title": "22fb44a9c36238533163c2a05102d86371c6be43",
"url": "https://fuchsia.googlesource.com/integration/+/22fb44a9c36238533163c2a05102d86371c6be43"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "4699149ea0f442cb2dc824bc2f56dc845186a5e7"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@4699149ea0f442cb2dc824bc2f56dc845186a5e7",
"title": "4699149ea0f442cb2dc824bc2f56dc845186a5e7",
"url": "https://fuchsia.googlesource.com/integration/+/4699149ea0f442cb2dc824bc2f56dc845186a5e7"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "7c63373e9b32ac46254939df7fd1470926d3b9a7"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@7c63373e9b32ac46254939df7fd1470926d3b9a7",
"title": "7c63373e9b32ac46254939df7fd1470926d3b9a7",
"url": "https://fuchsia.googlesource.com/integration/+/7c63373e9b32ac46254939df7fd1470926d3b9a7"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "ccb4b39340bcc5083126eaffec112cf7d528744b"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@ccb4b39340bcc5083126eaffec112cf7d528744b",
"title": "ccb4b39340bcc5083126eaffec112cf7d528744b",
"url": "https://fuchsia.googlesource.com/integration/+/ccb4b39340bcc5083126eaffec112cf7d528744b"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "099498bcf1b1e87f0ca71cb7f57363f5834f987f"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@099498bcf1b1e87f0ca71cb7f57363f5834f987f",
"title": "099498bcf1b1e87f0ca71cb7f57363f5834f987f",
"url": "https://fuchsia.googlesource.com/integration/+/099498bcf1b1e87f0ca71cb7f57363f5834f987f"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "37804f9c249dd4a3c38b1e1def07f89e247cae07"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@37804f9c249dd4a3c38b1e1def07f89e247cae07",
"title": "37804f9c249dd4a3c38b1e1def07f89e247cae07",
"url": "https://fuchsia.googlesource.com/integration/+/37804f9c249dd4a3c38b1e1def07f89e247cae07"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "c3cef85475b821e0698fc3166f8b9e7b98624827"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@c3cef85475b821e0698fc3166f8b9e7b98624827",
"title": "c3cef85475b821e0698fc3166f8b9e7b98624827",
"url": "https://fuchsia.googlesource.com/integration/+/c3cef85475b821e0698fc3166f8b9e7b98624827"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "97b98bfaeea09b3286fd150bd23b126a34dadf74"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@97b98bfaeea09b3286fd150bd23b126a34dadf74",
"title": "97b98bfaeea09b3286fd150bd23b126a34dadf74",
"url": "https://fuchsia.googlesource.com/integration/+/97b98bfaeea09b3286fd150bd23b126a34dadf74"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "02646d1dfd6fc00a96ebe15b439d0b3824338cbf"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@02646d1dfd6fc00a96ebe15b439d0b3824338cbf",
"title": "02646d1dfd6fc00a96ebe15b439d0b3824338cbf",
"url": "https://fuchsia.googlesource.com/integration/+/02646d1dfd6fc00a96ebe15b439d0b3824338cbf"
}
]
}
},
"gitilesCommit": {
"host": "fuchsia.googlesource.com",
"project": "integration",
"id": "02646d1dfd6fc00a96ebe15b439d0b3824338cbf",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8867153174110930944"
},
{
"key": "scheduler_job_id",
"value": "fuchsia/global.ci-core.x64-kubsan-e5a0ec7f"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[21:46:22.193] Scheduled build:
{
"id": "8701723112125206801",
"builder": {
"project": "fuchsia",
"bucket": "global.ci",
"builder": "core.x64-kubsan"
},
"createdBy": "project:fuchsia",
"createTime": "2025-10-06T21:46:21.695272227Z",
"updateTime": "2025-10-06T21:46:21.695272227Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "fuchsia.googlesource.com",
"project": "integration",
"id": "02646d1dfd6fc00a96ebe15b439d0b3824338cbf",
"ref": "refs/heads/main"
}
}
}
[21:46:22.193] Task URL: https://cr-buildbucket.appspot.com/build/8701723112125206801
[21:46:22.193] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8867153174110930944:2:0) after 4m46s
[21:47:01.831] Received PubSub notification, asking Buildbucket for the build status
[21:47:01.874] Build status: STARTED
[21:47:04.330] Received PubSub notification, asking Buildbucket for the build status
[21:47:04.360] Build status: STARTED
[21:51:08.191] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8867153174110930944:2:0)
[21:51:08.211] Build status: STARTED
[21:51:08.211] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8867153174110930944:5:0) after 6m4s
[21:57:12.227] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8867153174110930944:5:0)
[21:57:12.261] Build status: STARTED
[21:57:12.261] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8867153174110930944:6:0) after 7m41s
[22:04:53.274] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8867153174110930944:6:0)
[22:04:53.291] Build status: STARTED
[22:04:53.291] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8867153174110930944:7:0) after 4m12s
[22:09:05.359] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8867153174110930944:7:0)
[22:09:05.376] Build status: STARTED
[22:09:05.376] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8867153174110930944:8:0) after 2m6s
[22:11:11.443] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8867153174110930944:8:0)
[22:11:11.493] Build status: STARTED
[22:11:11.493] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8867153174110930944:9:0) after 1m26s
[22:12:37.689] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8867153174110930944:9:0)
[22:12:37.740] Build status: STARTED
[22:12:37.740] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8867153174110930944:10:0) after 8m35s
[22:21:12.897] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8867153174110930944:10:0)
[22:21:12.914] Build status: STARTED
[22:21:12.914] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8867153174110930944:11:0) after 4m53s
[22:26:06.082] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8867153174110930944:11:0)
[22:26:06.107] Build status: STARTED
[22:26:06.107] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8867153174110930944:12:0) after 5m1s
[22:31:07.179] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8867153174110930944:12:0)
[22:31:07.205] Build status: STARTED
[22:31:07.205] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8867153174110930944:13:0) after 3m17s
[22:34:24.230] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8867153174110930944:13:0)
[22:34:24.254] Build status: STARTED
[22:34:24.254] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8867153174110930944:14:0) after 2m20s
[22:36:44.433] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8867153174110930944:14:0)
[22:36:44.490] Build status: STARTED
[22:36:44.490] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8867153174110930944:15:0) after 8m49s
[22:45:33.604] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8867153174110930944:15:0)
[22:45:33.623] Build status: STARTED
[22:45:33.623] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8867153174110930944:16:0) after 8m19s
[22:53:52.855] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8867153174110930944:16:0)
[22:53:52.875] Build status: STARTED
[22:53:52.875] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8867153174110930944:17:0) after 1m28s
[22:55:20.908] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8867153174110930944:17:0)
[22:55:20.925] Build status: STARTED
[22:55:20.925] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8867153174110930944:18:0) after 7m25s
[23:02:45.941] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8867153174110930944:18:0)
[23:02:45.964] Build status: STARTED
[23:02:45.964] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8867153174110930944:19:0) after 5m24s
[23:08:09.975] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8867153174110930944:19:0)
[23:08:09.992] Build status: STARTED
[23:08:09.992] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8867153174110930944:20:0) after 9m57s
[23:18:06.994] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8867153174110930944:20:0)
[23:18:07.042] Build status: STARTED
[23:18:07.042] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8867153174110930944:21:0) after 7m47s
[23:23:17.950] Received PubSub notification, asking Buildbucket for the build status
[23:23:17.971] Build:
{
"id": "8701723112125206801",
"builder": {
"project": "fuchsia",
"bucket": "global.ci",
"builder": "core.x64-kubsan"
},
"createdBy": "project:fuchsia",
"createTime": "2025-10-06T21:46:21.695272227Z",
"startTime": "2025-10-06T21:46:25.303411779Z",
"endTime": "2025-10-06T23:23:17.607806751Z",
"updateTime": "2025-10-06T23:23:17.607806751Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "fuchsia.googlesource.com",
"project": "integration",
"id": "02646d1dfd6fc00a96ebe15b439d0b3824338cbf",
"ref": "refs/heads/main"
}
}
}
[23:23:17.971] Invocation finished in 1h36m57.552534859s with status FAILED