[21:21:28.414] New invocation is queued and will start shortly
[21:21:29.604] Starting the invocation (attempt 1)
[21:21:29.634] Popped buildset tag "buildset:commit/gitiles/fuchsia.googlesource.com/integration/+/138bdc015a46fdbc27d92cc0fa994a0d393be912"
[21:21:29.634] Popped gitiles commit info from properties and tags
[21:21:29.634] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[21:21:29.634] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[21:21:29.635] Buildbucket request:
{
"requestId": "8868423096134166432",
"builder": {
"project": "fuchsia",
"bucket": "global.ci",
"builder": "core.x64-kubsan"
},
"properties": {
"$recipe_engine/scheduler": {
"hostname": "luci-scheduler.appspot.com",
"invocation": "8868423096134166432",
"job": "fuchsia/global.ci-core.x64-kubsan-e5a0ec7f",
"triggers": [
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "17cd94c7c6cf4481d6da29ab2bfb77b02c1dcc3b"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@17cd94c7c6cf4481d6da29ab2bfb77b02c1dcc3b",
"title": "17cd94c7c6cf4481d6da29ab2bfb77b02c1dcc3b",
"url": "https://fuchsia.googlesource.com/integration/+/17cd94c7c6cf4481d6da29ab2bfb77b02c1dcc3b"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "4af262bf5d43e8b7d440c9b980950239193155ae"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@4af262bf5d43e8b7d440c9b980950239193155ae",
"title": "4af262bf5d43e8b7d440c9b980950239193155ae",
"url": "https://fuchsia.googlesource.com/integration/+/4af262bf5d43e8b7d440c9b980950239193155ae"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "9f8b21d52d12a5ba8959377e8cf4d34b0042257c"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@9f8b21d52d12a5ba8959377e8cf4d34b0042257c",
"title": "9f8b21d52d12a5ba8959377e8cf4d34b0042257c",
"url": "https://fuchsia.googlesource.com/integration/+/9f8b21d52d12a5ba8959377e8cf4d34b0042257c"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "bf773819e57921ccee5c8b435b0a1c8de7543902"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@bf773819e57921ccee5c8b435b0a1c8de7543902",
"title": "bf773819e57921ccee5c8b435b0a1c8de7543902",
"url": "https://fuchsia.googlesource.com/integration/+/bf773819e57921ccee5c8b435b0a1c8de7543902"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "2a145488e578e429c341c52cbac3aa492f5d2988"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@2a145488e578e429c341c52cbac3aa492f5d2988",
"title": "2a145488e578e429c341c52cbac3aa492f5d2988",
"url": "https://fuchsia.googlesource.com/integration/+/2a145488e578e429c341c52cbac3aa492f5d2988"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "bd45d1021a757273c8edabfb67b0f5d84e3b083b"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@bd45d1021a757273c8edabfb67b0f5d84e3b083b",
"title": "bd45d1021a757273c8edabfb67b0f5d84e3b083b",
"url": "https://fuchsia.googlesource.com/integration/+/bd45d1021a757273c8edabfb67b0f5d84e3b083b"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "75255ffded0afcabb308ff58bdc8960111c7d580"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@75255ffded0afcabb308ff58bdc8960111c7d580",
"title": "75255ffded0afcabb308ff58bdc8960111c7d580",
"url": "https://fuchsia.googlesource.com/integration/+/75255ffded0afcabb308ff58bdc8960111c7d580"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "d46a3dd3e94825532923a63d18ffca5e8bdf7a15"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@d46a3dd3e94825532923a63d18ffca5e8bdf7a15",
"title": "d46a3dd3e94825532923a63d18ffca5e8bdf7a15",
"url": "https://fuchsia.googlesource.com/integration/+/d46a3dd3e94825532923a63d18ffca5e8bdf7a15"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "c9aae7951e3fb075c847009dfaefbd4bce3e1a5b"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@c9aae7951e3fb075c847009dfaefbd4bce3e1a5b",
"title": "c9aae7951e3fb075c847009dfaefbd4bce3e1a5b",
"url": "https://fuchsia.googlesource.com/integration/+/c9aae7951e3fb075c847009dfaefbd4bce3e1a5b"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "5479c3d1a2832846475b59dbeabf5a3650f0cd29"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@5479c3d1a2832846475b59dbeabf5a3650f0cd29",
"title": "5479c3d1a2832846475b59dbeabf5a3650f0cd29",
"url": "https://fuchsia.googlesource.com/integration/+/5479c3d1a2832846475b59dbeabf5a3650f0cd29"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "00b98aae4ba38fb10702d8026b44285a4d73cfd6"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@00b98aae4ba38fb10702d8026b44285a4d73cfd6",
"title": "00b98aae4ba38fb10702d8026b44285a4d73cfd6",
"url": "https://fuchsia.googlesource.com/integration/+/00b98aae4ba38fb10702d8026b44285a4d73cfd6"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "904a339d0b927d81a7346f6da58739d656cf4b0a"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@904a339d0b927d81a7346f6da58739d656cf4b0a",
"title": "904a339d0b927d81a7346f6da58739d656cf4b0a",
"url": "https://fuchsia.googlesource.com/integration/+/904a339d0b927d81a7346f6da58739d656cf4b0a"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "e5fb9b85ef5e7c9548ffa20b614b6edeffe1a2df"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@e5fb9b85ef5e7c9548ffa20b614b6edeffe1a2df",
"title": "e5fb9b85ef5e7c9548ffa20b614b6edeffe1a2df",
"url": "https://fuchsia.googlesource.com/integration/+/e5fb9b85ef5e7c9548ffa20b614b6edeffe1a2df"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "fb37c76d1c42ad5104d138ca411634c383553eff"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@fb37c76d1c42ad5104d138ca411634c383553eff",
"title": "fb37c76d1c42ad5104d138ca411634c383553eff",
"url": "https://fuchsia.googlesource.com/integration/+/fb37c76d1c42ad5104d138ca411634c383553eff"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "fa07a01cf74758c36ef763961c99771ba453ac7d"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@fa07a01cf74758c36ef763961c99771ba453ac7d",
"title": "fa07a01cf74758c36ef763961c99771ba453ac7d",
"url": "https://fuchsia.googlesource.com/integration/+/fa07a01cf74758c36ef763961c99771ba453ac7d"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "c33effd795807659a5bf62a8eaa0a34b2a4c805a"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@c33effd795807659a5bf62a8eaa0a34b2a4c805a",
"title": "c33effd795807659a5bf62a8eaa0a34b2a4c805a",
"url": "https://fuchsia.googlesource.com/integration/+/c33effd795807659a5bf62a8eaa0a34b2a4c805a"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "4b86b98dac324e863a2368b97698285d9e2ca626"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@4b86b98dac324e863a2368b97698285d9e2ca626",
"title": "4b86b98dac324e863a2368b97698285d9e2ca626",
"url": "https://fuchsia.googlesource.com/integration/+/4b86b98dac324e863a2368b97698285d9e2ca626"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "138bdc015a46fdbc27d92cc0fa994a0d393be912"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@138bdc015a46fdbc27d92cc0fa994a0d393be912",
"title": "138bdc015a46fdbc27d92cc0fa994a0d393be912",
"url": "https://fuchsia.googlesource.com/integration/+/138bdc015a46fdbc27d92cc0fa994a0d393be912"
}
]
}
},
"gitilesCommit": {
"host": "fuchsia.googlesource.com",
"project": "integration",
"id": "138bdc015a46fdbc27d92cc0fa994a0d393be912",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8868423096134166432"
},
{
"key": "scheduler_job_id",
"value": "fuchsia/global.ci-core.x64-kubsan-e5a0ec7f"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[21:21:30.095] Scheduled build:
{
"id": "8702993034127417393",
"builder": {
"project": "fuchsia",
"bucket": "global.ci",
"builder": "core.x64-kubsan"
},
"createdBy": "project:fuchsia",
"createTime": "2025-09-22T21:21:29.698568288Z",
"updateTime": "2025-09-22T21:21:29.698568288Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "fuchsia.googlesource.com",
"project": "integration",
"id": "138bdc015a46fdbc27d92cc0fa994a0d393be912",
"ref": "refs/heads/main"
}
}
}
[21:21:30.095] Task URL: https://cr-buildbucket.appspot.com/build/8702993034127417393
[21:21:30.095] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868423096134166432:2:0) after 4m44s
[21:21:30.961] Received PubSub notification, asking Buildbucket for the build status
[21:21:30.980] Build status: SCHEDULED
[21:22:34.553] Received PubSub notification, asking Buildbucket for the build status
[21:22:34.640] Build status: STARTED
[21:26:14.164] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868423096134166432:2:0)
[21:26:14.182] Build status: STARTED
[21:26:14.182] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868423096134166432:5:0) after 4m11s
[21:30:25.221] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868423096134166432:5:0)
[21:30:25.265] Build status: STARTED
[21:30:25.265] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868423096134166432:6:0) after 6m10s
[21:36:35.336] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868423096134166432:6:0)
[21:36:35.357] Build status: STARTED
[21:36:35.357] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868423096134166432:7:0) after 8m2s
[21:44:37.374] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868423096134166432:7:0)
[21:44:37.461] Build status: STARTED
[21:44:37.461] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868423096134166432:8:0) after 9m34s
[21:54:11.478] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868423096134166432:8:0)
[21:54:11.516] Build status: STARTED
[21:54:11.516] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868423096134166432:9:0) after 3m1s
[21:57:12.537] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868423096134166432:9:0)
[21:57:12.568] Build status: STARTED
[21:57:12.568] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868423096134166432:10:0) after 5m58s
[22:03:10.635] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868423096134166432:10:0)
[22:03:10.658] Build status: STARTED
[22:03:10.659] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868423096134166432:11:0) after 3m10s
[22:06:20.673] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868423096134166432:11:0)
[22:06:20.716] Build status: STARTED
[22:06:20.716] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868423096134166432:12:0) after 5m38s
[22:11:58.805] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868423096134166432:12:0)
[22:11:58.877] Build status: STARTED
[22:11:58.877] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868423096134166432:13:0) after 8m46s
[22:20:44.994] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868423096134166432:13:0)
[22:20:45.011] Build status: STARTED
[22:20:45.011] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868423096134166432:14:0) after 5m57s
[22:26:42.025] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868423096134166432:14:0)
[22:26:42.050] Build status: STARTED
[22:26:42.050] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868423096134166432:15:0) after 9m32s
[22:36:14.073] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868423096134166432:15:0)
[22:36:14.109] Build status: STARTED
[22:36:14.109] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868423096134166432:16:0) after 8m51s
[22:45:05.145] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868423096134166432:16:0)
[22:45:05.169] Build status: STARTED
[22:45:05.169] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868423096134166432:17:0) after 5m54s
[22:50:59.185] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868423096134166432:17:0)
[22:50:59.206] Build status: STARTED
[22:50:59.206] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868423096134166432:18:0) after 3m37s
[22:54:36.221] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868423096134166432:18:0)
[22:54:36.236] Build status: STARTED
[22:54:36.236] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868423096134166432:19:0) after 5m38s
[23:00:14.286] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868423096134166432:19:0)
[23:00:14.304] Build status: STARTED
[23:00:14.304] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868423096134166432:20:0) after 1m52s
[23:02:06.373] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868423096134166432:20:0)
[23:02:06.389] Build status: STARTED
[23:02:06.389] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868423096134166432:21:0) after 6m39s
[23:08:45.631] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868423096134166432:21:0)
[23:08:45.652] Build status: STARTED
[23:08:45.652] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868423096134166432:22:0) after 3m59s
[23:12:44.723] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868423096134166432:22:0)
[23:12:44.868] Build status: STARTED
[23:12:44.868] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868423096134166432:23:0) after 5m46s
[23:18:30.930] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868423096134166432:23:0)
[23:18:30.948] Build status: STARTED
[23:18:30.948] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868423096134166432:24:0) after 7m39s
[23:26:09.981] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868423096134166432:24:0)
[23:26:10.002] Build status: STARTED
[23:26:10.002] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868423096134166432:25:0) after 6m51s
[23:33:01.079] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868423096134166432:25:0)
[23:33:01.118] Build status: STARTED
[23:33:01.119] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-kubsan-e5a0ec7f:8868423096134166432:26:0) after 9m55s
[23:40:15.307] Received PubSub notification, asking Buildbucket for the build status
[23:40:15.326] Build:
{
"id": "8702993034127417393",
"builder": {
"project": "fuchsia",
"bucket": "global.ci",
"builder": "core.x64-kubsan"
},
"createdBy": "project:fuchsia",
"createTime": "2025-09-22T21:21:29.698568288Z",
"startTime": "2025-09-22T21:22:34.290868589Z",
"endTime": "2025-09-22T23:40:13.233903822Z",
"updateTime": "2025-09-22T23:40:13.233903822Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "fuchsia.googlesource.com",
"project": "integration",
"id": "138bdc015a46fdbc27d92cc0fa994a0d393be912",
"ref": "refs/heads/main"
}
}
}
[23:40:15.326] Invocation finished in 2h18m46.92656955s with status FAILED