[20:23:23.340] New invocation is queued and will start shortly
[20:23:24.726] Starting the invocation (attempt 1)
[20:23:24.761] Popped buildset tag "buildset:commit/gitiles/fuchsia.googlesource.com/integration/+/8e3bf181212c8c6e4983f35fd843d0b04db46e38"
[20:23:24.761] Popped gitiles commit info from properties and tags
[20:23:24.761] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[20:23:24.762] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[20:23:24.762] Buildbucket request:
{
"requestId": "8851213326874386320",
"builder": {
"project": "fuchsia",
"bucket": "global.ci",
"builder": "core.x64-lto"
},
"properties": {
"$recipe_engine/scheduler": {
"hostname": "luci-scheduler.appspot.com",
"invocation": "8851213326874386320",
"job": "fuchsia/global.ci-core.x64-lto-e5a0ec7f",
"triggers": [
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "5b4c747db11c2a1920fd5103a5bbcdf640621a95"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@5b4c747db11c2a1920fd5103a5bbcdf640621a95",
"title": "5b4c747db11c2a1920fd5103a5bbcdf640621a95",
"url": "https://fuchsia.googlesource.com/integration/+/5b4c747db11c2a1920fd5103a5bbcdf640621a95"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "59fd404c019a67f434cb7d3a45c0faf2c09f6fef"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@59fd404c019a67f434cb7d3a45c0faf2c09f6fef",
"title": "59fd404c019a67f434cb7d3a45c0faf2c09f6fef",
"url": "https://fuchsia.googlesource.com/integration/+/59fd404c019a67f434cb7d3a45c0faf2c09f6fef"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "f01f639ed517fba7e21ea08d8f5c1cec94e5ca5b"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@f01f639ed517fba7e21ea08d8f5c1cec94e5ca5b",
"title": "f01f639ed517fba7e21ea08d8f5c1cec94e5ca5b",
"url": "https://fuchsia.googlesource.com/integration/+/f01f639ed517fba7e21ea08d8f5c1cec94e5ca5b"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "93a453ab88a5551f6426dd668eadce6533a588bd"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@93a453ab88a5551f6426dd668eadce6533a588bd",
"title": "93a453ab88a5551f6426dd668eadce6533a588bd",
"url": "https://fuchsia.googlesource.com/integration/+/93a453ab88a5551f6426dd668eadce6533a588bd"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "cc638228fd6c45bf41791ba4afe6799a7311da51"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@cc638228fd6c45bf41791ba4afe6799a7311da51",
"title": "cc638228fd6c45bf41791ba4afe6799a7311da51",
"url": "https://fuchsia.googlesource.com/integration/+/cc638228fd6c45bf41791ba4afe6799a7311da51"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "f506ce5970d506f589aaaeab7938e75fcebad079"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@f506ce5970d506f589aaaeab7938e75fcebad079",
"title": "f506ce5970d506f589aaaeab7938e75fcebad079",
"url": "https://fuchsia.googlesource.com/integration/+/f506ce5970d506f589aaaeab7938e75fcebad079"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "84f5b20a147b041371c9b4a8ed2737ea2fd7ee74"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@84f5b20a147b041371c9b4a8ed2737ea2fd7ee74",
"title": "84f5b20a147b041371c9b4a8ed2737ea2fd7ee74",
"url": "https://fuchsia.googlesource.com/integration/+/84f5b20a147b041371c9b4a8ed2737ea2fd7ee74"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "4cdc67a27c5c5d48486dd19241a9d5e6e37bc956"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@4cdc67a27c5c5d48486dd19241a9d5e6e37bc956",
"title": "4cdc67a27c5c5d48486dd19241a9d5e6e37bc956",
"url": "https://fuchsia.googlesource.com/integration/+/4cdc67a27c5c5d48486dd19241a9d5e6e37bc956"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "c2baf8dcf1c43a788806a38567e830c4136c8705"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@c2baf8dcf1c43a788806a38567e830c4136c8705",
"title": "c2baf8dcf1c43a788806a38567e830c4136c8705",
"url": "https://fuchsia.googlesource.com/integration/+/c2baf8dcf1c43a788806a38567e830c4136c8705"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "def1e8a3374db852b2e8f014d99b99cf7e47fc29"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@def1e8a3374db852b2e8f014d99b99cf7e47fc29",
"title": "def1e8a3374db852b2e8f014d99b99cf7e47fc29",
"url": "https://fuchsia.googlesource.com/integration/+/def1e8a3374db852b2e8f014d99b99cf7e47fc29"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "4c12dc47b870f80e19964b874a4dd961558a8b4a"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@4c12dc47b870f80e19964b874a4dd961558a8b4a",
"title": "4c12dc47b870f80e19964b874a4dd961558a8b4a",
"url": "https://fuchsia.googlesource.com/integration/+/4c12dc47b870f80e19964b874a4dd961558a8b4a"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "a98870442ec228ff8d3b161357c558b6da9cb655"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@a98870442ec228ff8d3b161357c558b6da9cb655",
"title": "a98870442ec228ff8d3b161357c558b6da9cb655",
"url": "https://fuchsia.googlesource.com/integration/+/a98870442ec228ff8d3b161357c558b6da9cb655"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "b8b6e368d3f0786e44811cc2c274beaab69828b4"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@b8b6e368d3f0786e44811cc2c274beaab69828b4",
"title": "b8b6e368d3f0786e44811cc2c274beaab69828b4",
"url": "https://fuchsia.googlesource.com/integration/+/b8b6e368d3f0786e44811cc2c274beaab69828b4"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://fuchsia.googlesource.com/integration",
"revision": "8e3bf181212c8c6e4983f35fd843d0b04db46e38"
},
"id": "https://fuchsia.googlesource.com/integration/+/refs/heads/main@8e3bf181212c8c6e4983f35fd843d0b04db46e38",
"title": "8e3bf181212c8c6e4983f35fd843d0b04db46e38",
"url": "https://fuchsia.googlesource.com/integration/+/8e3bf181212c8c6e4983f35fd843d0b04db46e38"
}
]
}
},
"gitilesCommit": {
"host": "fuchsia.googlesource.com",
"project": "integration",
"id": "8e3bf181212c8c6e4983f35fd843d0b04db46e38",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8851213326874386320"
},
{
"key": "scheduler_job_id",
"value": "fuchsia/global.ci-core.x64-lto-e5a0ec7f"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[20:23:25.120] Scheduled build:
{
"id": "8685783264686235841",
"builder": {
"project": "fuchsia",
"bucket": "global.ci",
"builder": "core.x64-lto"
},
"createdBy": "project:fuchsia",
"createTime": "2026-03-31T20:23:24.805928312Z",
"updateTime": "2026-03-31T20:23:24.805928312Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "fuchsia.googlesource.com",
"project": "integration",
"id": "8e3bf181212c8c6e4983f35fd843d0b04db46e38",
"ref": "refs/heads/main"
}
}
}
[20:23:25.120] Task URL: https://cr-buildbucket.appspot.com/build/8685783264686235841
[20:23:25.120] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-lto-e5a0ec7f:8851213326874386320:2:0) after 9m50s
[20:23:26.074] Received PubSub notification, asking Buildbucket for the build status
[20:23:26.093] Build status: SCHEDULED
[20:23:49.366] Received PubSub notification, asking Buildbucket for the build status
[20:23:49.396] Build status: STARTED
[20:33:15.223] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-lto-e5a0ec7f:8851213326874386320:2:0)
[20:33:15.251] Build status: STARTED
[20:33:15.251] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-lto-e5a0ec7f:8851213326874386320:5:0) after 6m33s
[20:39:48.272] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-lto-e5a0ec7f:8851213326874386320:5:0)
[20:39:48.291] Build status: STARTED
[20:39:48.291] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-lto-e5a0ec7f:8851213326874386320:6:0) after 2m24s
[20:42:12.319] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-lto-e5a0ec7f:8851213326874386320:6:0)
[20:42:12.346] Build status: STARTED
[20:42:12.346] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-lto-e5a0ec7f:8851213326874386320:7:0) after 2m28s
[20:44:40.371] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-lto-e5a0ec7f:8851213326874386320:7:0)
[20:44:40.391] Build status: STARTED
[20:44:40.391] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-lto-e5a0ec7f:8851213326874386320:8:0) after 8m20s
[20:53:00.407] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-lto-e5a0ec7f:8851213326874386320:8:0)
[20:53:00.426] Build status: STARTED
[20:53:00.426] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-lto-e5a0ec7f:8851213326874386320:9:0) after 1m14s
[20:54:14.450] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-lto-e5a0ec7f:8851213326874386320:9:0)
[20:54:14.505] Build status: STARTED
[20:54:14.505] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-lto-e5a0ec7f:8851213326874386320:10:0) after 8m39s
[21:02:53.521] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-lto-e5a0ec7f:8851213326874386320:10:0)
[21:02:53.538] Build status: STARTED
[21:02:53.538] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-lto-e5a0ec7f:8851213326874386320:11:0) after 8m47s
[21:11:40.555] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-lto-e5a0ec7f:8851213326874386320:11:0)
[21:11:40.574] Build status: STARTED
[21:11:40.574] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-lto-e5a0ec7f:8851213326874386320:12:0) after 9m11s
[21:20:51.641] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-lto-e5a0ec7f:8851213326874386320:12:0)
[21:20:51.703] Build status: STARTED
[21:20:51.703] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-lto-e5a0ec7f:8851213326874386320:13:0) after 5m57s
[21:26:48.759] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-lto-e5a0ec7f:8851213326874386320:13:0)
[21:26:48.779] Build status: STARTED
[21:26:48.779] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-lto-e5a0ec7f:8851213326874386320:14:0) after 8m31s
[21:35:19.816] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-lto-e5a0ec7f:8851213326874386320:14:0)
[21:35:19.863] Build status: STARTED
[21:35:19.863] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-lto-e5a0ec7f:8851213326874386320:15:0) after 6m41s
[21:42:01.032] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-lto-e5a0ec7f:8851213326874386320:15:0)
[21:42:01.052] Build status: STARTED
[21:42:01.052] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-lto-e5a0ec7f:8851213326874386320:16:0) after 3m32s
[21:45:33.083] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-lto-e5a0ec7f:8851213326874386320:16:0)
[21:45:33.102] Build status: STARTED
[21:45:33.102] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-lto-e5a0ec7f:8851213326874386320:17:0) after 3m57s
[21:49:30.141] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-lto-e5a0ec7f:8851213326874386320:17:0)
[21:49:30.186] Build status: STARTED
[21:49:30.186] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-lto-e5a0ec7f:8851213326874386320:18:0) after 7m26s
[21:56:56.252] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-lto-e5a0ec7f:8851213326874386320:18:0)
[21:56:56.269] Build status: STARTED
[21:56:56.269] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-lto-e5a0ec7f:8851213326874386320:19:0) after 1m23s
[21:58:19.296] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-lto-e5a0ec7f:8851213326874386320:19:0)
[21:58:19.386] Build status: STARTED
[21:58:19.386] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-lto-e5a0ec7f:8851213326874386320:20:0) after 8m15s
[22:06:34.423] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-lto-e5a0ec7f:8851213326874386320:20:0)
[22:06:34.454] Build status: STARTED
[22:06:34.454] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-lto-e5a0ec7f:8851213326874386320:21:0) after 7m27s
[22:14:01.497] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-lto-e5a0ec7f:8851213326874386320:21:0)
[22:14:01.515] Build status: STARTED
[22:14:01.515] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-lto-e5a0ec7f:8851213326874386320:22:0) after 9m8s
[22:23:09.619] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-lto-e5a0ec7f:8851213326874386320:22:0)
[22:23:09.639] Build status: STARTED
[22:23:09.639] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-lto-e5a0ec7f:8851213326874386320:23:0) after 8m15s
[22:31:24.668] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-lto-e5a0ec7f:8851213326874386320:23:0)
[22:31:24.682] Build status: STARTED
[22:31:24.682] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-lto-e5a0ec7f:8851213326874386320:24:0) after 9m19s
[22:40:43.935] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-lto-e5a0ec7f:8851213326874386320:24:0)
[22:40:43.984] Build status: STARTED
[22:40:43.984] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-lto-e5a0ec7f:8851213326874386320:25:0) after 6m10s
[22:46:54.003] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-lto-e5a0ec7f:8851213326874386320:25:0)
[22:46:54.031] Build status: STARTED
[22:46:54.031] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-lto-e5a0ec7f:8851213326874386320:26:0) after 3m53s
[22:50:47.098] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-lto-e5a0ec7f:8851213326874386320:26:0)
[22:50:47.139] Build status: STARTED
[22:50:47.139] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-lto-e5a0ec7f:8851213326874386320:27:0) after 9m8s
[22:59:55.254] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-lto-e5a0ec7f:8851213326874386320:27:0)
[22:59:55.275] Build status: STARTED
[22:59:55.275] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-lto-e5a0ec7f:8851213326874386320:28:0) after 1m33s
[23:01:28.343] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-lto-e5a0ec7f:8851213326874386320:28:0)
[23:01:28.364] Build status: STARTED
[23:01:28.364] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-lto-e5a0ec7f:8851213326874386320:29:0) after 6m42s
[23:08:10.365] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-lto-e5a0ec7f:8851213326874386320:29:0)
[23:08:10.380] Build status: STARTED
[23:08:10.380] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-lto-e5a0ec7f:8851213326874386320:30:0) after 1m30s
[23:09:40.525] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-lto-e5a0ec7f:8851213326874386320:30:0)
[23:09:40.545] Build status: STARTED
[23:09:40.545] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-lto-e5a0ec7f:8851213326874386320:31:0) after 7m39s
[23:17:19.536] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-lto-e5a0ec7f:8851213326874386320:31:0)
[23:17:19.557] Build status: STARTED
[23:17:19.557] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-lto-e5a0ec7f:8851213326874386320:32:0) after 9m51s
[23:27:10.549] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-lto-e5a0ec7f:8851213326874386320:32:0)
[23:27:10.579] Build status: STARTED
[23:27:10.580] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-lto-e5a0ec7f:8851213326874386320:33:0) after 2m46s
[23:29:56.727] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-lto-e5a0ec7f:8851213326874386320:33:0)
[23:29:56.742] Build status: STARTED
[23:29:56.742] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-lto-e5a0ec7f:8851213326874386320:34:0) after 1m14s
[23:31:10.862] Handling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-lto-e5a0ec7f:8851213326874386320:34:0)
[23:31:10.887] Build status: STARTED
[23:31:10.887] Scheduling timer "check-buildbucket-build-status" (fuchsia/global.ci-core.x64-lto-e5a0ec7f:8851213326874386320:35:0) after 4m56s
[23:35:32.774] Received PubSub notification, asking Buildbucket for the build status
[23:35:32.790] Build:
{
"id": "8685783264686235841",
"builder": {
"project": "fuchsia",
"bucket": "global.ci",
"builder": "core.x64-lto"
},
"createdBy": "project:fuchsia",
"createTime": "2026-03-31T20:23:24.805928312Z",
"startTime": "2026-03-31T20:23:49.081671737Z",
"endTime": "2026-03-31T23:35:24.353976651Z",
"updateTime": "2026-03-31T23:35:24.353976651Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "fuchsia.googlesource.com",
"project": "integration",
"id": "8e3bf181212c8c6e4983f35fd843d0b04db46e38",
"ref": "refs/heads/main"
}
}
}
[23:35:32.790] Invocation finished in 3h12m9.455163565s with status FAILED