[16:25:42.228] New invocation is queued and will start shortly
[16:25:43.352] Starting the invocation (attempt 1)
[16:25:43.379] Popped buildset tag "buildset:commit/gitiles/llvm.googlesource.com/llvm-project/+/c07ab9e2ab0f288c10af172d11a3936b89b952fb"
[16:25:43.379] Popped gitiles commit info from properties and tags
[16:25:43.379] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[16:25:43.379] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[16:25:43.379] Buildbucket request:
{
"requestId": "8883843188644403792",
"builder": {
"project": "fuchsia",
"bucket": "prod",
"builder": "clang-prod-unbounded-trigger"
},
"properties": {
"$recipe_engine/scheduler": {
"hostname": "luci-scheduler.appspot.com",
"invocation": "8883843188644403792",
"job": "fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5",
"triggers": [
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://llvm.googlesource.com/llvm-project",
"revision": "68ce637872a2e1a1dedbb9caa6eacf15ec5c7b99"
},
"id": "https://llvm.googlesource.com/llvm-project/+/refs/heads/main@68ce637872a2e1a1dedbb9caa6eacf15ec5c7b99",
"title": "68ce637872a2e1a1dedbb9caa6eacf15ec5c7b99",
"url": "https://llvm.googlesource.com/llvm-project/+/68ce637872a2e1a1dedbb9caa6eacf15ec5c7b99"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://llvm.googlesource.com/llvm-project",
"revision": "fcead25550bb727215919ecf2dfad17765223c19"
},
"id": "https://llvm.googlesource.com/llvm-project/+/refs/heads/main@fcead25550bb727215919ecf2dfad17765223c19",
"title": "fcead25550bb727215919ecf2dfad17765223c19",
"url": "https://llvm.googlesource.com/llvm-project/+/fcead25550bb727215919ecf2dfad17765223c19"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://llvm.googlesource.com/llvm-project",
"revision": "13faa819168e568404bee320ca7db9bc386f081f"
},
"id": "https://llvm.googlesource.com/llvm-project/+/refs/heads/main@13faa819168e568404bee320ca7db9bc386f081f",
"title": "13faa819168e568404bee320ca7db9bc386f081f",
"url": "https://llvm.googlesource.com/llvm-project/+/13faa819168e568404bee320ca7db9bc386f081f"
},
{
"gitiles": {
"ref": "refs/heads/main",
"repo": "https://llvm.googlesource.com/llvm-project",
"revision": "c07ab9e2ab0f288c10af172d11a3936b89b952fb"
},
"id": "https://llvm.googlesource.com/llvm-project/+/refs/heads/main@c07ab9e2ab0f288c10af172d11a3936b89b952fb",
"title": "c07ab9e2ab0f288c10af172d11a3936b89b952fb",
"url": "https://llvm.googlesource.com/llvm-project/+/c07ab9e2ab0f288c10af172d11a3936b89b952fb"
}
]
}
},
"gitilesCommit": {
"host": "llvm.googlesource.com",
"project": "llvm-project",
"id": "c07ab9e2ab0f288c10af172d11a3936b89b952fb",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8883843188644403792"
},
{
"key": "scheduler_job_id",
"value": "fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[16:25:44.318] Scheduled build:
{
"id": "8718413126585575233",
"builder": {
"project": "fuchsia",
"bucket": "prod",
"builder": "clang-prod-unbounded-trigger"
},
"createdBy": "project:fuchsia",
"createTime": "2025-04-05T16:25:43.564037039Z",
"updateTime": "2025-04-05T16:25:43.564037039Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "llvm.googlesource.com",
"project": "llvm-project",
"id": "c07ab9e2ab0f288c10af172d11a3936b89b952fb",
"ref": "refs/heads/main"
}
}
}
[16:25:44.318] Task URL: https://cr-buildbucket.appspot.com/build/8718413126585575233
[16:25:44.318] Scheduling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:2:0) after 4m42s
[16:25:44.377] Received PubSub notification, asking Buildbucket for the build status
[16:25:44.435] Build status: SCHEDULED
[16:25:48.514] Received PubSub notification, asking Buildbucket for the build status
[16:25:48.569] Build status: STARTED
[16:30:26.521] Handling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:2:0)
[16:30:26.550] Build status: STARTED
[16:30:26.550] Scheduling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:5:0) after 7m50s
[16:38:16.557] Handling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:5:0)
[16:38:16.576] Build status: STARTED
[16:38:16.576] Scheduling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:6:0) after 9m31s
[16:47:47.590] Handling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:6:0)
[16:47:47.610] Build status: STARTED
[16:47:47.611] Scheduling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:7:0) after 1m55s
[16:49:43.670] Handling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:7:0)
[16:49:43.699] Build status: STARTED
[16:49:43.699] Scheduling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:8:0) after 9m52s
[16:59:35.719] Handling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:8:0)
[16:59:35.745] Build status: STARTED
[16:59:35.745] Scheduling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:9:0) after 7m57s
[17:07:32.760] Handling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:9:0)
[17:07:32.776] Build status: STARTED
[17:07:32.776] Scheduling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:10:0) after 5m10s
[17:12:42.798] Handling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:10:0)
[17:12:42.818] Build status: STARTED
[17:12:42.818] Scheduling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:11:0) after 8m25s
[17:21:08.010] Handling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:11:0)
[17:21:08.025] Build status: STARTED
[17:21:08.025] Scheduling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:12:0) after 8m57s
[17:30:05.800] Handling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:12:0)
[17:30:05.831] Build status: STARTED
[17:30:05.832] Scheduling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:13:0) after 7m15s
[17:37:20.859] Handling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:13:0)
[17:37:20.874] Build status: STARTED
[17:37:20.874] Scheduling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:14:0) after 6m27s
[17:43:47.899] Handling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:14:0)
[17:43:47.917] Build status: STARTED
[17:43:47.917] Scheduling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:15:0) after 4m45s
[17:48:33.140] Handling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:15:0)
[17:48:33.182] Build status: STARTED
[17:48:33.182] Scheduling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:16:0) after 2m6s
[17:50:39.498] Handling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:16:0)
[17:50:39.528] Build status: STARTED
[17:50:39.528] Scheduling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:17:0) after 4m14s
[17:54:53.777] Handling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:17:0)
[17:54:53.798] Build status: STARTED
[17:54:53.798] Scheduling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:18:0) after 3m33s
[17:58:26.816] Handling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:18:0)
[17:58:26.835] Build status: STARTED
[17:58:26.835] Scheduling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:19:0) after 1m57s
[18:00:23.994] Handling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:19:0)
[18:00:24.023] Build status: STARTED
[18:00:24.024] Scheduling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:20:0) after 6m25s
[18:06:49.004] Handling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:20:0)
[18:06:49.020] Build status: STARTED
[18:06:49.020] Scheduling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:21:0) after 3m48s
[18:10:37.041] Handling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:21:0)
[18:10:37.061] Build status: STARTED
[18:10:37.061] Scheduling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:22:0) after 1m55s
[18:12:32.085] Handling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:22:0)
[18:12:32.105] Build status: STARTED
[18:12:32.105] Scheduling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:23:0) after 5m5s
[18:17:37.168] Handling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:23:0)
[18:17:37.188] Build status: STARTED
[18:17:37.188] Scheduling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:24:0) after 5m3s
[18:22:40.217] Handling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:24:0)
[18:22:40.284] Build status: STARTED
[18:22:40.284] Scheduling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:25:0) after 2m30s
[18:25:10.302] Handling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:25:0)
[18:25:10.330] Build status: STARTED
[18:25:10.330] Scheduling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:26:0) after 6m36s
[18:31:46.670] Handling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:26:0)
[18:31:46.693] Build status: STARTED
[18:31:46.693] Scheduling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:27:0) after 4m38s
[18:36:24.719] Handling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:27:0)
[18:36:24.753] Build status: STARTED
[18:36:24.754] Scheduling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:28:0) after 1m27s
[18:37:51.788] Handling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:28:0)
[18:37:51.808] Build status: STARTED
[18:37:51.808] Scheduling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:29:0) after 8m7s
[18:45:58.841] Handling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:29:0)
[18:45:58.869] Build status: STARTED
[18:45:58.869] Scheduling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:30:0) after 9m35s
[18:55:34.062] Handling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:30:0)
[18:55:34.082] Build status: STARTED
[18:55:34.082] Scheduling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:31:0) after 3m48s
[18:59:22.206] Handling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:31:0)
[18:59:22.219] Build status: STARTED
[18:59:22.219] Scheduling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:32:0) after 2m36s
[19:01:58.616] Handling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:32:0)
[19:01:58.635] Build status: STARTED
[19:01:58.635] Scheduling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:33:0) after 9m6s
[19:11:04.659] Handling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:33:0)
[19:11:04.674] Build status: STARTED
[19:11:04.674] Scheduling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:34:0) after 4m7s
[19:15:12.014] Handling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:34:0)
[19:15:12.038] Build status: STARTED
[19:15:12.038] Scheduling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:35:0) after 4m38s
[19:19:50.349] Handling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:35:0)
[19:19:50.370] Build status: STARTED
[19:19:50.370] Scheduling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:36:0) after 8m42s
[19:28:32.489] Handling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:36:0)
[19:28:32.510] Build status: STARTED
[19:28:32.510] Scheduling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:37:0) after 7m0s
[19:35:32.533] Handling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:37:0)
[19:35:32.553] Build status: STARTED
[19:35:32.553] Scheduling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:38:0) after 8m38s
[19:44:10.596] Handling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:38:0)
[19:44:10.612] Build status: STARTED
[19:44:10.612] Scheduling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:39:0) after 8m47s
[19:52:58.280] Handling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:39:0)
[19:52:58.320] Build status: STARTED
[19:52:58.320] Scheduling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:40:0) after 3m4s
[19:56:02.465] Handling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:40:0)
[19:56:02.479] Build status: STARTED
[19:56:02.479] Scheduling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:41:0) after 8m56s
[20:04:58.559] Handling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:41:0)
[20:04:58.580] Build status: STARTED
[20:04:58.580] Scheduling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:42:0) after 1m15s
[20:06:13.648] Handling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:42:0)
[20:06:13.666] Build status: STARTED
[20:06:13.666] Scheduling timer "check-buildbucket-build-status" (fuchsia/prod-clang-prod-unbounded-trigger-40be1bb5:8883843188644403792:43:0) after 9m3s
[20:08:53.562] Received PubSub notification, asking Buildbucket for the build status
[20:08:53.583] Build:
{
"id": "8718413126585575233",
"builder": {
"project": "fuchsia",
"bucket": "prod",
"builder": "clang-prod-unbounded-trigger"
},
"createdBy": "project:fuchsia",
"createTime": "2025-04-05T16:25:43.564037039Z",
"startTime": "2025-04-05T16:25:48.277100766Z",
"endTime": "2025-04-05T20:08:53.234737216Z",
"updateTime": "2025-04-05T20:08:53.234737216Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "llvm.googlesource.com",
"project": "llvm-project",
"id": "c07ab9e2ab0f288c10af172d11a3936b89b952fb",
"ref": "refs/heads/main"
}
}
}
[20:08:53.583] Invocation finished in 3h43m11.366273581s with status FAILED