app-local-ai/bonsai
LocalAI text-generation backend for 1-bit/ternary models (Bonsai fork of llama.cpp)
Screenshots
-
bonsai-4.10.0~amd64test +amdgpu_targets_gfx908 +amdgpu_targets_gfx90a +amdgpu_targets_gfx942 +amdgpu_targets_gfx950 +amdgpu_targets_gfx1030 +amdgpu_targets_gfx1100 +amdgpu_targets_gfx1101 +amdgpu_targets_gfx1200 +amdgpu_targets_gfx1201 amdgpu_targets_gfx803 amdgpu_targets_gfx900 amdgpu_targets_gfx906 amdgpu_targets_gfx940 amdgpu_targets_gfx941 amdgpu_targets_gfx1010 amdgpu_targets_gfx1011 amdgpu_targets_gfx1012 amdgpu_targets_gfx1031 amdgpu_targets_gfx1102 amdgpu_targets_gfx1103 amdgpu_targets_gfx1150 amdgpu_targets_gfx1151 cuda native openblas rocm vulkan video_cards_amdgpu
View 
Download 
Browse License: MIT Overlay: local-ai
ChangeLog
commit 3691bac70a82ed71338946aa680a9a2ea623cfd0
Author: gitea-actions <gitea-actions@noreply.ipnmod.org>
Date: Fri Sep 18 18:56:00 2026 +0000
Manifests for local-ai-distfiles-v4.10.0
commit c513560e68b9db83830ff94c1c02b37ad27e6466
Author: Plamen K. Kosseff <plamen@ipnmod.org>
Date: Fri Sep 18 18:41:39 2026 +0000
LocalAI 4.10.0: lockstep bump, distfiles under local-ai-v tags, fish-speech pinned by commit
Assisted-by: Claude:claude-fable-5
Signed-off-by: Plamen K. Kosseff <plamen@ipnmod.org>
commit b7bb6b90728cb0de04be2c0e9a1939d0feb19663
Author: Plamen K. Kosseff <plamen@ipnmod.org>
Date: Thu Sep 17 17:52:15 2026 +0000
review D1: generate run.sh in the eclasses, revbump ggml-family backends to record rocm subslot deps
Assisted-by: Claude:claude-fable-5
Signed-off-by: Plamen K. Kosseff <plamen@ipnmod.org>
commit aa62f8ce307e2d7faa5ab8b6c740d489f132b348
Author: Plamen K. Kosseff <plamen@ipnmod.org>
Date: Mon Sep 7 09:19:20 2026 +0000
app-local-ai/bonsai: the 4.9.0 pin, not master's; no grpc-server rename yet
Assisted-by: Claude:claude-fable-5
Signed-off-by: Plamen K. Kosseff <plamen@ipnmod.org>
commit 9a429e20c533fce642956069f8c5fa2036041256
Author: Plamen K. Kosseff <plamen@ipnmod.org>
Date: Mon Sep 7 09:10:42 2026 +0000
app-local-ai/bonsai: new backend, llama.cpp fork on the shared glue
Assisted-by: Claude:claude-fable-5
Signed-off-by: Plamen K. Kosseff <plamen@ipnmod.org>
Author: gitea-actions <gitea-actions@noreply.ipnmod.org>
Date: Fri Sep 18 18:56:00 2026 +0000
Manifests for local-ai-distfiles-v4.10.0
commit c513560e68b9db83830ff94c1c02b37ad27e6466
Author: Plamen K. Kosseff <plamen@ipnmod.org>
Date: Fri Sep 18 18:41:39 2026 +0000
LocalAI 4.10.0: lockstep bump, distfiles under local-ai-v tags, fish-speech pinned by commit
Assisted-by: Claude:claude-fable-5
Signed-off-by: Plamen K. Kosseff <plamen@ipnmod.org>
commit b7bb6b90728cb0de04be2c0e9a1939d0feb19663
Author: Plamen K. Kosseff <plamen@ipnmod.org>
Date: Thu Sep 17 17:52:15 2026 +0000
review D1: generate run.sh in the eclasses, revbump ggml-family backends to record rocm subslot deps
Assisted-by: Claude:claude-fable-5
Signed-off-by: Plamen K. Kosseff <plamen@ipnmod.org>
commit aa62f8ce307e2d7faa5ab8b6c740d489f132b348
Author: Plamen K. Kosseff <plamen@ipnmod.org>
Date: Mon Sep 7 09:19:20 2026 +0000
app-local-ai/bonsai: the 4.9.0 pin, not master's; no grpc-server rename yet
Assisted-by: Claude:claude-fable-5
Signed-off-by: Plamen K. Kosseff <plamen@ipnmod.org>
commit 9a429e20c533fce642956069f8c5fa2036041256
Author: Plamen K. Kosseff <plamen@ipnmod.org>
Date: Mon Sep 7 09:10:42 2026 +0000
app-local-ai/bonsai: new backend, llama.cpp fork on the shared glue
Assisted-by: Claude:claude-fable-5
Signed-off-by: Plamen K. Kosseff <plamen@ipnmod.org>