app-local-ai/bonsai
LocalAI text-generation backend for 1-bit/ternary models (Bonsai fork of llama.cpp)
Screenshots
-
bonsai-4.9.0~amd64test +amdgpu_targets_gfx908 +amdgpu_targets_gfx90a +amdgpu_targets_gfx942 +amdgpu_targets_gfx950 +amdgpu_targets_gfx1030 +amdgpu_targets_gfx1100 +amdgpu_targets_gfx1101 +amdgpu_targets_gfx1200 +amdgpu_targets_gfx1201 amdgpu_targets_gfx803 amdgpu_targets_gfx900 amdgpu_targets_gfx906 amdgpu_targets_gfx940 amdgpu_targets_gfx941 amdgpu_targets_gfx1010 amdgpu_targets_gfx1011 amdgpu_targets_gfx1012 amdgpu_targets_gfx1031 amdgpu_targets_gfx1102 amdgpu_targets_gfx1103 amdgpu_targets_gfx1150 amdgpu_targets_gfx1151 cuda native openblas rocm vulkan video_cards_amdgpu
View 
Download 
Browse License: MIT Overlay: local-ai
ChangeLog
commit aa62f8ce307e2d7faa5ab8b6c740d489f132b348
Author: Plamen K. Kosseff <plamen@ipnmod.org>
Date: Mon Sep 7 09:19:20 2026 +0000
app-local-ai/bonsai: the 4.9.0 pin, not master's; no grpc-server rename yet
Assisted-by: Claude:claude-fable-5
Signed-off-by: Plamen K. Kosseff <plamen@ipnmod.org>
commit 9a429e20c533fce642956069f8c5fa2036041256
Author: Plamen K. Kosseff <plamen@ipnmod.org>
Date: Mon Sep 7 09:10:42 2026 +0000
app-local-ai/bonsai: new backend, llama.cpp fork on the shared glue
Assisted-by: Claude:claude-fable-5
Signed-off-by: Plamen K. Kosseff <plamen@ipnmod.org>
Author: Plamen K. Kosseff <plamen@ipnmod.org>
Date: Mon Sep 7 09:19:20 2026 +0000
app-local-ai/bonsai: the 4.9.0 pin, not master's; no grpc-server rename yet
Assisted-by: Claude:claude-fable-5
Signed-off-by: Plamen K. Kosseff <plamen@ipnmod.org>
commit 9a429e20c533fce642956069f8c5fa2036041256
Author: Plamen K. Kosseff <plamen@ipnmod.org>
Date: Mon Sep 7 09:10:42 2026 +0000
app-local-ai/bonsai: new backend, llama.cpp fork on the shared glue
Assisted-by: Claude:claude-fable-5
Signed-off-by: Plamen K. Kosseff <plamen@ipnmod.org>