app-local-ai/bonsai
LocalAI text-generation backend for 1-bit/ternary models (Bonsai fork of llama.cpp)
Screenshots
-
bonsai-4.9.0~amd64test +amdgpu_targets_gfx908 +amdgpu_targets_gfx90a +amdgpu_targets_gfx942 +amdgpu_targets_gfx950 +amdgpu_targets_gfx1030 +amdgpu_targets_gfx1100 +amdgpu_targets_gfx1101 +amdgpu_targets_gfx1200 +amdgpu_targets_gfx1201 amdgpu_targets_gfx803 amdgpu_targets_gfx900 amdgpu_targets_gfx906 amdgpu_targets_gfx940 amdgpu_targets_gfx941 amdgpu_targets_gfx1010 amdgpu_targets_gfx1011 amdgpu_targets_gfx1012 amdgpu_targets_gfx1031 amdgpu_targets_gfx1102 amdgpu_targets_gfx1103 amdgpu_targets_gfx1150 amdgpu_targets_gfx1151 cuda native openblas rocm vulkan video_cards_amdgpu
View 
Download 
Browse License: MIT Overlay: local-ai
Runtime Dependencies
bonsai-4.9.0
net-misc/curl
dev-cpp/abseil-cpp:=
dev-libs/protobuf:=
net-libs/grpc:=
sci-ml/local-ai
openblas?
( sci-libs/openblas )
vulkan?
( media-libs/vulkan-loader video_cards_amdgpu?
( media-libs/mesa[vulkan,video_cards_radeonsi] )
)
cuda?
( dev-util/nvidia-cuda-toolkit:= )
rocm?
( >=dev-util/hip-7.2 >=sci-libs/hipBLAS-7.2 >=sci-libs/rocBLAS-7.2 )
dev-cpp/abseil-cpp:=
dev-libs/protobuf:=
net-libs/grpc:=
sci-ml/local-ai
openblas?
( sci-libs/openblas )
vulkan?
( media-libs/vulkan-loader video_cards_amdgpu?
( media-libs/mesa[vulkan,video_cards_radeonsi] )
)
cuda?
( dev-util/nvidia-cuda-toolkit:= )
rocm?
( >=dev-util/hip-7.2 >=sci-libs/hipBLAS-7.2 >=sci-libs/rocBLAS-7.2 )