sci-ml/koboldcpp
All-in-one local AI server (LLM, image, speech, TTS) on ggml/llama.cpp
Screenshots
-
koboldcpp-1.118.1~amd64cuda rocm +vulkan cpu_flags_x86_avx cpu_flags_x86_avx2 cpu_flags_x86_f16c cpu_flags_x86_fma3 python_single_target_python3_12 python_single_target_python3_13 python_single_target_python3_14 +amdgpu_targets_gfx908 +amdgpu_targets_gfx90a +amdgpu_targets_gfx942 +amdgpu_targets_gfx1030 +amdgpu_targets_gfx1100 +amdgpu_targets_gfx1101 +amdgpu_targets_gfx1200 +amdgpu_targets_gfx1201 amdgpu_targets_gfx803 amdgpu_targets_gfx900 amdgpu_targets_gfx906 amdgpu_targets_gfx940 amdgpu_targets_gfx941 amdgpu_targets_gfx1010 amdgpu_targets_gfx1011 amdgpu_targets_gfx1012 amdgpu_targets_gfx1031 amdgpu_targets_gfx1102 amdgpu_targets_gfx1103 amdgpu_targets_gfx1150 amdgpu_targets_gfx1151
View 
Download 
Browse License: AGPL-3+ MIT Overlay: bentoo
Runtime Dependencies
koboldcpp-1.118.1
python_single_target_python3_12?
( dev-lang/python:3.12 )
python_single_target_python3_13?
( dev-lang/python:3.13 )
python_single_target_python3_14?
( dev-lang/python:3.14 )
cuda?
( dev-util/nvidia-cuda-toolkit:= )
rocm?
( >=dev-util/hip-6.3 >=sci-libs/hipBLAS-6.3 )
vulkan?
( media-libs/vulkan-loader )