app-misc/llama-cpp
LLM inference in C/C++ (GGML/GGUF) — CPU + optional GPU backends
Screenshots
-
llama-cpp-9608~amd64curl openblas +openmp blis rocm cuda opencl openssl vulkan flexiblas wmma examples cpu_flags_x86_avx cpu_flags_x86_avx2 cpu_flags_x86_fma3 cpu_flags_x86_f16c cpu_flags_x86_bmi2 cpu_flags_x86_avx_vnni cpu_flags_x86_avx512f cpu_flags_x86_avx512vbmi cpu_flags_x86_avx512_vnni cpu_flags_x86_avx512_bf16 +amdgpu_targets_gfx908 +amdgpu_targets_gfx90a +amdgpu_targets_gfx942 +amdgpu_targets_gfx950 +amdgpu_targets_gfx1030 +amdgpu_targets_gfx1100 +amdgpu_targets_gfx1101 +amdgpu_targets_gfx1200 +amdgpu_targets_gfx1201 amdgpu_targets_gfx803 amdgpu_targets_gfx900 amdgpu_targets_gfx906 amdgpu_targets_gfx940 amdgpu_targets_gfx941 amdgpu_targets_gfx1010 amdgpu_targets_gfx1011 amdgpu_targets_gfx1012 amdgpu_targets_gfx1031 amdgpu_targets_gfx1102 amdgpu_targets_gfx1103 amdgpu_targets_gfx1150 amdgpu_targets_gfx1151
View 
Download 
Browse License: MIT Overlay: zGentoo -
llama-cpp-9490~amd64curl openblas +openmp blis rocm cuda opencl openssl vulkan flexiblas wmma examples cpu_flags_x86_avx cpu_flags_x86_avx2 cpu_flags_x86_fma3 cpu_flags_x86_f16c cpu_flags_x86_bmi2 cpu_flags_x86_avx_vnni cpu_flags_x86_avx512f cpu_flags_x86_avx512vbmi cpu_flags_x86_avx512_vnni cpu_flags_x86_avx512_bf16 +amdgpu_targets_gfx908 +amdgpu_targets_gfx90a +amdgpu_targets_gfx942 +amdgpu_targets_gfx950 +amdgpu_targets_gfx1030 +amdgpu_targets_gfx1100 +amdgpu_targets_gfx1101 +amdgpu_targets_gfx1200 +amdgpu_targets_gfx1201 amdgpu_targets_gfx803 amdgpu_targets_gfx900 amdgpu_targets_gfx906 amdgpu_targets_gfx940 amdgpu_targets_gfx941 amdgpu_targets_gfx1010 amdgpu_targets_gfx1011 amdgpu_targets_gfx1012 amdgpu_targets_gfx1031 amdgpu_targets_gfx1102 amdgpu_targets_gfx1103 amdgpu_targets_gfx1150 amdgpu_targets_gfx1151
View Download Browse License: MIT Overlay: zGentoo
Runtime Dependencies
llama-cpp-9608
curl?
( net-misc/curl:= )
openblas?
( sci-libs/openblas:= )
openmp?
( llvm-runtimes/openmp:= )
blis?
( sci-libs/blis:= )
flexiblas?
( sci-libs/flexiblas:= )
rocm?
( >=dev-util/hip-7.1:= >=sci-libs/hipBLAS-7.1:= wmma?
( >=sci-libs/rocWMMA-7.1:= )
)
cuda?
( dev-util/nvidia-cuda-toolkit:= )
openssl?
( dev-libs/openssl:= )
dev-python/numpy
opencl?
( dev-libs/opencl-icd-loader )
vulkan?
( media-libs/vulkan-loader )
acct-user/llama-cpp
acct-group/llama-cpp
llama-cpp-9490
curl?
( net-misc/curl:= )
openblas?
( sci-libs/openblas:= )
openmp?
( llvm-runtimes/openmp:= )
blis?
( sci-libs/blis:= )
flexiblas?
( sci-libs/flexiblas:= )
rocm?
( >=dev-util/hip-7.1:= >=sci-libs/hipBLAS-7.1:= wmma?
( >=sci-libs/rocWMMA-7.1:= )
)
cuda?
( dev-util/nvidia-cuda-toolkit:= )
openssl?
( dev-libs/openssl:= )
dev-python/numpy
opencl?
( dev-libs/opencl-icd-loader )
vulkan?
( media-libs/vulkan-loader )
acct-user/llama-cpp
acct-group/llama-cpp