gpo.zugaina.org

Search Portage & Overlays:

app-misc/llama-cpp

LLM inference in C/C++ (GGML/GGUF) — CPU + optional GPU backends

Screenshots

  • llama-cpp-9608
    ~amd64
    curl openblas +openmp blis rocm cuda opencl openssl vulkan flexiblas wmma examples cpu_flags_x86_avx cpu_flags_x86_avx2 cpu_flags_x86_fma3 cpu_flags_x86_f16c cpu_flags_x86_bmi2 cpu_flags_x86_avx_vnni cpu_flags_x86_avx512f cpu_flags_x86_avx512vbmi cpu_flags_x86_avx512_vnni cpu_flags_x86_avx512_bf16 +amdgpu_targets_gfx908 +amdgpu_targets_gfx90a +amdgpu_targets_gfx942 +amdgpu_targets_gfx950 +amdgpu_targets_gfx1030 +amdgpu_targets_gfx1100 +amdgpu_targets_gfx1101 +amdgpu_targets_gfx1200 +amdgpu_targets_gfx1201 amdgpu_targets_gfx803 amdgpu_targets_gfx900 amdgpu_targets_gfx906 amdgpu_targets_gfx940 amdgpu_targets_gfx941 amdgpu_targets_gfx1010 amdgpu_targets_gfx1011 amdgpu_targets_gfx1012 amdgpu_targets_gfx1031 amdgpu_targets_gfx1102 amdgpu_targets_gfx1103 amdgpu_targets_gfx1150 amdgpu_targets_gfx1151

    View      Download      Browse     License: MIT   
    Overlay: zGentoo
  • llama-cpp-9490
    ~amd64
    curl openblas +openmp blis rocm cuda opencl openssl vulkan flexiblas wmma examples cpu_flags_x86_avx cpu_flags_x86_avx2 cpu_flags_x86_fma3 cpu_flags_x86_f16c cpu_flags_x86_bmi2 cpu_flags_x86_avx_vnni cpu_flags_x86_avx512f cpu_flags_x86_avx512vbmi cpu_flags_x86_avx512_vnni cpu_flags_x86_avx512_bf16 +amdgpu_targets_gfx908 +amdgpu_targets_gfx90a +amdgpu_targets_gfx942 +amdgpu_targets_gfx950 +amdgpu_targets_gfx1030 +amdgpu_targets_gfx1100 +amdgpu_targets_gfx1101 +amdgpu_targets_gfx1200 +amdgpu_targets_gfx1201 amdgpu_targets_gfx803 amdgpu_targets_gfx900 amdgpu_targets_gfx906 amdgpu_targets_gfx940 amdgpu_targets_gfx941 amdgpu_targets_gfx1010 amdgpu_targets_gfx1011 amdgpu_targets_gfx1012 amdgpu_targets_gfx1031 amdgpu_targets_gfx1102 amdgpu_targets_gfx1103 amdgpu_targets_gfx1150 amdgpu_targets_gfx1151

    View      Download      Browse     License: MIT   
    Overlay: zGentoo

USE Flags

curl
Global: Adds support for client-side URL transfer library
openblas
* This flag is undocumented *
+openmp
* This flag is undocumented *
blis
* This flag is undocumented *
rocm
* This flag is undocumented *
cuda
Global: Build CUDA binaries.
opencl
Global: Build OpenCL binaries.
openssl
Global: Uses dev-libs/openssl for verifying lua packages instead of md5sum.
vulkan
* This flag is undocumented *
flexiblas
* This flag is undocumented *
wmma
* This flag is undocumented *
examples
Global: Install examples, usually source code
cpu_flags_x86_avx
* This flag is undocumented *
cpu_flags_x86_avx2
* This flag is undocumented *
cpu_flags_x86_fma3
* This flag is undocumented *
cpu_flags_x86_f16c
* This flag is undocumented *
cpu_flags_x86_bmi2
* This flag is undocumented *
cpu_flags_x86_avx_vnni
* This flag is undocumented *
cpu_flags_x86_avx512f
* This flag is undocumented *
cpu_flags_x86_avx512vbmi
* This flag is undocumented *
cpu_flags_x86_avx512_vnni
* This flag is undocumented *
cpu_flags_x86_avx512_bf16
* This flag is undocumented *
+amdgpu_targets_gfx908
* This flag is undocumented *
+amdgpu_targets_gfx90a
* This flag is undocumented *
+amdgpu_targets_gfx942
* This flag is undocumented *
+amdgpu_targets_gfx950
* This flag is undocumented *
+amdgpu_targets_gfx1030
* This flag is undocumented *
+amdgpu_targets_gfx1100
* This flag is undocumented *
+amdgpu_targets_gfx1101
* This flag is undocumented *
+amdgpu_targets_gfx1200
* This flag is undocumented *
+amdgpu_targets_gfx1201
* This flag is undocumented *
amdgpu_targets_gfx803
* This flag is undocumented *
amdgpu_targets_gfx900
* This flag is undocumented *
amdgpu_targets_gfx906
* This flag is undocumented *
amdgpu_targets_gfx940
* This flag is undocumented *
amdgpu_targets_gfx941
* This flag is undocumented *
amdgpu_targets_gfx1010
* This flag is undocumented *
amdgpu_targets_gfx1011
* This flag is undocumented *
amdgpu_targets_gfx1012
* This flag is undocumented *
amdgpu_targets_gfx1031
* This flag is undocumented *
amdgpu_targets_gfx1102
* This flag is undocumented *
amdgpu_targets_gfx1103
* This flag is undocumented *
amdgpu_targets_gfx1150
* This flag is undocumented *
amdgpu_targets_gfx1151
* This flag is undocumented *