Gentoo Portage Overlays - sci-misc/llama-cpp

sci-misc/llama-cpp

Port of Facebook's LLaMA model in C/C++

Screenshots

https://github.com/ggml-org/llama.cpp

llama-cpp-9999

blis curl cuda flexiblas openblas opencl +openmp openssl rocm vulkan wmma +amdgpu_targets_gfx908 +amdgpu_targets_gfx90a +amdgpu_targets_gfx942 +amdgpu_targets_gfx1030 +amdgpu_targets_gfx1100 +amdgpu_targets_gfx1101 +amdgpu_targets_gfx1200 +amdgpu_targets_gfx1201 amdgpu_targets_gfx803 amdgpu_targets_gfx900 amdgpu_targets_gfx906 amdgpu_targets_gfx940 amdgpu_targets_gfx941 amdgpu_targets_gfx1010 amdgpu_targets_gfx1011 amdgpu_targets_gfx1012 amdgpu_targets_gfx1031 amdgpu_targets_gfx1102 amdgpu_targets_gfx1103 amdgpu_targets_gfx1150 amdgpu_targets_gfx1151

View

Download

Browse License: MIT

Overlay: vklimovs

llama-cpp-9999

curl openblas +openmp blis rocm cuda opencl openssl vulkan flexiblas wmma examples +amdgpu_targets_gfx908 +amdgpu_targets_gfx90a +amdgpu_targets_gfx942 +amdgpu_targets_gfx1030 +amdgpu_targets_gfx1100 +amdgpu_targets_gfx1101 +amdgpu_targets_gfx1200 +amdgpu_targets_gfx1201 amdgpu_targets_gfx803 amdgpu_targets_gfx900 amdgpu_targets_gfx906 amdgpu_targets_gfx940 amdgpu_targets_gfx941 amdgpu_targets_gfx1010 amdgpu_targets_gfx1011 amdgpu_targets_gfx1012 amdgpu_targets_gfx1031 amdgpu_targets_gfx1102 amdgpu_targets_gfx1103 amdgpu_targets_gfx1150 amdgpu_targets_gfx1151

View

Download

Browse License: MIT

Overlay: guru

llama-cpp-9999

~amd64

curl openblas +openmp blis hip cuda opencl vulkan +amdgpu_targets_gfx908 +amdgpu_targets_gfx90a +amdgpu_targets_gfx942 +amdgpu_targets_gfx1030 +amdgpu_targets_gfx1100 +amdgpu_targets_gfx1101 +amdgpu_targets_gfx1200 +amdgpu_targets_gfx1201 amdgpu_targets_gfx803 amdgpu_targets_gfx900 amdgpu_targets_gfx906 amdgpu_targets_gfx940 amdgpu_targets_gfx941 amdgpu_targets_gfx1010 amdgpu_targets_gfx1011 amdgpu_targets_gfx1012 amdgpu_targets_gfx1031 amdgpu_targets_gfx1102 amdgpu_targets_gfx1103 amdgpu_targets_gfx1150 amdgpu_targets_gfx1151

View

Download

Browse License: MIT

Overlay: FireBurn

llama-cpp-9999

View

Download

Browse License: MIT

Overlay: inode64-overlay

llama-cpp-9999

openblas +openmp blis rocm cuda opencl +openssl vulkan flexiblas wmma examples +webui sycl cpu_flags_x86_avx cpu_flags_x86_avx2 cpu_flags_x86_avx512f cpu_flags_x86_avx512vbmi cpu_flags_x86_bmi2 cpu_flags_x86_f16c cpu_flags_x86_fma3 cpu_flags_x86_sse4_2 +amdgpu_targets_gfx908 +amdgpu_targets_gfx90a +amdgpu_targets_gfx942 +amdgpu_targets_gfx950 +amdgpu_targets_gfx1030 +amdgpu_targets_gfx1100 +amdgpu_targets_gfx1101 +amdgpu_targets_gfx1200 +amdgpu_targets_gfx1201 amdgpu_targets_gfx803 amdgpu_targets_gfx900 amdgpu_targets_gfx906 amdgpu_targets_gfx940 amdgpu_targets_gfx941 amdgpu_targets_gfx1010 amdgpu_targets_gfx1011 amdgpu_targets_gfx1012 amdgpu_targets_gfx1031 amdgpu_targets_gfx1102 amdgpu_targets_gfx1103 amdgpu_targets_gfx1150 amdgpu_targets_gfx1151

View

Download

Browse License: MIT

Overlay: stuff

llama-cpp-0_pre9413

~amd64

View

Download

Browse License: MIT

Overlay: stuff

llama-cpp-0_pre9404

~amd64

View

Download

Browse License: MIT

Overlay: stuff

llama-cpp-0_pre9284

~amd64

View

Download

Browse License: MIT

Overlay: vklimovs

llama-cpp-0_pre8838

~amd64

View

Download

Browse License: MIT

Overlay: inode64-overlay

llama-cpp-0_pre8838

~amd64

View

Download

Browse License: MIT

Overlay: guru

llama-cpp-0_pre8628

~amd64

curl openblas +openmp blis rocm cuda opencl vulkan flexiblas wmma examples +amdgpu_targets_gfx908 +amdgpu_targets_gfx90a +amdgpu_targets_gfx942 +amdgpu_targets_gfx1030 +amdgpu_targets_gfx1100 +amdgpu_targets_gfx1101 +amdgpu_targets_gfx1200 +amdgpu_targets_gfx1201 amdgpu_targets_gfx803 amdgpu_targets_gfx900 amdgpu_targets_gfx906 amdgpu_targets_gfx940 amdgpu_targets_gfx941 amdgpu_targets_gfx1010 amdgpu_targets_gfx1011 amdgpu_targets_gfx1012 amdgpu_targets_gfx1031 amdgpu_targets_gfx1102 amdgpu_targets_gfx1103 amdgpu_targets_gfx1150 amdgpu_targets_gfx1151

View

Download

Browse License: MIT

Overlay: guru

llama-cpp-0_pre8198

~amd64

View

Download

Browse License: MIT

Overlay: guru

llama-cpp-0_pre7924

~amd64

View

Download

Browse License: MIT

Overlay: guru

llama-cpp-0_pre7611

~amd64

curl openblas +openmp blis hip cuda opencl vulkan flexiblas +amdgpu_targets_gfx908 +amdgpu_targets_gfx90a +amdgpu_targets_gfx942 +amdgpu_targets_gfx1030 +amdgpu_targets_gfx1100 +amdgpu_targets_gfx1101 +amdgpu_targets_gfx1200 +amdgpu_targets_gfx1201 amdgpu_targets_gfx803 amdgpu_targets_gfx900 amdgpu_targets_gfx906 amdgpu_targets_gfx940 amdgpu_targets_gfx941 amdgpu_targets_gfx1010 amdgpu_targets_gfx1011 amdgpu_targets_gfx1012 amdgpu_targets_gfx1031 amdgpu_targets_gfx1102 amdgpu_targets_gfx1103 amdgpu_targets_gfx1150 amdgpu_targets_gfx1151

View

Download

Browse License: MIT

Overlay: guru

llama-cpp-0_pre7276

~amd64

View

Download

Browse License: MIT

Overlay: guru

llama-cpp-0_pre6980

~amd64

View

Download

Browse License: MIT

Overlay: guru

ChangeLog USE Flags Dependencies Reverse Deps Related Bugs

Runtime Dependencies

llama-cpp-9999

blis?
      ( sci-libs/blis:= )

curl?
      ( net-misc/curl:= )

cuda?
      ( dev-util/nvidia-cuda-toolkit:= )

flexiblas?
      ( sci-libs/flexiblas:= )

openblas?
      ( sci-libs/openblas:= )

openmp?
      ( llvm-runtimes/openmp:= )

openssl?
      ( dev-libs/openssl:= )

rocm?
      ( >=dev-util/hip-6.3:= >=sci-libs/hipBLAS-6.3:=[amdgpu_targets_gfx908
            (-)
      ?
,amdgpu_targets_gfx90a
            (-)
      ?
,amdgpu_targets_gfx942
            (-)
      ?
,amdgpu_targets_gfx1030
            (-)
      ?
,amdgpu_targets_gfx1100
            (-)
      ?
,amdgpu_targets_gfx1101
            (-)
      ?
,amdgpu_targets_gfx1200
            (-)
      ?
,amdgpu_targets_gfx1201
            (-)
      ?
,amdgpu_targets_gfx803
            (-)
      ?
,amdgpu_targets_gfx900
            (-)
      ?
,amdgpu_targets_gfx906
            (-)
      ?
,amdgpu_targets_gfx940
            (-)
      ?
,amdgpu_targets_gfx941
            (-)
      ?
,amdgpu_targets_gfx1010
            (-)
      ?
,amdgpu_targets_gfx1011
            (-)
      ?
,amdgpu_targets_gfx1012
            (-)
      ?
,amdgpu_targets_gfx1031
            (-)
      ?
,amdgpu_targets_gfx1102
            (-)
      ?
,amdgpu_targets_gfx1103
            (-)
      ?
,amdgpu_targets_gfx1150
            (-)
      ?
,amdgpu_targets_gfx1151
            (-)
      ?
] wmma?
            ( >=sci-libs/rocWMMA-6.3:=[amdgpu_targets_gfx908
                  (-)
            ?
,amdgpu_targets_gfx90a
                  (-)
            ?
,amdgpu_targets_gfx942
                  (-)
            ?
,amdgpu_targets_gfx1030
                  (-)
            ?
,amdgpu_targets_gfx1100
                  (-)
            ?
,amdgpu_targets_gfx1101
                  (-)
            ?
,amdgpu_targets_gfx1200
                  (-)
            ?
,amdgpu_targets_gfx1201
                  (-)
            ?
,amdgpu_targets_gfx803
                  (-)
            ?
,amdgpu_targets_gfx900
                  (-)
            ?
,amdgpu_targets_gfx906
                  (-)
            ?
,amdgpu_targets_gfx940
                  (-)
            ?
,amdgpu_targets_gfx941
                  (-)
            ?
,amdgpu_targets_gfx1010
                  (-)
            ?
,amdgpu_targets_gfx1011
                  (-)
            ?
,amdgpu_targets_gfx1012
                  (-)
            ?
,amdgpu_targets_gfx1031
                  (-)
            ?
,amdgpu_targets_gfx1102
                  (-)
            ?
,amdgpu_targets_gfx1103
                  (-)
            ?
,amdgpu_targets_gfx1150
                  (-)
            ?
,amdgpu_targets_gfx1151
                  (-)
            ?
] )
       )

opencl?
      ( dev-libs/opencl-icd-loader )

vulkan?
      ( media-libs/vulkan-loader )

llama-cpp-9999

curl?
      ( net-misc/curl:= )

openblas?
      ( sci-libs/openblas:= )

openmp?
      ( llvm-runtimes/openmp:= )

blis?
      ( sci-libs/blis:= )

flexiblas?
      ( sci-libs/flexiblas:= )

rocm?
      ( >=dev-util/hip-6.3:= >=sci-libs/hipBLAS-6.3:= wmma?
            ( >=sci-libs/rocWMMA-6.3:= )
       )

cuda?
      ( dev-util/nvidia-cuda-toolkit:= )

openssl?
      ( dev-libs/openssl:= )

dev-python/numpy

opencl?
      ( dev-libs/opencl-icd-loader )

vulkan?
      ( media-libs/vulkan-loader )

llama-cpp-9999

curl?
      ( net-misc/curl:= )

openblas?
      ( sci-libs/openblas:= )

openmp?
      ( llvm-runtimes/openmp:= )

blis?
      ( sci-libs/blis:= )

hip?
      ( >=dev-util/hip-6.3:= >=sci-libs/hipBLAS-6.3:= )

cuda?
      ( dev-util/nvidia-cuda-toolkit:= )

dev-python/numpy

opencl?
      ( dev-libs/opencl-icd-loader )

vulkan?
      ( media-libs/vulkan-loader )

llama-cpp-9999

openblas?
      ( sci-libs/openblas:= )

openmp?
      ( llvm-runtimes/openmp:= )

blis?
      ( sci-libs/blis:= )

flexiblas?
      ( sci-libs/flexiblas:= )

rocm?
      ( >=dev-util/hip-7.0:= >=sci-libs/hipBLAS-7.0:= wmma?
            ( >=sci-libs/rocWMMA-7.0:= )
       )

cuda?
      ( dev-util/nvidia-cuda-toolkit:= )

sycl?
      ( sci-libs/mkl:= )

openssl?
      ( dev-libs/openssl:= )

dev-python/numpy

opencl?
      ( dev-libs/opencl-icd-loader )

vulkan?
      ( media-libs/vulkan-loader )

llama-cpp-0_pre9413

llama-cpp-0_pre9404

llama-cpp-0_pre9284

llama-cpp-0_pre8838

llama-cpp-0_pre8628

curl?
      ( net-misc/curl:= )

openblas?
      ( sci-libs/openblas:= )

openmp?
      ( llvm-runtimes/openmp:= )

blis?
      ( sci-libs/blis:= )

flexiblas?
      ( sci-libs/flexiblas:= )

rocm?
      ( >=dev-util/hip-6.3:= >=sci-libs/hipBLAS-6.3:= wmma?
            ( >=sci-libs/rocWMMA-6.3:= )
       )

cuda?
      ( dev-util/nvidia-cuda-toolkit:= )

dev-python/numpy

opencl?
      ( dev-libs/opencl-icd-loader )

vulkan?
      ( media-libs/vulkan-loader )

llama-cpp-0_pre8198

curl?
      ( net-misc/curl:= )

openblas?
      ( sci-libs/openblas:= )

openmp?
      ( llvm-runtimes/openmp:= )

blis?
      ( sci-libs/blis:= )

flexiblas?
      ( sci-libs/flexiblas:= )

rocm?
      ( >=dev-util/hip-6.3:= >=sci-libs/hipBLAS-6.3:= wmma?
            ( >=sci-libs/rocWMMA-6.3:= )
       )

cuda?
      ( dev-util/nvidia-cuda-toolkit:= )

dev-python/numpy

opencl?
      ( dev-libs/opencl-icd-loader )

vulkan?
      ( media-libs/vulkan-loader )

llama-cpp-0_pre7924

curl?
      ( net-misc/curl:= )

openblas?
      ( sci-libs/openblas:= )

openmp?
      ( llvm-runtimes/openmp:= )

blis?
      ( sci-libs/blis:= )

flexiblas?
      ( sci-libs/flexiblas:= )

rocm?
      ( >=dev-util/hip-6.3:= >=sci-libs/hipBLAS-6.3:= wmma?
            ( >=sci-libs/rocWMMA-6.3:= )
       )

cuda?
      ( dev-util/nvidia-cuda-toolkit:= )

dev-python/numpy

opencl?
      ( dev-libs/opencl-icd-loader )

vulkan?
      ( media-libs/vulkan-loader )

llama-cpp-0_pre7611

curl?
      ( net-misc/curl:= )

openblas?
      ( sci-libs/openblas:= )

openmp?
      ( llvm-runtimes/openmp:= )

blis?
      ( sci-libs/blis:= )

flexiblas?
      ( sci-libs/flexiblas:= )

hip?
      ( >=dev-util/hip-6.3:= >=sci-libs/hipBLAS-6.3:= )

cuda?
      ( dev-util/nvidia-cuda-toolkit:= )

dev-python/numpy

opencl?
      ( dev-libs/opencl-icd-loader )

vulkan?
      ( media-libs/vulkan-loader )

llama-cpp-0_pre7276

curl?
      ( net-misc/curl:= )

openblas?
      ( sci-libs/openblas:= )

openmp?
      ( llvm-runtimes/openmp:= )

blis?
      ( sci-libs/blis:= )

flexiblas?
      ( sci-libs/flexiblas:= )

hip?
      ( >=dev-util/hip-6.3:= >=sci-libs/hipBLAS-6.3:= )

cuda?
      ( dev-util/nvidia-cuda-toolkit:= )

dev-python/numpy

opencl?
      ( dev-libs/opencl-icd-loader )

vulkan?
      ( media-libs/vulkan-loader )

llama-cpp-0_pre6980

curl?
      ( net-misc/curl:= )

openblas?
      ( sci-libs/openblas:= )

openmp?
      ( llvm-runtimes/openmp:= )

blis?
      ( sci-libs/blis:= )

flexiblas?
      ( sci-libs/flexiblas:= )

hip?
      ( >=dev-util/hip-6.3:= >=sci-libs/hipBLAS-6.3:= )

cuda?
      ( dev-util/nvidia-cuda-toolkit:= )

dev-python/numpy

opencl?
      ( dev-libs/opencl-icd-loader )

vulkan?
      ( media-libs/vulkan-loader )