gpo.zugaina.org

Search Portage & Overlays:

sci-ml/llama-cpp

LLM inference in C/C++

Screenshots

  • llama-cpp-9999
    openblas +openmp blis rocm cuda opencl vulkan flexiblas wmma examples rpc +server cpu_flags_x86_sse4_2 cpu_flags_x86_avx cpu_flags_x86_avx_vnni cpu_flags_x86_avx2 cpu_flags_x86_bmi2 cpu_flags_x86_avx512f cpu_flags_x86_avx512cd cpu_flags_x86_avx512vl cpu_flags_x86_avx512dq cpu_flags_x86_avx512bw cpu_flags_x86_avx512vbmi cpu_flags_x86_avx512_vnni cpu_flags_x86_avx512_bf16 cpu_flags_x86_fma3 cpu_flags_x86_f16c cpu_flags_x86_amx_tile cpu_flags_x86_amx_int8 cpu_flags_x86_amx_bf16 cpu_flags_riscv_v cpu_flags_riscv_zfh cpu_flags_riscv_zvfh cpu_flags_riscv_zicbop cpu_flags_riscv_zihintpause cpu_flags_riscv_xtheadvector +amdgpu_targets_gfx908 +amdgpu_targets_gfx90a +amdgpu_targets_gfx942 +amdgpu_targets_gfx1030 +amdgpu_targets_gfx1100 +amdgpu_targets_gfx1101 +amdgpu_targets_gfx1200 +amdgpu_targets_gfx1201 amdgpu_targets_gfx803 amdgpu_targets_gfx900 amdgpu_targets_gfx906 amdgpu_targets_gfx940 amdgpu_targets_gfx941 amdgpu_targets_gfx1010 amdgpu_targets_gfx1011 amdgpu_targets_gfx1012 amdgpu_targets_gfx1031 amdgpu_targets_gfx1102 amdgpu_targets_gfx1103 amdgpu_targets_gfx1150 amdgpu_targets_gfx1151

    View      Download      Browse     License: MIT   
    Overlay: gentoo-zh
  • llama-cpp-9999
    systemd utils static lto test examples disable-arm-neon dynamic-backends curl hbm android msvc +accelerate blas blis +llamafile cann musa cuda cuda-force-mmq cuda-force-cublas +cuda-unified-memory cuda-f16 cuda-no-peer-copy cuda-no-vmm cuda-fa-all-quants +cuda-graphs hip hip-graphs +hip-no-vmm hip-uma vulkan vulkan-check-results vulkan-debug vulkan-memory-debug vulkan-shader-debug-info vulkan-perf vulkan-validate vulkan-run-tests kompute +openmp rpc opencl opencl-profiling +opencl-embed-kernels +opencl-use-adreno-kernels metal metal-use-bf16 metal-ndebug metal-shader-debug +metal-embed-library +cpu webgpu cpu-native cpu-all-variants cpu_flags_x86_avx cpu_flags_x86_avx_vnni cpu_flags_x86_avx2 cpu_flags_x86_avx512 cpu_flags_x86_avx512_vbmi cpu_flags_x86_avx512_vnni cpu_flags_x86_avx512_bf16 cpu_flags_x86_fma cpu_flags_x86_f16c cpu_flags_x86_amx_tile cpu_flags_x86_amx_int8 cpu_flags_x86_amx_bf16 cpu_flags_x86_sse cpu_flags_x86_sse2 cpu_flags_x86_sse3 cpu_flags_x86_sse4 cpu_flags_x86_sse4a cpu_flags_x86_sse41 cpu_flags_x86_sse42 cpu_flags_x86_ssse3 kleidiai cpu_flags_loong_lasx cpu_flags_loong_lsx cpu_flags_riscv_rvv abi_x86_32 abi_x86_64 abi_x86_x32 abi_mips_n32 abi_mips_n64 abi_mips_o32 abi_s390_32 abi_s390_64 +amdgpu_targets_gfx908 +amdgpu_targets_gfx90a +amdgpu_targets_gfx942 +amdgpu_targets_gfx1030 +amdgpu_targets_gfx1100 +amdgpu_targets_gfx1101 +amdgpu_targets_gfx1200 +amdgpu_targets_gfx1201 amdgpu_targets_gfx803 amdgpu_targets_gfx900 amdgpu_targets_gfx906 amdgpu_targets_gfx940 amdgpu_targets_gfx941 amdgpu_targets_gfx1010 amdgpu_targets_gfx1011 amdgpu_targets_gfx1012 amdgpu_targets_gfx1031 amdgpu_targets_gfx1102 amdgpu_targets_gfx1103 amdgpu_targets_gfx1150 amdgpu_targets_gfx1151 python_single_target_python3_11 python_single_target_python3_12

    View      Download      Browse     License: MIT   
  • llama-cpp-0_pre8583
    ~amd64 ~riscv
    openblas +openmp blis rocm cuda opencl vulkan flexiblas wmma examples rpc +server cpu_flags_x86_sse4_2 cpu_flags_x86_avx cpu_flags_x86_avx_vnni cpu_flags_x86_avx2 cpu_flags_x86_bmi2 cpu_flags_x86_avx512f cpu_flags_x86_avx512cd cpu_flags_x86_avx512vl cpu_flags_x86_avx512dq cpu_flags_x86_avx512bw cpu_flags_x86_avx512vbmi cpu_flags_x86_avx512_vnni cpu_flags_x86_avx512_bf16 cpu_flags_x86_fma3 cpu_flags_x86_f16c cpu_flags_x86_amx_tile cpu_flags_x86_amx_int8 cpu_flags_x86_amx_bf16 cpu_flags_riscv_v cpu_flags_riscv_zfh cpu_flags_riscv_zvfh cpu_flags_riscv_zicbop cpu_flags_riscv_zihintpause cpu_flags_riscv_xtheadvector +amdgpu_targets_gfx908 +amdgpu_targets_gfx90a +amdgpu_targets_gfx942 +amdgpu_targets_gfx1030 +amdgpu_targets_gfx1100 +amdgpu_targets_gfx1101 +amdgpu_targets_gfx1200 +amdgpu_targets_gfx1201 amdgpu_targets_gfx803 amdgpu_targets_gfx900 amdgpu_targets_gfx906 amdgpu_targets_gfx940 amdgpu_targets_gfx941 amdgpu_targets_gfx1010 amdgpu_targets_gfx1011 amdgpu_targets_gfx1012 amdgpu_targets_gfx1031 amdgpu_targets_gfx1102 amdgpu_targets_gfx1103 amdgpu_targets_gfx1150 amdgpu_targets_gfx1151

    View      Download      Browse     License: MIT   
    Overlay: gentoo-zh
  • llama-cpp-0.6644
    ~amd64
    +curl +server +amdgpu_targets_gfx908 +amdgpu_targets_gfx90a +amdgpu_targets_gfx942 +amdgpu_targets_gfx1030 +amdgpu_targets_gfx1100 +amdgpu_targets_gfx1101 +amdgpu_targets_gfx1200 +amdgpu_targets_gfx1201 amdgpu_targets_gfx803 amdgpu_targets_gfx900 amdgpu_targets_gfx906 amdgpu_targets_gfx940 amdgpu_targets_gfx941 amdgpu_targets_gfx1010 amdgpu_targets_gfx1011 amdgpu_targets_gfx1012 amdgpu_targets_gfx1031 amdgpu_targets_gfx1102 amdgpu_targets_gfx1103 amdgpu_targets_gfx1150 amdgpu_targets_gfx1151

    View      Download      Browse     License: MIT   
    Overlay: phackerlay
  • llama-cpp-0.6335
    ~amd64 ~arm ~arm64 ~arm64-macos ~loong ~riscv ~x64-macos ~x86 ~x86-macos
    systemd utils static lto test examples disable-arm-neon dynamic-backends curl hbm android msvc +accelerate blas blis +llamafile cann musa cuda cuda-force-mmq cuda-force-cublas +cuda-unified-memory cuda-f16 cuda-no-peer-copy cuda-no-vmm cuda-fa-all-quants +cuda-graphs hip hip-graphs +hip-no-vmm hip-uma vulkan vulkan-check-results vulkan-debug vulkan-memory-debug vulkan-shader-debug-info vulkan-perf vulkan-validate vulkan-run-tests kompute +openmp rpc opencl opencl-profiling +opencl-embed-kernels +opencl-use-adreno-kernels metal metal-use-bf16 metal-ndebug metal-shader-debug +metal-embed-library +cpu webgpu cpu-native cpu-all-variants cpu_flags_x86_avx cpu_flags_x86_avx_vnni cpu_flags_x86_avx2 cpu_flags_x86_avx512 cpu_flags_x86_avx512_vbmi cpu_flags_x86_avx512_vnni cpu_flags_x86_avx512_bf16 cpu_flags_x86_fma cpu_flags_x86_f16c cpu_flags_x86_amx_tile cpu_flags_x86_amx_int8 cpu_flags_x86_amx_bf16 cpu_flags_x86_sse cpu_flags_x86_sse2 cpu_flags_x86_sse3 cpu_flags_x86_sse4 cpu_flags_x86_sse4a cpu_flags_x86_sse41 cpu_flags_x86_sse42 cpu_flags_x86_ssse3 kleidiai cpu_flags_loong_lasx cpu_flags_loong_lsx cpu_flags_riscv_rvv abi_x86_32 abi_x86_64 abi_x86_x32 abi_mips_n32 abi_mips_n64 abi_mips_o32 abi_s390_32 abi_s390_64 +amdgpu_targets_gfx908 +amdgpu_targets_gfx90a +amdgpu_targets_gfx942 +amdgpu_targets_gfx1030 +amdgpu_targets_gfx1100 +amdgpu_targets_gfx1101 +amdgpu_targets_gfx1200 +amdgpu_targets_gfx1201 amdgpu_targets_gfx803 amdgpu_targets_gfx900 amdgpu_targets_gfx906 amdgpu_targets_gfx940 amdgpu_targets_gfx941 amdgpu_targets_gfx1010 amdgpu_targets_gfx1011 amdgpu_targets_gfx1012 amdgpu_targets_gfx1031 amdgpu_targets_gfx1102 amdgpu_targets_gfx1103 amdgpu_targets_gfx1150 amdgpu_targets_gfx1151 python_single_target_python3_11 python_single_target_python3_12

    View      Download      Browse     License: MIT   

Runtime Dependencies

llama-cpp-9999

dev-libs/openssl

openmp?
      ( llvm-runtimes/openmp:= )

openblas?
      ( sci-libs/openblas:= )

blis?
      ( sci-libs/blis:= )

flexiblas?
      ( sci-libs/flexiblas:= )

rocm?
      ( >=dev-util/hip-6.3 >=sci-libs/hipBLAS-6.3 wmma?
            ( >=sci-libs/rocWMMA-6.3 )
       )

cuda?
      ( dev-util/nvidia-cuda-toolkit:= )

opencl?
      ( dev-libs/opencl-icd-loader )

vulkan?
      ( media-libs/vulkan-loader )

llama-cpp-9999

acct-user/genai
acct-group/genai

blas?
      ( virtual/blas )

cuda?
      ( dev-util/nvidia-cuda-toolkit )

blis?
      ( sci-libs/blis )

opencl?
      ( virtual/opencl )

llama-cpp-0_pre8583

dev-libs/openssl

openmp?
      ( llvm-runtimes/openmp:= )

openblas?
      ( sci-libs/openblas:= )

blis?
      ( sci-libs/blis:= )

flexiblas?
      ( sci-libs/flexiblas:= )

rocm?
      ( >=dev-util/hip-6.3 >=sci-libs/hipBLAS-6.3 wmma?
            ( >=sci-libs/rocWMMA-6.3 )
       )

cuda?
      ( dev-util/nvidia-cuda-toolkit:= )

opencl?
      ( dev-libs/opencl-icd-loader )

vulkan?
      ( media-libs/vulkan-loader )

llama-cpp-0.6644


curl?
      ( net-misc/curl:= )

dev-python/numpy

llama-cpp-0.6335

acct-user/genai
acct-group/genai

blas?
      ( virtual/blas )

cuda?
      ( dev-util/nvidia-cuda-toolkit )

blis?
      ( sci-libs/blis )

opencl?
      ( virtual/opencl )