sci-misc/llama-cpp
Port of Facebook's LLaMA model in C/C++, with its web UI
Screenshots
-
llama-cpp-9999curl openblas +openmp blis hip cuda opencl vulkan xdna +amdgpu_targets_gfx942 +amdgpu_targets_gfx1010 +amdgpu_targets_gfx1011 +amdgpu_targets_gfx1012 +amdgpu_targets_gfx1030 +amdgpu_targets_gfx1031 +amdgpu_targets_gfx1032 +amdgpu_targets_gfx1033 +amdgpu_targets_gfx1034 +amdgpu_targets_gfx1035 +amdgpu_targets_gfx1036 +amdgpu_targets_gfx1100 +amdgpu_targets_gfx1101 +amdgpu_targets_gfx1102 +amdgpu_targets_gfx1103 +amdgpu_targets_gfx1150 +amdgpu_targets_gfx1151 +amdgpu_targets_gfx1152 +amdgpu_targets_gfx1200 +amdgpu_targets_gfx1201 amdgpu_targets_gfx803 amdgpu_targets_gfx900 amdgpu_targets_gfx906 amdgpu_targets_gfx908 amdgpu_targets_gfx90a amdgpu_targets_gfx90c amdgpu_targets_gfx950 amdgpu_targets_gfx1153 amdgpu_targets_gfx1250
View 
Download 
Browse License: MIT 0BSD Apache-2.0 BSD BSD-2 CC0-1.0 ISC MIT MPL-2.0 Unlicense Overlay: FireBurn -
llama-cpp-0.6.0~amd64curl openblas +openmp blis hip cuda opencl vulkan xdna +amdgpu_targets_gfx942 +amdgpu_targets_gfx1010 +amdgpu_targets_gfx1011 +amdgpu_targets_gfx1012 +amdgpu_targets_gfx1030 +amdgpu_targets_gfx1031 +amdgpu_targets_gfx1032 +amdgpu_targets_gfx1033 +amdgpu_targets_gfx1034 +amdgpu_targets_gfx1035 +amdgpu_targets_gfx1036 +amdgpu_targets_gfx1100 +amdgpu_targets_gfx1101 +amdgpu_targets_gfx1102 +amdgpu_targets_gfx1103 +amdgpu_targets_gfx1150 +amdgpu_targets_gfx1151 +amdgpu_targets_gfx1152 +amdgpu_targets_gfx1200 +amdgpu_targets_gfx1201 amdgpu_targets_gfx803 amdgpu_targets_gfx900 amdgpu_targets_gfx906 amdgpu_targets_gfx908 amdgpu_targets_gfx90a amdgpu_targets_gfx90c amdgpu_targets_gfx950 amdgpu_targets_gfx1153 amdgpu_targets_gfx1250
View Download Browse License: MIT 0BSD Apache-2.0 BSD BSD-2 CC0-1.0 ISC MIT MPL-2.0 Unlicense Overlay: FireBurn