sci-misc/kvmem-llama-cpp
CUDA llama.cpp runtime with tiered KV memory for long contexts
Screenshots
-
kvmem-llama-cpp-0.17.0~amd64cpu_flags_x86_avx cpu_flags_x86_avx2 cpu_flags_x86_bmi2 cpu_flags_x86_f16c cpu_flags_x86_fma3 cpu_flags_x86_sse4_2 +openmp test
View 
Download 
Browse License: Apache-2.0 MIT Overlay: ruizhi-overlay
Reverse Dependencies
Reverse dependancies are sometimes conditional based on your USE flags, Ebuild version and sometimes other packages. please keep this in mind.