sci-misc/kvmem-llama-cpp
CUDA llama.cpp runtime with tiered KV memory for long contexts
Screenshots
-
kvmem-llama-cpp-0.17.0~amd64cpu_flags_x86_avx cpu_flags_x86_avx2 cpu_flags_x86_bmi2 cpu_flags_x86_f16c cpu_flags_x86_fma3 cpu_flags_x86_sse4_2 +openmp test
View 
Download 
Browse License: Apache-2.0 MIT Overlay: ruizhi-overlay
ChangeLog
commit 5baa56dd637d5154562500902e54515598b2acf8
Author: user.email <ruizhi.zhong@outlook.com>
Date: Fri Oct 2 00:23:38 2026 +0800
sci-misc/kvmem-llama-cpp: add CUDA runtime 0.17.0
Author: user.email <ruizhi.zhong@outlook.com>
Date: Fri Oct 2 00:23:38 2026 +0800
sci-misc/kvmem-llama-cpp: add CUDA runtime 0.17.0