sci-ml/exllamav2
Inference library for running local LLMs on consumer hardware.
Screenshots
-
exllamav2-0.3.2~amd64python_single_target_python3_11 python_single_target_python3_12 python_single_target_python3_13 debug
View 
Download 
Browse License: MIT Overlay: tatsh-overlay
ChangeLog
commit 9b99ef198fc78a4ac649a28a389331d972dabf9b
Author: Andrew Udvare <audvare@gmail.com>
Date: Mon Oct 20 02:53:55 2025 -0400
sci-ml/exllamav2: new package, add 0.3.2
Signed-off-by: Andrew Udvare <audvare@gmail.com>
Author: Andrew Udvare <audvare@gmail.com>
Date: Mon Oct 20 02:53:55 2025 -0400
sci-ml/exllamav2: new package, add 0.3.2
Signed-off-by: Andrew Udvare <audvare@gmail.com>