sci-ml/exllamav3
Inference library for running local LLMs on consumer hardware
Screenshots
-
exllamav3-1.6.1~amd64python_single_target_python3_12 python_single_target_python3_13 python_single_target_python3_14 python_single_target_python3_15 debug
View 
Download 
Browse License: MIT Overlay: tatsh-overlay