sci-ml/exllamav3
Inference library for running local LLMs on consumer hardware.
Screenshots
-
exllamav3-0.0.12~amd64python_single_target_python3_11 python_single_target_python3_12 python_single_target_python3_13 debug
View 
Download 
Browse License: MIT Overlay: tatsh-overlay