sci-ml/exllamav2
Inference library for running local LLMs on consumer hardware.
Screenshots
-
exllamav2-0.3.2~amd64python_single_target_python3_11 python_single_target_python3_12 python_single_target_python3_13 debug
View 
Download 
Browse License: MIT Overlay: tatsh-overlay