Gentoo Portage Overlays - sci-ml/exllamav2

sci-ml/exllamav2

Inference library for running local LLMs on consumer hardware.

Screenshots

https://github.com/turboderp/exllamav2

exllamav2-0.3.2

~amd64

python_single_target_python3_11 python_single_target_python3_12 python_single_target_python3_13 debug

View

Download

Browse License: MIT

Overlay: tatsh-overlay

ChangeLog USE Flags Dependencies Reverse Deps Related Bugs

Bugs

Bug #	Severity	Platform	Status	Description

These bugs were grabbed from http://bugs.gentoo.org and have only passed a preliminary search using the package title, to do a more through search please visit: http://bugs.gentoo.org.