www-apps/tabbyapi
An OAI compatible exllamav3 API that's both lightweight and fast.
Screenshots
-
tabbyapi-202607313~amd64standalone python_single_target_python3_12 python_single_target_python3_13 python_single_target_python3_14
View 
Download 
Browse License: AGPL-3 Overlay: tatsh-overlay