www-apps/tabbyapi
An OAI compatible exllamav3 API that's both lightweight and fast
Screenshots
-
tabbyapi-202610113~amd64standalone python_single_target_python3_12 python_single_target_python3_13 python_single_target_python3_14 python_single_target_python3_15
View 
Download 
Browse License: AGPL-3 Overlay: tatsh-overlay