www-apps/tabbyapi
An OAI compatible exllamav2 API that's both lightweight and fast.
Screenshots
-
tabbyapi-20251017~amd64standalone python_single_target_python3_11 python_single_target_python3_12 python_single_target_python3_13
View 
Download 
Browse License: AGPL-3 Overlay: tatsh-overlay