Gentoo Portage Overlays - sci-ml/llama-swap

Newest News Repository news GLSAs Browse USE Flags Overlays More...

sci-ml/llama-swap

Transparent model-swapping proxy for llama.cpp, vLLM and other OpenAI-compatible servers

Screenshots

https://github.com/mostlygeek/llama-swap

llama-swap-250-r1

~amd64 ~arm64

systemd ui

View

Download

Browse License: MIT Apache-2.0 BSD BSD-2 ISC

Overlay: bentoo

ChangeLog USE Flags Dependencies Reverse Deps Related Bugs

Runtime Dependencies

llama-swap-250-r1