gpo.zugaina.org

Search Portage & Overlays:

sci-ml/llama-swap

Model-swapping proxy for llama.cpp, vLLM and OpenAI-compatible servers

Screenshots

  • llama-swap-255
    ~amd64 ~arm64
    systemd ui

    View      Download      Browse     License: MIT Apache-2.0 BSD BSD-2 ISC   
    Overlay: bentoo