gpo.zugaina.org

Search Portage & Overlays:

sci-ml/llama-swap

Transparent model-swapping proxy for llama.cpp, vLLM and other OpenAI-compatible servers

Screenshots

  • llama-swap-250-r1
    ~amd64 ~arm64
    systemd ui

    View      Download      Browse     License: MIT Apache-2.0 BSD BSD-2 ISC   
    Overlay: bentoo

USE Flags

systemd
* This flag is undocumented *
ui
Global: Build the user interface (could be gtk or ncurses based, depending on sdl, dga, svga and aalib USE flags)