gpo.zugaina.org

Search Portage & Overlays:

sci-misc/llama-swap

Reliable LLM model swapping proxy for llama.cpp / vllm / etc.

Screenshots

  • llama-swap-262
    ~amd64 ~arm ~arm64
    openrc systemd ui

    View      Download      Browse     License: MIT Apache-2.0 BSD BSD-2 ISC   
    Overlay: stuff
  • llama-swap-261
    ~amd64 ~arm ~arm64
    openrc systemd ui

    View      Download      Browse     License: MIT Apache-2.0 BSD BSD-2 ISC   
    Overlay: stuff
  • llama-swap-260
    ~amd64 ~arm ~arm64
    openrc systemd ui

    View      Download      Browse     License: MIT Apache-2.0 BSD BSD-2 ISC   
    Overlay: stuff