gpo.zugaina.org

Search Portage & Overlays:

sci-misc/llama-swap

Reliable LLM model swapping proxy for llama.cpp / vllm / etc.

Screenshots

  • llama-swap-265
    ~amd64 ~arm ~arm64
    openrc systemd ui

    View      Download      Browse     License: MIT Apache-2.0 BSD BSD-2 ISC   
    Overlay: stuff
  • llama-swap-264
    ~amd64 ~arm ~arm64
    openrc systemd ui

    View      Download      Browse     License: MIT Apache-2.0 BSD BSD-2 ISC   
    Overlay: stuff
  • llama-swap-263
    ~amd64 ~arm ~arm64
    openrc systemd ui

    View      Download      Browse     License: MIT Apache-2.0 BSD BSD-2 ISC   
    Overlay: stuff