gpo.zugaina.org

Search Portage & Overlays:

app-local-ai/vllm-cpp

LocalAI text-generation backend (vllm.cpp gRPC server)

Screenshots

  • vllm-cpp-4.9.0
    ~amd64
    vulkan video_cards_amdgpu

    View      Download      Browse     License: Apache-2.0 MIT   
    Overlay: local-ai