gpo.zugaina.org

Search Portage & Overlays:

app-local-ai/vllm-cpp

LocalAI text-generation backend (vllm.cpp gRPC server)

Screenshots

  • vllm-cpp-4.9.0
    ~amd64
    vulkan video_cards_amdgpu

    View      Download      Browse     License: Apache-2.0 MIT   
    Overlay: local-ai

Runtime Dependencies

vllm-cpp-4.9.0

sci-ml/local-ai

vulkan?
      ( media-libs/vulkan-loader video_cards_amdgpu?
            ( media-libs/mesa[vulkan,video_cards_radeonsi] )
       )