Gentoo Portage Overlays - app-local-ai/vllm-cpp

Newest News Repository news GLSAs Browse USE Flags Overlays More...

app-local-ai/vllm-cpp

LocalAI text-generation backend (vllm.cpp gRPC server)

Screenshots

vllm-cpp-4.9.0

~amd64

vulkan video_cards_amdgpu

View

Download

Browse License: Apache-2.0 MIT

Overlay: local-ai

ChangeLog USE Flags Dependencies Reverse Deps Related Bugs

USE Flags

vulkan

* This flag is undocumented *

video_cards_amdgpu

* This flag is undocumented *