Gentoo Portage Overlays - app-local-ai/vllm-cpp

app-local-ai/vllm-cpp

LocalAI text-generation backend (vllm.cpp gRPC server)

Screenshots

https://localai.io
https://github.com/mudler/LocalAI

vllm-cpp-4.9.0

~amd64

vulkan video_cards_amdgpu

View

Download

Browse License: Apache-2.0 MIT

Overlay: local-ai

ChangeLog USE Flags Dependencies Reverse Deps Related Bugs

ChangeLog

commit 6991e372d91b7de82a24fa4cd595d2654e69d223
Author: Plamen K. Kosseff <plamen@ipnmod.org>
Date: Mon Sep 7 08:37:21 2026 +0000

app-local-ai/vllm-cpp: extend the array-bounds -Werror demotion to gcc 15

Assisted-by: Claude:claude-fable-5
Signed-off-by: Plamen K. Kosseff <plamen@ipnmod.org>

commit 51cdc7c43ab90b0d6620cfa07b520cf9acae0c30
Author: Plamen K. Kosseff <plamen@ipnmod.org>
Date: Mon Sep 7 08:22:43 2026 +0000

app-local-ai/vllm-cpp: new backend, first non-ggml engine

Assisted-by: Claude:claude-fable-5
Signed-off-by: Plamen K. Kosseff <plamen@ipnmod.org>