sci-misc/koboldcpp
All-in-one local AI server (LLM, image, speech, TTS) on ggml/llama.cpp
Screenshots
View
Download
BrowseChangeLog
commit 2eaace015aad6bc267e4ce91f830a5e5fadb1ef2
Author: Ivan S. Titov <iohann.s.titov@gmail.com>
Date: Mon Aug 17 23:24:28 2026 +0200
sci-misc/koboldcpp: drop 1.118
commit 517883703e95112807dcae1d593a17158ae759d2
Author: Ivan S. Titov <iohann.s.titov@gmail.com>
Date: Mon Aug 17 23:24:28 2026 +0200
sci-misc/koboldcpp: add 1.119
commit cb76285ae9a8a3d60be3b3cd77bace43ba54b891
Author: Ivan S. Titov <iohann.s.titov@gmail.com>
Date: Sun Aug 2 12:27:36 2026 +0200
sci-misc/koboldcpp: drop 1.117.1
commit 3a2b35a8f8bd0d567e43d429c22b33fd7ef4fd35
Author: Ivan S. Titov <iohann.s.titov@gmail.com>
Date: Sun Aug 2 12:27:20 2026 +0200
sci-misc/koboldcpp: add 1.118.1
commit 91026f4dd64fcbde73e42762db6cda69e5acd7ab
Author: Ivan S. Titov <iohann.s.titov@gmail.com>
Date: Sat Aug 1 23:07:34 2026 +0200
sci-misc/koboldcpp: drop 1.116.1
Superseded; retention keeps the last two releases (1.117.1, 1.118).
commit ea3427698bc072fba4b676944be73950d6545cc7
Author: Ivan S. Titov <iohann.s.titov@gmail.com>
Date: Sat Aug 1 23:07:28 2026 +0200
sci-misc/koboldcpp: add 1.118
The Makefile build interface is unchanged from 1.117.1 (the -DNDEBUG -s
strip sed and the bundled-glslc removal both still apply) and the launcher
carries no third-party Python runtime deps, so the ebuild is copied
verbatim.
commit d26e488d095396a8343a1053601f18f59982a8df
Author: Ivan S. Titov <iohann.s.titov@gmail.com>
Date: Mon Jul 27 10:04:12 2026 +0200
*/*: drop dead Python targets from PYTHON_COMPAT
139 ebuilds across 65 packages still listed python3_10, python3_11 or
python3_13t. None of the three is a supported implementation any more:
gentoo's python-utils-r1 sets _PYTHON_ALL_IMPLS to python3_ plus
python3_t, and everything older falls into the branch commented
"implementations deprecated prior to EAPI 9 are fatal".
Inert today, which is why nothing caught it. Targets outside
_PYTHON_ALL_IMPLS are silently dropped rather than rejected, so they
never became USE flags and never produced a dependency atom -- an ebuild
declaring python3_ was only ever offering 12, 13 and 14.
Two reasons to clean them up anyway. The eclass branch they land in
dies for any EAPI other than 7 or 8, so all 139 are waiting to break on
the first EAPI 9 bump. And pkgcheck's OldPythonCompat is a git-scoped
check that only inspects ebuilds touched in a commit range, so it never
reports these on a full-tree scan and would instead fire on whichever
unrelated commit next touches one of them.
No revbump, because nothing observable changes. Verified on a sample
spanning every transformation shape that the python USE flags portage
offers are byte-identical before and after, and that a pkgcheck run
over all 65 packages returns a set-identical list of findings.
The eight python2_7 ebuilds are deliberately untouched: that target is
also absent from _PYTHON_ALL_IMPLS, but they reach it through the
_PYTHON_ALLOW_PY27 hatch in the overlay's forked python-utils-r1_py2.
commit 0ea4bf02868534a53d6e24f684529d59208f8eb7
Author: Ivan S. Titov <iohann.s.titov@gmail.com>
Date: Fri Jul 10 22:54:41 2026 +0200
sci-misc/koboldcpp: drop 1.117
commit 3275ff6d8959092a7865a79391b5ff8563c19cd5
Author: Ivan S. Titov <iohann.s.titov@gmail.com>
Date: Fri Jul 10 22:52:50 2026 +0200
sci-misc/koboldcpp: add 1.117.1
commit dd92dbbf146f61c83abc99580e261895dd7142c1
Author: Ivan S. Titov <iohann.s.titov@gmail.com>
Date: Fri Jul 10 15:24:51 2026 +0200
sci-misc/koboldcpp: add 1.117
commit 7f5741cf5ac46ac8a8b76539f7711aef7d274b21
Author: Ivan S. Titov <iohann.s.titov@gmail.com>
Date: Sat Jul 4 12:59:33 2026 +0200
sci-misc/koboldcpp: new package, add 1.116.1
All-in-one local AI server (LLM + Stable Diffusion + Whisper + TTS) built on
ggml/llama.cpp. Builds the ggml backends from the vendored source and installs
the pure-stdlib launcher (koboldcpp.py) with the embedded KoboldAI Lite web UI
and resources. The upstream PyInstaller blob and the bundled prebuilt glslc are
not used (Vulkan shaders build with the system media-libs/shaderc), and no
model weights are shipped.
USE=vulkan is upstream's official GPU path for both AMD and NVIDIA, and is
build-verified here (CPU + Vulkan). CUDA and ROCm are intentionally omitted for
now: CUDA cannot be verified on this host, and koboldcpp's ROCm support is an
unofficial upstream fork whose Makefile GPU_TARGETS handling needs work. Both
are follow-ups.
Author: Ivan S. Titov <iohann.s.titov@gmail.com>
Date: Mon Aug 17 23:24:28 2026 +0200
sci-misc/koboldcpp: drop 1.118
commit 517883703e95112807dcae1d593a17158ae759d2
Author: Ivan S. Titov <iohann.s.titov@gmail.com>
Date: Mon Aug 17 23:24:28 2026 +0200
sci-misc/koboldcpp: add 1.119
commit cb76285ae9a8a3d60be3b3cd77bace43ba54b891
Author: Ivan S. Titov <iohann.s.titov@gmail.com>
Date: Sun Aug 2 12:27:36 2026 +0200
sci-misc/koboldcpp: drop 1.117.1
commit 3a2b35a8f8bd0d567e43d429c22b33fd7ef4fd35
Author: Ivan S. Titov <iohann.s.titov@gmail.com>
Date: Sun Aug 2 12:27:20 2026 +0200
sci-misc/koboldcpp: add 1.118.1
commit 91026f4dd64fcbde73e42762db6cda69e5acd7ab
Author: Ivan S. Titov <iohann.s.titov@gmail.com>
Date: Sat Aug 1 23:07:34 2026 +0200
sci-misc/koboldcpp: drop 1.116.1
Superseded; retention keeps the last two releases (1.117.1, 1.118).
commit ea3427698bc072fba4b676944be73950d6545cc7
Author: Ivan S. Titov <iohann.s.titov@gmail.com>
Date: Sat Aug 1 23:07:28 2026 +0200
sci-misc/koboldcpp: add 1.118
The Makefile build interface is unchanged from 1.117.1 (the -DNDEBUG -s
strip sed and the bundled-glslc removal both still apply) and the launcher
carries no third-party Python runtime deps, so the ebuild is copied
verbatim.
commit d26e488d095396a8343a1053601f18f59982a8df
Author: Ivan S. Titov <iohann.s.titov@gmail.com>
Date: Mon Jul 27 10:04:12 2026 +0200
*/*: drop dead Python targets from PYTHON_COMPAT
139 ebuilds across 65 packages still listed python3_10, python3_11 or
python3_13t. None of the three is a supported implementation any more:
gentoo's python-utils-r1 sets _PYTHON_ALL_IMPLS to python3_ plus
python3_t, and everything older falls into the branch commented
"implementations deprecated prior to EAPI 9 are fatal".
Inert today, which is why nothing caught it. Targets outside
_PYTHON_ALL_IMPLS are silently dropped rather than rejected, so they
never became USE flags and never produced a dependency atom -- an ebuild
declaring python3_ was only ever offering 12, 13 and 14.
Two reasons to clean them up anyway. The eclass branch they land in
dies for any EAPI other than 7 or 8, so all 139 are waiting to break on
the first EAPI 9 bump. And pkgcheck's OldPythonCompat is a git-scoped
check that only inspects ebuilds touched in a commit range, so it never
reports these on a full-tree scan and would instead fire on whichever
unrelated commit next touches one of them.
No revbump, because nothing observable changes. Verified on a sample
spanning every transformation shape that the python USE flags portage
offers are byte-identical before and after, and that a pkgcheck run
over all 65 packages returns a set-identical list of findings.
The eight python2_7 ebuilds are deliberately untouched: that target is
also absent from _PYTHON_ALL_IMPLS, but they reach it through the
_PYTHON_ALLOW_PY27 hatch in the overlay's forked python-utils-r1_py2.
commit 0ea4bf02868534a53d6e24f684529d59208f8eb7
Author: Ivan S. Titov <iohann.s.titov@gmail.com>
Date: Fri Jul 10 22:54:41 2026 +0200
sci-misc/koboldcpp: drop 1.117
commit 3275ff6d8959092a7865a79391b5ff8563c19cd5
Author: Ivan S. Titov <iohann.s.titov@gmail.com>
Date: Fri Jul 10 22:52:50 2026 +0200
sci-misc/koboldcpp: add 1.117.1
commit dd92dbbf146f61c83abc99580e261895dd7142c1
Author: Ivan S. Titov <iohann.s.titov@gmail.com>
Date: Fri Jul 10 15:24:51 2026 +0200
sci-misc/koboldcpp: add 1.117
commit 7f5741cf5ac46ac8a8b76539f7711aef7d274b21
Author: Ivan S. Titov <iohann.s.titov@gmail.com>
Date: Sat Jul 4 12:59:33 2026 +0200
sci-misc/koboldcpp: new package, add 1.116.1
All-in-one local AI server (LLM + Stable Diffusion + Whisper + TTS) built on
ggml/llama.cpp. Builds the ggml backends from the vendored source and installs
the pure-stdlib launcher (koboldcpp.py) with the embedded KoboldAI Lite web UI
and resources. The upstream PyInstaller blob and the bundled prebuilt glslc are
not used (Vulkan shaders build with the system media-libs/shaderc), and no
model weights are shipped.
USE=vulkan is upstream's official GPU path for both AMD and NVIDIA, and is
build-verified here (CPU + Vulkan). CUDA and ROCm are intentionally omitted for
now: CUDA cannot be verified on this host, and koboldcpp's ROCm support is an
unofficial upstream fork whose Makefile GPU_TARGETS handling needs work. Both
are follow-ups.