sci-misc/prism-llama-cpp
PrismML llama.cpp fork with Bonsai low-bit model support
-
prism-llama-cpp-12128~amd64cuda curl openmp openssl vulkan
View
Download
Browse License: MIT Overlay: ruizhi-overlay -
prism-llama-cpp-9999-r1cuda curl openmp openssl vulkan
View
Download
Browse License: MIT Overlay: ruizhi-overlay
ChangeLog
commit ff40a925b41d0d8c868a227c9b81d0fec73160b6
Author: user.email <ruizhi.zhong@outlook.com>
Date: Sat Oct 31 20:56:48 2026 +0800
overlay: bump strata, datagrip, prism-llama-cpp and kvmem-llama-cpp
sci-ml/strata 0.2.9: the ggml pin in third_party/ggml/VERSION.txt is
unchanged, so LLAMA_COMMIT stays put. redact-portage-managed.patch is
re-derived against the new tarball; it applied with a nine-line offset and
now applies cleanly. requirements.txt and requirements-monitor.txt did not
change, and the terminal file set package_terminal.py stages is the same.
dev-util/datagrip 2026.2.6.1: straight version bump, every path the ebuild
sets permissions on still exists in the new tarball.
sci-misc/prism-llama-cpp 12128: upstream tag prism-b12128-d7b2896.
sci-misc/kvmem-llama-cpp 0.19.1:
- Upstream moved to kvmem/kvmem, so HOMEPAGE, the SRC_URI, metadata.xml
and the update checker follow.
- backends/versions.json now pins llama.cpp 620d222 and replaces the single
kvmem patch with an ordered five-patch series (kvmem, pq2, ptq1,
ptq1-performance, checkpoint-policy). scripts/prepare-backends.py needs the
submodule's git metadata to verify the series, which a tarball build does
not have, so the pinned tree is unpacked and the same series, in the same
order, is applied with eapply. All five apply with fuzz=0.
- KVMEM_ENABLE_NVME is gone: the NVMe store was retired upstream in favour
of the shared RAM/SSD tiers. Its build switch and its test target are
dropped; host_kv_storage_test and tiered_kv_storage_test cover the tiers
that replaced it.
- New backport: monitor_hardware.hpp includes <nvml.h>, whose one-argument
DEPRECATED(ver) clobbers llama.cpp's two-argument DEPRECATED(func, hint)
and breaks mtmd.h in llama-kvmem-server.cpp. The patch restores the
llama.cpp spelling after NVML is done with the name.
- README.gentoo: the old example passed --kvmem-gen-reserve 16384, which is
now documented as reusable generation workspace rather than an output cap.
It shows --kvmem-host-mib and the opt-in SSD pair instead.
Validated locally on amd64 with CUDA 13.4 and sm_120a: kvmem 0.19.1 builds
llama-kvmem-cli and llama-kvmem-server and its six model-free tests pass;
strata 0.2.9 builds its engine; prism 12128 configures. Manifest regenerated
with pkgdev manifest; pkgcheck reports no new findings.
commit 365b2d2e9f052c7704f7850242a75a5f3063a81c
Author: user.email <ruizhi.zhong@outlook.com>
Date: Fri Oct 30 20:37:37 2026 +0800
Bump packages reported by the update checker (#28)
Release bumps for the packages issue #28 reported:
app-text/quarto-bin 1.10.19 -> 1.10.20
sci-ml/strata 0.2.7.1 -> 0.2.8
sci-ml/torchaudio 2.11.0-r2 -> 2.11.1
sci-misc/prism-llama-cpp 10826 -> 10831
app-misc/chatgpt-desktop 26.1023.51421 -> 26.1027.30824
app-misc/claude-desktop 4.29.0 -> 4.4212.0
torchaudio 2.11.1 is a packaging and bug-fix release that still supports
PyTorch 2.11 and later, so the existing dependency and PYTHON_COMPAT stand.
Prism moves to prism-b10831-9d9efea. Strata keeps its pinned llama.cpp tree
(third_party/ggml/VERSION.txt is unchanged), and its terminal file set,
package_engine.py/stage_tuning.py interfaces and CMake options are unchanged,
so only the version moves; the Portage redaction patch still applies at fuzz=0.
The remaining two entries needed no ebuild change, but the checker was wrong:
* app-misc/bcompare already tracks 5.2.7.32913. The scooter lookup failed
because the site answers HTTP 500 to curl's default User-Agent; request the
page as a browser does.
* sci-misc/kvmem-llama-cpp stays at 0.18.0. kvmem publishes v0.19.0-rc1 with
the prerelease box unchecked, so get_latest_stable() returned a release
candidate. Filter the version string the way get_latest_tag() already does.
Also correct the launcher comment naming sci-misc/strata instead of sci-ml/strata.
commit 63d631dbc8b0439bda25639bfe769741159600bd
Author: Ruizhi Zhong <ruizhi.zhong@outlook.com>
Date: Mon Oct 26 23:00:11 2026 +0800
sci-misc/prism-llama-cpp: bump to 10826
Bump PrismML llama.cpp from prism-b10819-909f0ca to
prism-b10826-c9c34bc. The 10819..10826 range only changes CUDA kernels
and backend tests, with no CMake or build-flag changes, so the ebuild
only needs the new tag, commit, and distfile digest. Keep the live
prism-llama-cpp-9999-r1 ebuild.
ComfyUI 0.42.5 is still its latest tag and pins comfy-aimdo 0.5.6,
comfy-kitchen 0.2.39, and comfyui-frontend-package 1.55.18, so those
packages stay at the pinned versions reported by the update checker.
Closes #23
commit 5eda39e22a1b1146c6328bec081d49e6453b37ea
Author: user.email <ruizhi.zhong@outlook.com>
Date: Sun Oct 25 15:10:50 2026 +0800
overlay: bump packages from issue #22
Bump the packages reported in issue #22 that can follow their upstream
releases: media-fonts/sarasa-gothic 1.0.42 -> 1.0.43 and
sci-misc/prism-llama-cpp 10787 -> 10819 (prism-b10819-909f0ca). The
Sarasa distfile matches the SHA-256 digest GitHub publishes for the
release asset, and the Prism 10787..10819 range touches no CMake files,
so that ebuild only needs the new tag and commit. The live
prism-llama-cpp-9999-r1 ebuild is kept.
ComfyUI's asset packages keep the exact pins from its 0.42.5
requirements.txt, and 0.42.5 is still the latest ComfyUI tag. Only
ComfyUI master pins newer versions (comfy-aimdo 0.6.0, comfy-kitchen
0.2.40 and comfyui-frontend-package 1.57.1), so comfy-aimdo,
comfy-kitchen and comfyui-frontend-package stay at 0.5.6, 0.2.39 and
1.55.18 even though newer upstream releases exist. Master does not pin
the comfyui-frontend-package 1.57.3 that the update checker reports.
Closes #22
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
commit 8cac0625e7b9c448a60ef47ace36067faaf67455
Author: ruizhi <ruizhi.zhong@outlook.com>
Date: Wed Oct 21 19:49:42 2026 +0800
overlay: bump packages from issue #19
commit 1f5ea897923300998a4e63ccc3dd84f26b092645
Author: user.email <ruizhi.zhong@outlook.com>
Date: Mon Oct 19 00:24:45 2026 +0800
Update packages for October 2026 releases
commit 5c396a234aefcc27478a50ec7416d2e65edd61d2
Author: ruizhi <ruizhi.zhong@outlook.com>
Date: Wed Oct 14 19:17:15 2026 +0800
overlay: bump packages from update report
commit fa8e2c1b0c6fe44e7bd0a275f952c864f008e0d4
Author: user.email <ruizhi.zhong@outlook.com>
Date: Mon Oct 5 16:46:35 2026 +0800
Bump ChatGPT Desktop and Prism llama.cpp
commit 87da77f6c9e725eb75c1856375675b1e43b09819
Author: Ruizhi Zhong <ruizhi.zhong@outlook.com>
Date: Sun Sep 27 23:30:11 2026 +0800
sci-misc/prism-llama-cpp: add PrismML release ebuild
commit 74d8d6eca2d01b854f0a7afb4a49945b976e34ee
Author: Ruizhi Zhong <ruizhi.zhong@outlook.com>
Date: Sun Sep 27 23:02:08 2026 +0800
sci-misc/prism-llama-cpp: add live ebuild
Author: user.email <ruizhi.zhong@outlook.com>
Date: Sat Oct 31 20:56:48 2026 +0800
overlay: bump strata, datagrip, prism-llama-cpp and kvmem-llama-cpp
sci-ml/strata 0.2.9: the ggml pin in third_party/ggml/VERSION.txt is
unchanged, so LLAMA_COMMIT stays put. redact-portage-managed.patch is
re-derived against the new tarball; it applied with a nine-line offset and
now applies cleanly. requirements.txt and requirements-monitor.txt did not
change, and the terminal file set package_terminal.py stages is the same.
dev-util/datagrip 2026.2.6.1: straight version bump, every path the ebuild
sets permissions on still exists in the new tarball.
sci-misc/prism-llama-cpp 12128: upstream tag prism-b12128-d7b2896.
sci-misc/kvmem-llama-cpp 0.19.1:
- Upstream moved to kvmem/kvmem, so HOMEPAGE, the SRC_URI, metadata.xml
and the update checker follow.
- backends/versions.json now pins llama.cpp 620d222 and replaces the single
kvmem patch with an ordered five-patch series (kvmem, pq2, ptq1,
ptq1-performance, checkpoint-policy). scripts/prepare-backends.py needs the
submodule's git metadata to verify the series, which a tarball build does
not have, so the pinned tree is unpacked and the same series, in the same
order, is applied with eapply. All five apply with fuzz=0.
- KVMEM_ENABLE_NVME is gone: the NVMe store was retired upstream in favour
of the shared RAM/SSD tiers. Its build switch and its test target are
dropped; host_kv_storage_test and tiered_kv_storage_test cover the tiers
that replaced it.
- New backport: monitor_hardware.hpp includes <nvml.h>, whose one-argument
DEPRECATED(ver) clobbers llama.cpp's two-argument DEPRECATED(func, hint)
and breaks mtmd.h in llama-kvmem-server.cpp. The patch restores the
llama.cpp spelling after NVML is done with the name.
- README.gentoo: the old example passed --kvmem-gen-reserve 16384, which is
now documented as reusable generation workspace rather than an output cap.
It shows --kvmem-host-mib and the opt-in SSD pair instead.
Validated locally on amd64 with CUDA 13.4 and sm_120a: kvmem 0.19.1 builds
llama-kvmem-cli and llama-kvmem-server and its six model-free tests pass;
strata 0.2.9 builds its engine; prism 12128 configures. Manifest regenerated
with pkgdev manifest; pkgcheck reports no new findings.
commit 365b2d2e9f052c7704f7850242a75a5f3063a81c
Author: user.email <ruizhi.zhong@outlook.com>
Date: Fri Oct 30 20:37:37 2026 +0800
Bump packages reported by the update checker (#28)
Release bumps for the packages issue #28 reported:
app-text/quarto-bin 1.10.19 -> 1.10.20
sci-ml/strata 0.2.7.1 -> 0.2.8
sci-ml/torchaudio 2.11.0-r2 -> 2.11.1
sci-misc/prism-llama-cpp 10826 -> 10831
app-misc/chatgpt-desktop 26.1023.51421 -> 26.1027.30824
app-misc/claude-desktop 4.29.0 -> 4.4212.0
torchaudio 2.11.1 is a packaging and bug-fix release that still supports
PyTorch 2.11 and later, so the existing dependency and PYTHON_COMPAT stand.
Prism moves to prism-b10831-9d9efea. Strata keeps its pinned llama.cpp tree
(third_party/ggml/VERSION.txt is unchanged), and its terminal file set,
package_engine.py/stage_tuning.py interfaces and CMake options are unchanged,
so only the version moves; the Portage redaction patch still applies at fuzz=0.
The remaining two entries needed no ebuild change, but the checker was wrong:
* app-misc/bcompare already tracks 5.2.7.32913. The scooter lookup failed
because the site answers HTTP 500 to curl's default User-Agent; request the
page as a browser does.
* sci-misc/kvmem-llama-cpp stays at 0.18.0. kvmem publishes v0.19.0-rc1 with
the prerelease box unchecked, so get_latest_stable() returned a release
candidate. Filter the version string the way get_latest_tag() already does.
Also correct the launcher comment naming sci-misc/strata instead of sci-ml/strata.
commit 63d631dbc8b0439bda25639bfe769741159600bd
Author: Ruizhi Zhong <ruizhi.zhong@outlook.com>
Date: Mon Oct 26 23:00:11 2026 +0800
sci-misc/prism-llama-cpp: bump to 10826
Bump PrismML llama.cpp from prism-b10819-909f0ca to
prism-b10826-c9c34bc. The 10819..10826 range only changes CUDA kernels
and backend tests, with no CMake or build-flag changes, so the ebuild
only needs the new tag, commit, and distfile digest. Keep the live
prism-llama-cpp-9999-r1 ebuild.
ComfyUI 0.42.5 is still its latest tag and pins comfy-aimdo 0.5.6,
comfy-kitchen 0.2.39, and comfyui-frontend-package 1.55.18, so those
packages stay at the pinned versions reported by the update checker.
Closes #23
commit 5eda39e22a1b1146c6328bec081d49e6453b37ea
Author: user.email <ruizhi.zhong@outlook.com>
Date: Sun Oct 25 15:10:50 2026 +0800
overlay: bump packages from issue #22
Bump the packages reported in issue #22 that can follow their upstream
releases: media-fonts/sarasa-gothic 1.0.42 -> 1.0.43 and
sci-misc/prism-llama-cpp 10787 -> 10819 (prism-b10819-909f0ca). The
Sarasa distfile matches the SHA-256 digest GitHub publishes for the
release asset, and the Prism 10787..10819 range touches no CMake files,
so that ebuild only needs the new tag and commit. The live
prism-llama-cpp-9999-r1 ebuild is kept.
ComfyUI's asset packages keep the exact pins from its 0.42.5
requirements.txt, and 0.42.5 is still the latest ComfyUI tag. Only
ComfyUI master pins newer versions (comfy-aimdo 0.6.0, comfy-kitchen
0.2.40 and comfyui-frontend-package 1.57.1), so comfy-aimdo,
comfy-kitchen and comfyui-frontend-package stay at 0.5.6, 0.2.39 and
1.55.18 even though newer upstream releases exist. Master does not pin
the comfyui-frontend-package 1.57.3 that the update checker reports.
Closes #22
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
commit 8cac0625e7b9c448a60ef47ace36067faaf67455
Author: ruizhi <ruizhi.zhong@outlook.com>
Date: Wed Oct 21 19:49:42 2026 +0800
overlay: bump packages from issue #19
commit 1f5ea897923300998a4e63ccc3dd84f26b092645
Author: user.email <ruizhi.zhong@outlook.com>
Date: Mon Oct 19 00:24:45 2026 +0800
Update packages for October 2026 releases
commit 5c396a234aefcc27478a50ec7416d2e65edd61d2
Author: ruizhi <ruizhi.zhong@outlook.com>
Date: Wed Oct 14 19:17:15 2026 +0800
overlay: bump packages from update report
commit fa8e2c1b0c6fe44e7bd0a275f952c864f008e0d4
Author: user.email <ruizhi.zhong@outlook.com>
Date: Mon Oct 5 16:46:35 2026 +0800
Bump ChatGPT Desktop and Prism llama.cpp
commit 87da77f6c9e725eb75c1856375675b1e43b09819
Author: Ruizhi Zhong <ruizhi.zhong@outlook.com>
Date: Sun Sep 27 23:30:11 2026 +0800
sci-misc/prism-llama-cpp: add PrismML release ebuild
commit 74d8d6eca2d01b854f0a7afb4a49945b976e34ee
Author: Ruizhi Zhong <ruizhi.zhong@outlook.com>
Date: Sun Sep 27 23:02:08 2026 +0800
sci-misc/prism-llama-cpp: add live ebuild

