sci-libs/ctranslate2
Fast inference engine for Transformer models
Screenshots
-
ctranslate2-4.8.4~amd64+cli dnnl +openblas +openmp rocm +ruy +amdgpu_targets_gfx908 +amdgpu_targets_gfx90a +amdgpu_targets_gfx942 +amdgpu_targets_gfx950 +amdgpu_targets_gfx1030 +amdgpu_targets_gfx1100 +amdgpu_targets_gfx1101 +amdgpu_targets_gfx1102 +amdgpu_targets_gfx1103 +amdgpu_targets_gfx1150 +amdgpu_targets_gfx1151 +amdgpu_targets_gfx1152 +amdgpu_targets_gfx1153 +amdgpu_targets_gfx1200 +amdgpu_targets_gfx1201 amdgpu_targets_gfx803 amdgpu_targets_gfx900 amdgpu_targets_gfx906 amdgpu_targets_gfx90c amdgpu_targets_gfx1010 amdgpu_targets_gfx1011 amdgpu_targets_gfx1012 amdgpu_targets_gfx1031 amdgpu_targets_gfx1032 amdgpu_targets_gfx1033 amdgpu_targets_gfx1034 amdgpu_targets_gfx1035 amdgpu_targets_gfx1036
View 
Download 
Browse License: MIT Overlay: local-ai
ChangeLog
commit 4f6579913f95ce6322c6340c45ef98a9f836c175
Author: Plamen K. Kosseff <plamen@ipnmod.org>
Date: Wed Oct 28 10:00:26 2026 +0000
localai-backend/faster-whisper: new backend, venv-free, with the shared python layer under it
New packages: sci-ml/torchmetrics, vector-quantize-pytorch, modelscope, llama-cpp-python, torchao, faster-whisper, pytorch-lightning, lightning. sci-libs/ctranslate2 and dev-python/ctranslate2.
ctranslate2: empty submodule dirs filled from the tree (spdlog, cxxopts) and from pinned tarballs (cpu_features, ruy with dev-libs/cpuinfo). MKL and the Intel OpenMP runtime off, openblas/dnnl/ruy as USE flags, rocm wired like local-ai-ggml.eclass.
llama-cpp-python: builds its vendored llama.cpp, same CPU gates and vulkan surface as the ggml eclass, libllama under llama_cpp/lib.
torchao: built from the GitHub tag with USE_CPP=0, the pure-python package upstream ships as its py3-none-any wheel.
The faster-whisper backend carries only what backend.py imports. The upstream requirement files list unrelated packages.
metadata/docs/todo-kokoro-kitten-tts.md: findings for the two backends set aside.
Assisted-by: Claude Code:claude-fable-5
Signed-off-by: Plamen K. Kosseff <plamen@ipnmod.org>
Author: Plamen K. Kosseff <plamen@ipnmod.org>
Date: Wed Oct 28 10:00:26 2026 +0000
localai-backend/faster-whisper: new backend, venv-free, with the shared python layer under it
New packages: sci-ml/torchmetrics, vector-quantize-pytorch, modelscope, llama-cpp-python, torchao, faster-whisper, pytorch-lightning, lightning. sci-libs/ctranslate2 and dev-python/ctranslate2.
ctranslate2: empty submodule dirs filled from the tree (spdlog, cxxopts) and from pinned tarballs (cpu_features, ruy with dev-libs/cpuinfo). MKL and the Intel OpenMP runtime off, openblas/dnnl/ruy as USE flags, rocm wired like local-ai-ggml.eclass.
llama-cpp-python: builds its vendored llama.cpp, same CPU gates and vulkan surface as the ggml eclass, libllama under llama_cpp/lib.
torchao: built from the GitHub tag with USE_CPP=0, the pure-python package upstream ships as its py3-none-any wheel.
The faster-whisper backend carries only what backend.py imports. The upstream requirement files list unrelated packages.
metadata/docs/todo-kokoro-kitten-tts.md: findings for the two backends set aside.
Assisted-by: Claude Code:claude-fable-5
Signed-off-by: Plamen K. Kosseff <plamen@ipnmod.org>