dev-python/tiktoken
A fast BPE tokeniser for use with OpenAI's models
-
tiktoken-0.14.0~amd64 ~arm64test debug python_targets_python3_12 python_targets_python3_13 python_targets_python3_14 python_targets_python3_15 debug
View
Download
Browse License: MIT Apache-2.0-with-LLVM-exceptions MIT Unicode-3.0 Overlay: guru -
tiktoken-0.14.0~amd64test debug python_targets_python3_12 python_targets_python3_13 python_targets_python3_14 python_targets_python3_15 debug
View
Download
Browse License: MIT Apache-2.0 Unicode-3.0 Overlay: tatsh-overlay -
tiktoken-0.14.0~amd64 ~arm64debug python_targets_python3_12 python_targets_python3_13 python_targets_python3_14 debug
View
Download
Browse License: MIT Apache-2.0-with-LLVM-exceptions MIT Unicode-3.0 Overlay: stuff -
tiktoken-0.14.0~amd64 ~arm64test debug python_targets_python3_12 python_targets_python3_13 python_targets_python3_14 debug
View
Download
Browse License: MIT Apache-2.0-with-LLVM-exceptions MIT Unicode-3.0 Overlay: bentoo
ChangeLog
commit 55f74d471e9872499e133d4a99e399202ea37642
Author: Plamen K. Kosseff <plamen@ipnmod.org>
Date: Fri Sep 11 08:14:30 2026 +0000
dev-python: fish-speech dependency tier (5 new + tiktoken GURU mirror)
Assisted-by: Claude:claude-fable-5
Signed-off-by: Plamen K. Kosseff <plamen@ipnmod.org>
Author: Plamen K. Kosseff <plamen@ipnmod.org>
Date: Fri Sep 11 08:14:30 2026 +0000
dev-python: fish-speech dependency tier (5 new + tiktoken GURU mirror)
Assisted-by: Claude:claude-fable-5
Signed-off-by: Plamen K. Kosseff <plamen@ipnmod.org>

