dev-python/tiktoken
A fast BPE tokeniser for use with OpenAI's models
-
tiktoken-0.13.0~amd64 ~arm64debug python_targets_python3_12 python_targets_python3_13 python_targets_python3_14 debug
View
Download
Browse License: MIT Apache-2.0-with-LLVM-exceptions MIT Unicode-3.0 Overlay: stuff -
tiktoken-0.12.0~amd64 ~arm64debug python_targets_python3_12 python_targets_python3_13 python_targets_python3_14 debug
View
Download
Browse License: MIT Apache-2.0-with-LLVM-exceptions MIT Unicode-3.0 Overlay: stuff -
tiktoken-0.12.0~amd64 ~arm64test debug python_targets_python3_11 python_targets_python3_12 python_targets_python3_13 python_targets_python3_14 debug
View
Download
Browse License: MIT Apache-2.0-with-LLVM-exceptions MIT Unicode-3.0 Overlay: guru -
tiktoken-0.12.0~amd64test debug python_targets_python3_11 python_targets_python3_12 python_targets_python3_13 python_targets_python3_14 debug
View
Download
Browse License: MIT Apache-2.0 Unicode-3.0 Overlay: tatsh-overlay
ChangeLog
commit d42b3dc9f6bb828da7f1c094951becbf326992cb
Author: Florian Albrechtskirchinger <falbrechtskirchinger@gmail.com>
Date: Fri May 29 10:59:38 2026 +0200
dev-python/tiktoken: add missing BDEPEND
Requires dev-python/setuptools-rust.
Closes: https://bugs.gentoo.org/974945
Signed-off-by: Florian Albrechtskirchinger <falbrechtskirchinger@gmail.com>
commit d999e1e10db4aaa8eca9b49373ea5dbb31f54c1e
Author: Florian Albrechtskirchinger <falbrechtskirchinger@gmail.com>
Date: Thu Mar 26 03:00:34 2026 +0100
dev-python/tiktoken: new package, add 0.12.0
Signed-off-by: Florian Albrechtskirchinger <falbrechtskirchinger@gmail.com>
Author: Florian Albrechtskirchinger <falbrechtskirchinger@gmail.com>
Date: Fri May 29 10:59:38 2026 +0200
dev-python/tiktoken: add missing BDEPEND
Requires dev-python/setuptools-rust.
Closes: https://bugs.gentoo.org/974945
Signed-off-by: Florian Albrechtskirchinger <falbrechtskirchinger@gmail.com>
commit d999e1e10db4aaa8eca9b49373ea5dbb31f54c1e
Author: Florian Albrechtskirchinger <falbrechtskirchinger@gmail.com>
Date: Thu Mar 26 03:00:34 2026 +0100
dev-python/tiktoken: new package, add 0.12.0
Signed-off-by: Florian Albrechtskirchinger <falbrechtskirchinger@gmail.com>

