Gentoo Portage Overlays - dev-python/tokenizers

dev-python/tokenizers

Fast State-of-the-Art Tokenizers optimized for Research and Production

Screenshots

https://github.com/huggingface/tokenizers

tokenizers-0.22.2

~amd64

debug python_targets_python3_11 python_targets_python3_12 python_targets_python3_13 debug

View

Download

Browse License: Apache-2.0 Apache-2.0 MIT Unicode-3.0

Overlay: bennypowers

ChangeLog USE Flags Dependencies Reverse Deps Related Bugs

Bugs

Bug #	Severity	Platform	Status	Description

These bugs were grabbed from http://bugs.gentoo.org and have only passed a preliminary search using the package title, to do a more through search please visit: http://bugs.gentoo.org.