Gentoo Portage Overlays - sci-libs/tokenizers

sci-libs/tokenizers

Implementation of today's most used tokenizers

Screenshots

https://github.com/huggingface/tokenizers

tokenizers-0.20.1-r1

~amd64

test debug python_single_target_python3_10 python_single_target_python3_11 python_single_target_python3_12 debug

View

Download

Browse License: Apache-2.0 Apache-2.0 Apache-2.0-with-LLVM-exceptions BSD-2 BSD ISC MIT MPL-2.0 Unicode-DFS-2016

Overlay: gentoo

ChangeLog USE Flags Dependencies Reverse Deps Related Bugs

Runtime Dependencies

tokenizers-0.20.1-r1

python_single_target_python3_10?
      ( dev-lang/python:3.10 )

python_single_target_python3_11?
      ( dev-lang/python:3.11 )

python_single_target_python3_12?
      ( dev-lang/python:3.12 )