gpo.zugaina.org

Search Portage & Overlays:

sci-ml/tokenizers

Implementation of today's most used tokenizers

Screenshots

  • tokenizers-0.22.1
    ~amd64
    test debug python_single_target_python3_11 python_single_target_python3_12 python_single_target_python3_13 debug

    View      Download      Browse     License: Apache-2.0 Apache-2.0 Apache-2.0-with-LLVM-exceptions BSD-2 BSD ISC MIT MPL-2.0 Unicode-DFS-2016   
    Overlay: gentoo
  • tokenizers-0.21.4
    ~amd64
    test debug python_single_target_python3_11 python_single_target_python3_12 python_single_target_python3_13 debug

    View      Download      Browse     License: Apache-2.0 Apache-2.0 Apache-2.0-with-LLVM-exceptions BSD-2 BSD ISC MIT MPL-2.0 Unicode-DFS-2016   
    Overlay: gentoo
  • tokenizers-0.21.1-r88881
    ~amd64
    test debug python_single_target_python3_11 python_single_target_python3_12 python_single_target_python3_13 debug

    View      Download      Browse     License: Apache-2.0 Apache-2.0 Apache-2.0-with-LLVM-exceptions BSD-2 BSD ISC MIT MPL-2.0 Unicode-DFS-2016   
    Overlay: anonch
  • tokenizers-0.21.1-r1
    ~amd64
    test debug python_single_target_python3_11 python_single_target_python3_12 python_single_target_python3_13 debug

    View      Download      Browse     License: Apache-2.0 Apache-2.0 Apache-2.0-with-LLVM-exceptions BSD-2 BSD ISC MIT MPL-2.0 Unicode-DFS-2016   
    Overlay: anonch
  • tokenizers-0.21.0
    ~amd64
    test debug python_single_target_python3_11 python_single_target_python3_12 python_single_target_python3_13 debug

    View      Download      Browse     License: Apache-2.0 Apache-2.0 Apache-2.0-with-LLVM-exceptions BSD-2 BSD ISC MIT MPL-2.0 Unicode-DFS-2016   
    Overlay: anonch

Runtime Dependencies

tokenizers-0.22.1

dev-libs/oniguruma

python_single_target_python3_11?
      ( dev-lang/python:3.11 )

python_single_target_python3_12?
      ( dev-lang/python:3.12 )

python_single_target_python3_13?
      ( dev-lang/python:3.13 )

tokenizers-0.21.4

dev-libs/oniguruma

python_single_target_python3_11?
      ( dev-lang/python:3.11 )

python_single_target_python3_12?
      ( dev-lang/python:3.12 )

python_single_target_python3_13?
      ( dev-lang/python:3.13 )

tokenizers-0.21.1-r88881

dev-libs/oniguruma

python_single_target_python3_11?
      ( dev-lang/python:3.11 )

python_single_target_python3_12?
      ( dev-lang/python:3.12 )

python_single_target_python3_13?
      ( dev-lang/python:3.13 )

tokenizers-0.21.1-r1

dev-libs/oniguruma

python_single_target_python3_11?
      ( dev-lang/python:3.11 )

python_single_target_python3_12?
      ( dev-lang/python:3.12 )

python_single_target_python3_13?
      ( dev-lang/python:3.13 )

tokenizers-0.21.0


python_single_target_python3_11?
      ( dev-lang/python:3.11 )

python_single_target_python3_12?
      ( dev-lang/python:3.12 )

python_single_target_python3_13?
      ( dev-lang/python:3.13 )