gpo.zugaina.org

Search Portage & Overlays:

dev-python/tiktoken

A fast BPE tokeniser for use with OpenAI's models

Screenshots

  • tiktoken-0.12.0
    ~amd64 ~arm64
    test debug python_targets_python3_11 python_targets_python3_12 python_targets_python3_13 python_targets_python3_14 debug

    View      Download      Browse     License: MIT Apache-2.0-with-LLVM-exceptions MIT Unicode-3.0   
    Overlay: guru