gpo.zugaina.org

Search Portage & Overlays:

dev-python/tiktoken

Fast BPE tokeniser for use with OpenAI's models

Screenshots

  • tiktoken-0.8.0
    ~amd64
    python_targets_python3_11 python_targets_python3_12 python_targets_python3_13

    View      Download      Browse     License: MIT   
    Overlay: tatsh-overlay