gpo.zugaina.org

Search Portage & Overlays:

dev-python/tiktoken

Fast BPE tokeniser for use with OpenAI's models

Screenshots

  • tiktoken-0.8.0
    ~amd64
    python_targets_python3_11 python_targets_python3_12 python_targets_python3_13

    View      Download      Browse     License: MIT   
    Overlay: tatsh-overlay

USE Flags

python_targets_python3_11
* This flag is undocumented *
python_targets_python3_12
* This flag is undocumented *
python_targets_python3_13
* This flag is undocumented *