gpo.zugaina.org

Search Portage & Overlays:

dev-python/count-tokens

Count number of tokens in the text file using tiktoken tokenizer from OpenAI.

Screenshots

  • count-tokens-0.7.3
    ~amd64 ~x86
    python_targets_python3_11 python_targets_python3_12 python_targets_python3_13 python_targets_python3_14

    View      Download      Browse     License: MIT   
    Overlay: pypi

USE Flags

python_targets_python3_11
* This flag is undocumented *
python_targets_python3_12
* This flag is undocumented *
python_targets_python3_13
* This flag is undocumented *
python_targets_python3_14
* This flag is undocumented *