Gentoo Portage Overlays - dev-python/count-tokens

dev-python/count-tokens

Count number of tokens in the text file using tiktoken tokenizer from OpenAI.

Screenshots

https://github.com/izikeros/count_tokens

count-tokens-0.7.3

~amd64 ~x86

python_targets_python3_11 python_targets_python3_12 python_targets_python3_13 python_targets_python3_14

View

Download

Browse License: MIT

Overlay: pypi

ChangeLog USE Flags Dependencies Reverse Deps Related Bugs

Bugs

Bug #	Severity	Platform	Status	Description

These bugs were grabbed from http://bugs.gentoo.org and have only passed a preliminary search using the package title, to do a more through search please visit: http://bugs.gentoo.org.