dev-python/tiktoken
Fast BPE tokeniser for use with OpenAI's models
Screenshots
-
tiktoken-0.8.0~amd64python_targets_python3_11 python_targets_python3_12 python_targets_python3_13
View 
Download 
Browse License: MIT Overlay: tatsh-overlay
Reverse Dependencies
Reverse dependancies are sometimes conditional based on your USE flags, Ebuild version and sometimes other packages. please keep this in mind.