dev-python/mosestokenizer
Wrappers for the Moses tokenizer/detokenizer/punctuation-normaliser
ChangeLog
commit 38da2e9b97e80aaca7c698fff72e0b55a227748c
Author: Ivan S. Titov <iohann.s.titov@gmail.com>
Date: Fri Sep 25 09:25:39 2026 +0200
dev-python/mosestokenizer: Keyword 1.2.1 for ~arm
Pure Python, with no compiled code or architecture-specific paths.
commit 3d96cb05fb7dbb919615f7d6ad631b0cf0d71bfa
Author: Ivan S. Titov <iohann.s.titov@gmail.com>
Date: Sat May 9 21:54:08 2026 +0200
dev-python/mosestokenizer: new package, bigcode-eval dep
Author: Ivan S. Titov <iohann.s.titov@gmail.com>
Date: Fri Sep 25 09:25:39 2026 +0200
dev-python/mosestokenizer: Keyword 1.2.1 for ~arm
Pure Python, with no compiled code or architecture-specific paths.
commit 3d96cb05fb7dbb919615f7d6ad631b0cf0d71bfa
Author: Ivan S. Titov <iohann.s.titov@gmail.com>
Date: Sat May 9 21:54:08 2026 +0200
dev-python/mosestokenizer: new package, bigcode-eval dep


View
Download
Browse