mii/AzooKeyKanaKanjiConverter
1
0
Fork 0
mirror of https://github.com/mii443/AzooKeyKanaKanjiConverter.git synced 2025-08-22 15:05:26 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
531c6fe0fbd2963d57ea18bfd9f0c531ca8123f8
AzooKeyKanaKanjiConverter/Sources/EfficientNGram/tokenizer/README.md

163 B
Raw Blame History

tokenizer

This tokenizer data is from ku-nlp/gpt2-small-japanese-char, following CC BY-SA 4.0 License.