mii/AzooKeyKanaKanjiConverter
1
0
Fork 0
mirror of https://github.com/mii443/AzooKeyKanaKanjiConverter.git synced 2025-12-03 02:58:27 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
develop
AzooKeyKanaKanjiConverter/Sources/EfficientNGram/tokenizer
History

README.md

tokenizer

This tokenizer data is from ku-nlp/gpt2-small-japanese-char, following CC BY-SA 4.0 License.