Logo
Explore Help
Sign In
mii/tokenizers
1
0
Fork 0
You've already forked tokenizers
mirror of https://github.com/mii443/tokenizers.git synced 2025-12-09 14:18:30 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
8585b761d16c5fb7ff26101fb2682c2f30e58e8f
tokenizers/bindings/python/examples
History
Anthony MOI 8585b761d1 Python - More updates to the new API
2020-02-10 11:57:30 -05:00
..
custom_pre_tokenizer.py
Python - Update examples with getter/setter
2020-01-07 15:23:11 -05:00
example.py
Python - More updates to the new API
2020-02-10 11:57:30 -05:00
train_bert_wordpiece.py
Python - Update Bert default special tokens
2020-02-05 12:55:01 -05:00
train_bytelevel_bpe.py
Updated train_bytelevel_bpe.py to use the high level Python API.
2020-01-14 12:00:50 +01:00
Powered by Gitea Version: 1.24.5 Page: 167ms Template: 1ms
English
Bahasa Indonesia Deutsch English Español Français Gaeilge Italiano Latviešu Magyar nyelv Nederlands Polski Português de Portugal Português do Brasil Suomi Svenska Türkçe Čeština Ελληνικά Български Русский Українська فارسی മലയാളം 日本語 简体中文 繁體中文(台灣) 繁體中文(香港) 한국어
Licenses API