mii/tokenizers
1
0
Fork 0
mirror of https://github.com/mii443/tokenizers.git synced 2025-12-07 21:28:19 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
076319d542f87e9f72db379d7e47b29b1ce7bd87
tokenizers/bindings/python/py_src/tokenizers/trainers
History
Sylvain Gugger 6616e699f7 Expand documentation of UnigramTrainer (#770) 
* Expand documentation of UnigramTrainer

* Put doc at the source

* Add signature

* make style

Co-authored-by: Anthony Moi <m.anthony.moi@gmail.com>
2021-08-12 10:12:26 -04:00
..
__init__.py
Add WordLevel trainer
2020-11-20 13:30:44 -05:00
__init__.pyi
Expand documentation of UnigramTrainer (#770)
2021-08-12 10:12:26 -04:00