Logo
Explore Help
Sign In
mii/tokenizers
1
0
Fork 0
You've already forked tokenizers
mirror of https://github.com/mii443/tokenizers.git synced 2025-09-01 14:59:20 +00:00
Code Issues Packages Projects Releases Wiki Activity
1,437 Commits 1 Branch 0 Tags
57200144ca2a5940a156d751ee37fe8fd1dcd85c
Commit Graph

13 Commits

Author SHA1 Message Date
Anthony MOI
6a29dbc070 Doc - Hotfix training from iterators tutorial 2021-02-03 15:50:09 -05:00
Anthony MOI
91dae1de15 Doc - Add documentation for training from iterators 2021-01-12 15:51:38 -05:00
Anthony MOI
387b8a1033 Generate pyi, fix tests and clippy warnings 2020-11-20 13:30:44 -05:00
taufique74
5cccaefcee typo: from_files() renamed to from_file() 2020-11-04 08:15:32 -05:00
Anthony MOI
d788a950ac Doc - Fixes some CI fails 2020-11-02 17:07:27 -05:00
Anthony MOI
324aa2930a Doc - Improve python and node tests 2020-11-02 17:07:27 -05:00
Anthony MOI
b6ffd9cba0 Doc - Cleanup old tests & node lints 2020-11-02 17:07:27 -05:00
Anthony MOI
9521603e08 Doc - Update Decoder part of the Pipeline page 2020-11-02 17:07:27 -05:00
Anthony MOI
8b65c1f4bc Doc - Update Bert example on the Pipeline page 2020-11-02 17:07:27 -05:00
Anthony MOI
620769fd4b Doc - Update PreTokenizer part of the Pipeline page 2020-11-02 17:07:27 -05:00
Anthony MOI
13a80050f0 Doc - Update Normalizer part of the Pipeline page 2020-11-02 17:07:27 -05:00
Anthony MOI
4cf0a0b72c Doc - Quicktour uses python tested code 2020-11-02 17:07:27 -05:00
Anthony MOI
000c19a7a5 Doc - Improve snippets testing 2020-11-02 17:07:27 -05:00
Powered by Gitea Version: 1.24.2 Page: 289ms Template: 11ms
English
Bahasa Indonesia Deutsch English Español Français Gaeilge Italiano Latviešu Magyar nyelv Nederlands Polski Português de Portugal Português do Brasil Suomi Svenska Türkçe Čeština Ελληνικά Български Русский Українська فارسی മലയാളം 日本語 简体中文 繁體中文(台灣) 繁體中文(香港) 한국어
Licenses API