mii/tokenizers
1
0
Fork 0
mirror of https://github.com/mii443/tokenizers.git synced 2025-12-05 12:18:20 +00:00
Code Issues Packages Projects Releases Wiki Activity
1,554 Commits 1 Branch 0 Tags
a5f644616b45c9251f71f8549481381dfa121650
Commit Graph

7 Commits

Author SHA1 Message Date
Anthony MOI
387b8a1033 Generate pyi, fix tests and clippy warnings 2020-11-20 13:30:44 -05:00
Anthony MOI
d788a950ac Doc - Fixes some CI fails 2020-11-02 17:07:27 -05:00
Anthony MOI
324aa2930a Doc - Improve python and node tests 2020-11-02 17:07:27 -05:00
Anthony MOI
9521603e08 Doc - Update Decoder part of the Pipeline page 2020-11-02 17:07:27 -05:00
Anthony MOI
8b65c1f4bc Doc - Update Bert example on the Pipeline page 2020-11-02 17:07:27 -05:00
Anthony MOI
620769fd4b Doc - Update PreTokenizer part of the Pipeline page 2020-11-02 17:07:27 -05:00
Anthony MOI
13a80050f0 Doc - Update Normalizer part of the Pipeline page 2020-11-02 17:07:27 -05:00