mii/tokenizers
1
0
Fork 0
mirror of https://github.com/mii443/tokenizers.git synced 2025-08-22 16:25:30 +00:00
Code Issues Packages Projects Releases Wiki Activity

Python - Add some tests utils

Browse Source
This commit is contained in:
Anthony MOI
2020-03-30 16:56:43 -04:00
parent 477037fd6b
commit 023566fbbb
4 changed files with 38 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
.gitignore vendored
View File

@ -8,6 +8,7 @@ Cargo.lock
/data
tokenizers/data
bindings/python/tests/data
/docs
__pycache__