mii/tokenizers
1
0
Fork 0
mirror of https://github.com/mii443/tokenizers.git synced 2025-12-16 17:18:43 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
bded212356c06e686391a81c6f28098bb20d817c
tokenizers/bindings/python/scripts
History
Nicolas Patry 91393ef75e Fixing doc. (#1499) 
* Fixing doc.

* SentencePieceUnigram  and Convert.py still used sentencepiece

* stub

---------

Co-authored-by: Arthur Zucker <arthur.zucker@gmail.com>
2024-04-17 09:32:40 +02:00
..
convert.py
Fixing doc. (#1499)
2024-04-17 09:32:40 +02:00
sentencepiece_extractor.py
[remove black] And use ruff (#1436)
2024-03-12 11:24:21 +01:00
spm_parity_check.py
[remove black] And use ruff (#1436)
2024-03-12 11:24:21 +01:00