Nicolas Patry b16406c900 Moving StripAccents within normalizer for Albert +XLNet, but now crash ...

in Precompiled. offsets are wrong ?

2020-09-22 08:21:38 +02:00

..

convert.py

Moving StripAccents within normalizer for Albert +XLNet, but now crash

2020-09-22 08:21:38 +02:00

sentencepiece_extractor.py

Black pass.

2020-08-31 14:05:39 -04:00

spm_parity_check.py

Adding a new convert script, that will convert all python Tokenizer code

2020-09-22 08:21:38 +02:00