Anthony MOI 1a6f4b5204 Allow initial_alphabet on UnigramTrainer

2020-10-26 10:57:29 -04:00

..

decoders

Black pre-commit after rebase.

2020-09-24 08:57:02 +02:00

implementations

Fixed BPE.read_files -> BPE.read_file in SentencePieceBPETokenizer

2020-10-26 10:57:14 -04:00

models

Upgrading to black 20.8b1

2020-09-24 09:27:30 -04:00

normalizers

Black pre-commit after rebase.

2020-09-24 08:57:02 +02:00

pre_tokenizers

Finish exposing the UnicodeScripts PreTokenizer

2020-10-21 11:01:54 -04:00

processors

Update __init__.pyi

2020-09-29 10:09:10 -04:00

trainers

Allow initial_alphabet on UnigramTrainer

2020-10-26 10:57:29 -04:00

__init__.py

Python - Update CHANGELOG and bump to 0.9.2 for release

2020-10-15 10:14:58 -04:00

__init__.pyi

Upgrading to black 20.8b1

2020-09-24 09:27:30 -04:00