Anthony MOI 42c4691e4d Python - Update Bert default special tokens ...

Closes #106

2020-02-05 12:55:01 -05:00

..

custom_pre_tokenizer.py

Python - Update examples with getter/setter

2020-01-07 15:23:11 -05:00

example.py

Use the same vocabs/merges for Python and Rust comparison.

2020-01-15 11:57:34 +01:00

train_bert_wordpiece.py

Python - Update Bert default special tokens

2020-02-05 12:55:01 -05:00

train_bytelevel_bpe.py

Updated train_bytelevel_bpe.py to use the high level Python API.

2020-01-14 12:00:50 +01:00