Nicolas Patry 36832bfa12 from_files -> from_file everywhere ...

- read_files -> read_file
- from_file pure rust impl in python bindings
- Fix some typing in python binding
- Added {BPE,WordLevel,WordPiece}.from_file tests.

2020-09-24 08:57:02 +02:00

..

__init__.py

Python - Add first implementations tests

2020-04-01 17:25:55 -04:00

test_bert_wordpiece.py

Temp work to make the APIs uniform (build from memory by default).

2020-09-24 08:57:02 +02:00

test_byte_level_bpe.py

from_files -> from_file everywhere

2020-09-24 08:57:02 +02:00

test_char_bpe.py

from_files -> from_file everywhere

2020-09-24 08:57:02 +02:00