Commit Graph

6 Commits

Author SHA1 Message Date
36832bfa12 from_files -> from_file everywhere
- read_files -> read_file
- from_file pure rust impl in python bindings
- Fix some typing in python binding
- Added {BPE,WordLevel,WordPiece}.from_file tests.
2020-09-24 08:57:02 +02:00
9672995a56 We use 19.10b0 not 20 here... 2020-09-24 08:57:02 +02:00
8f8156fd2c Adressing first pass of comments. 2020-09-24 08:57:02 +02:00
98a30eead1 Temp work to make the APIs uniform (build from memory by default). 2020-09-24 08:57:02 +02:00
aa3b39f692 Python - Tests for parallelism with multiprocessing
Co-authored-by: Evan Pete Walsh <epwalsh10@gmail.com>
2020-06-23 11:25:39 -04:00
5ebe687753 Python - Add first implementations tests 2020-04-01 17:25:55 -04:00