Anthony MOI dce52621c6 Rust - Make parallelism optional

2020-06-22 20:31:52 -04:00

..

decoders.rs

Python - Test and fix classes pickling

2020-05-27 13:46:37 -04:00

encoding.rs

Python - Make Encoding pickable

2020-05-27 13:46:37 -04:00

error.rs

Python - RustFmt

2020-02-18 15:07:34 -05:00

lib.rs

Python - Add bindings for new AddedToken options

2020-03-24 20:58:45 -04:00

models.rs

Rust - Make parallelism optional

2020-06-22 20:31:52 -04:00

normalizers.rs

Python - Test and fix classes pickling

2020-05-27 13:46:37 -04:00

pre_tokenizers.rs

Python - Test and fix classes pickling

2020-05-27 13:46:37 -04:00

processors.rs

Python - Test and fix classes pickling

2020-05-27 13:46:37 -04:00

token.rs

Python - Remove warning on unused Token

2019-12-13 15:28:48 -05:00

tokenizer.rs

Python - Improve AddedToken interface

2020-06-19 17:53:46 -04:00

trainers.rs

Python - Improve AddedToken interface

2020-06-19 17:53:46 -04:00

utils.rs

Expose Tokenizer parts

2019-12-31 22:57:47 -05:00