Commit Graph

11 Commits

Author SHA1 Message Date
1a90cc96e5 Python - Can add tokens 2019-12-16 18:45:26 -05:00
ed7e3999d2 Python - Fix some clippy warnings 2019-12-13 18:17:51 -05:00
2a0ad97809 Python - Update API to allow failure 2019-12-13 12:20:05 -05:00
b4b31d73cd Expose vocabulary size 2019-12-10 16:20:31 -05:00
6c294c60b0 Python - Add Encoding repr + improve example 2019-12-10 15:18:07 -05:00
8cedc5f1f6 Update Python bindings for Encoding 2019-12-10 12:38:36 -05:00
849272d44f Python - add missing modules exports 2019-12-09 12:50:53 -05:00
eaafb22511 Add bindings for Trainer in Python 2019-12-03 15:54:15 -05:00
8fbe3c2662 Python - Add decoders 2019-11-22 21:08:57 -05:00
e44f52024c Python - Set a PreTokenizer in a model 2019-11-22 21:01:52 -05:00
39a6d04c53 Improve Python bindings
This is an attempt at actually exposing the same structure that we use in the Rust lib. This will allow Python to instantiate Model/PreTokenizer/... with their own arguments, combining everything without relying on parsed kwargs.
2019-11-22 17:57:36 -05:00