1a90cc96e5
Python - Can add tokens
2019-12-16 18:45:26 -05:00
ed7e3999d2
Python - Fix some clippy warnings
2019-12-13 18:17:51 -05:00
2a0ad97809
Python - Update API to allow failure
2019-12-13 12:20:05 -05:00
b4b31d73cd
Expose vocabulary size
2019-12-10 16:20:31 -05:00
6c294c60b0
Python - Add Encoding repr + improve example
2019-12-10 15:18:07 -05:00
8cedc5f1f6
Update Python bindings for Encoding
2019-12-10 12:38:36 -05:00
849272d44f
Python - add missing modules exports
2019-12-09 12:50:53 -05:00
eaafb22511
Add bindings for Trainer in Python
2019-12-03 15:54:15 -05:00
8fbe3c2662
Python - Add decoders
2019-11-22 21:08:57 -05:00
e44f52024c
Python - Set a PreTokenizer in a model
2019-11-22 21:01:52 -05:00
39a6d04c53
Improve Python bindings
...
This is an attempt at actually exposing the same structure that we use in the Rust lib. This will allow Python to instantiate Model/PreTokenizer/... with their own arguments, combining everything without relying on parsed kwargs.
2019-11-22 17:57:36 -05:00