|
|
839239d3b4
|
Bump version
|
2019-12-27 10:43:34 -05:00 |
|
|
|
bddf7ba737
|
Python - Fix building from wheels
|
2019-12-27 10:39:19 -05:00 |
|
|
|
ffd28ba558
|
Bump for release
|
2019-12-26 14:56:13 -05:00 |
|
|
|
74cc6f6bde
|
Python - Simplify padding interface
|
2019-12-26 14:34:13 -05:00 |
|
|
|
d93d4fc3cd
|
Python - Simplify truncation interface
|
2019-12-26 10:35:20 -05:00 |
|
|
|
a7734ffc9f
|
Python - Update doc and readme for add_prefix_space
|
2019-12-26 10:34:53 -05:00 |
|
|
|
1879cb0bcb
|
Python - change with_added_tokens as kwarg
|
2019-12-25 22:22:35 -05:00 |
|
|
|
905c1eb77e
|
Python - update some packages
|
2019-12-25 22:16:43 -05:00 |
|
|
|
597031b973
|
Python - remove unused variable
|
2019-12-25 22:16:11 -05:00 |
|
|
|
9d289d357d
|
Python - change add_prefix_space as kwarg
|
2019-12-25 22:10:17 -05:00 |
|
|
|
4bc5a7bbe7
|
Python - fix example
|
2019-12-24 11:20:40 -05:00 |
|
|
|
c0ed873c4d
|
simplify initialization of BpeTrainer
|
2019-12-23 20:13:48 -05:00 |
|
|
|
fab1d4cabc
|
Bump version for release
|
2019-12-23 17:28:38 -05:00 |
|
|
|
e01d4f2052
|
Python - Remove misleading __repr__
|
2019-12-23 17:27:59 -05:00 |
|
|
|
2266960ef7
|
Bump version and update Readme
|
2019-12-20 10:26:40 -05:00 |
|
|
|
f2b9c30ad9
|
Handle vocab size with added tokens
|
2019-12-19 20:19:56 -05:00 |
|
|
|
b7040e0412
|
Option to skip special tokens while decoding
|
2019-12-19 20:03:02 -05:00 |
|
|
|
a8d68d516d
|
Handle special tokens
|
2019-12-19 19:48:16 -05:00 |
|
|
|
9763282d59
|
Bump version for release
|
2019-12-17 18:42:34 -05:00 |
|
|
|
4d14b08afe
|
ByteLevel handles prefix spaces
|
2019-12-17 18:35:40 -05:00 |
|
|
|
6766585965
|
Python - Do not expose non working features of Encoding
|
2019-12-17 17:43:42 -05:00 |
|
|
|
0a3d4a86a9
|
Python - Update bindings for BertPreTokenizer
|
2019-12-17 17:40:56 -05:00 |
|
|
|
3f95248d6d
|
Python - Truncation & padding bindings
|
2019-12-17 17:24:53 -05:00 |
|
|
|
08eb163415
|
Bump version for release
|
2019-12-16 19:38:33 -05:00 |
|
|
|
d80f752ec9
|
Python - Add some missing Encoding bindings
|
2019-12-16 19:38:18 -05:00 |
|
|
|
036ee603f4
|
Python - Update example
|
2019-12-16 18:50:21 -05:00 |
|
|
|
93a74aa53a
|
Python - Expose PostProcessors
|
2019-12-16 18:46:14 -05:00 |
|
|
|
1a90cc96e5
|
Python - Can add tokens
|
2019-12-16 18:45:26 -05:00 |
|
|
|
ee883c3fc7
|
Bump version for release
|
2019-12-13 18:18:07 -05:00 |
|
|
|
ed7e3999d2
|
Python - Fix some clippy warnings
|
2019-12-13 18:17:51 -05:00 |
|
|
|
24139d7324
|
Improve some Python classes
|
2019-12-13 17:53:46 -05:00 |
|
|
|
1c4593cad4
|
Python - Remove warning on unused Token
|
2019-12-13 15:28:48 -05:00 |
|
|
|
e93cc62a71
|
Python - Handle kwargs for bert modules
|
2019-12-13 15:28:29 -05:00 |
|
|
|
3355be89cd
|
Python - Update examples and improve errors
|
2019-12-13 14:37:29 -05:00 |
|
|
|
7cf4b3a6cd
|
Python - Rewrite PyDecoder and PyPreTokenizer
|
2019-12-13 12:20:25 -05:00 |
|
|
|
2a0ad97809
|
Python - Update API to allow failure
|
2019-12-13 12:20:05 -05:00 |
|
|
|
1c7be358b7
|
Python - Better error conversions
|
2019-12-13 12:14:27 -05:00 |
|
|
|
7cb2fe2ea0
|
Bump version
|
2019-12-10 18:01:07 -05:00 |
|
|
|
b4b31d73cd
|
Expose vocabulary size
|
2019-12-10 16:20:31 -05:00 |
|
|
|
6c294c60b0
|
Python - Add Encoding repr + improve example
|
2019-12-10 15:18:07 -05:00 |
|
|
|
99773d9ce4
|
Python - Add encoding getters
|
2019-12-10 15:17:41 -05:00 |
|
|
|
8cedc5f1f6
|
Update Python bindings for Encoding
|
2019-12-10 12:38:36 -05:00 |
|
|
|
018f57f054
|
Python - Update example
|
2019-12-09 12:51:05 -05:00 |
|
|
|
849272d44f
|
Python - add missing modules exports
|
2019-12-09 12:50:53 -05:00 |
|
|
|
3979096c52
|
Python - add BasicPreTokenizer
|
2019-12-09 12:50:09 -05:00 |
|
|
|
d60d24a378
|
Python - Add WordPiece model
|
2019-12-09 12:49:44 -05:00 |
|
|
|
5eba30835d
|
Python - Add WordPiece decoder
|
2019-12-09 12:49:17 -05:00 |
|
|
|
c46ec97855
|
Update README
|
2019-12-03 17:26:20 -05:00 |
|
|
|
75232c0f06
|
Fix setup.py
|
2019-12-03 16:20:20 -05:00 |
|
|
|
499f5507df
|
Bump versions for 0.0.3 release
|
2019-12-03 16:11:45 -05:00 |
|
