Nicolas Patry 4b6055d4fb Adding pickling support for trainers (#949) ...

* TMP.

* Adding support for pickling Python trainers.

* Remove not warranted files + missed naming updates.

* Stubbing.

* Making sure serialized format is written in python tests.

2022-03-14 12:18:11 +01:00

..

bindings

Adding pickling support for trainers (#949)

2022-03-14 12:18:11 +01:00

documentation

Doc - Hotfix training from iterators tutorial

2021-02-03 15:50:09 -05:00

implementations

Add a way to specify the unknown token in SentencePieceUnigramTokenizer python implem (#762)

2021-08-12 09:42:44 -04:00

__init__.py

Python - Add some tests utils

2020-04-01 17:25:55 -04:00

test_serialization.py

Fixing bad deserialization following inclusion of a default for Punctuation. (#884)

2022-01-17 22:28:25 +01:00

utils.py

Clippy fixes. (#846)

2021-12-15 15:55:48 +01:00