From 93bb82c6577166f48a235ae3f20ecdf3c9f65e8f Mon Sep 17 00:00:00 2001 From: Anthony MOI Date: Wed, 20 May 2020 19:42:40 -0400 Subject: [PATCH] Update READMEs and CHANGELOGs --- bindings/python/CHANGELOG.md | 4 ++++ 1 file changed, 4 insertions(+) diff --git a/bindings/python/CHANGELOG.md b/bindings/python/CHANGELOG.md index 43fe3993..af1795a3 100644 --- a/bindings/python/CHANGELOG.md +++ b/bindings/python/CHANGELOG.md @@ -10,6 +10,10 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0 - [#272]: Serialization of the `Tokenizer` and all the parts (`PreTokenizer`, `Normalizer`, ...). This adds some methods to easily save/load an entire tokenizer (`from_str`, `from_file`). +### Added +- [#272]: Serialization of the `Tokenizer` and all the parts (`PreTokenizer`, `Normalizer`, ...). +This adds some methods to easily save/load an entire tokenizer (`from_str`, `from_file`). + ### Changed - Improved errors generated during truncation: When the provided max length is too low are now handled properly.