mii/tokenizers
1
0
Fork 0
mirror of https://github.com/mii443/tokenizers.git synced 2025-12-05 20:28:22 +00:00
Code Issues Packages Projects Releases Wiki Activity

Rust - Improve TruncationError

Browse Source
This commit is contained in:
Anthony MOI
2020-04-24 11:53:30 -04:00
parent 7d2b59b0aa
commit 02cc97756f
3 changed files with 30 additions and 8 deletions
Download Patch File Download Diff File Expand all files Collapse all files

6
bindings/python/CHANGELOG.md
View File

@@ -4,6 +4,12 @@ All notable changes to this project will be documented in this file.
The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.0.0/),
and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html).
## [Unreleased]
### Changed
- Improved errors generated during truncation: When the provided max length is too low are
now handled properly.
## [0.7.0]
### Changed