mii/tokenizers
1
0
Fork 0
mirror of https://github.com/mii443/tokenizers.git synced 2025-08-22 16:25:30 +00:00
Code Issues Packages Projects Releases Wiki Activity

node: version 0.4.1

Browse Source
This commit is contained in:
Pierric Cistac
2020-02-11 09:54:17 -05:00
parent bbbd97c7e1
commit 5e612669bb
3 changed files with 9 additions and 3 deletions
Download Patch File Download Diff File Expand all files Collapse all files

8
bindings/node/CHANGELOG.md
View File

@ -1,4 +1,10 @@
# [0.4.0](https://github.com/huggingface/tokenizers/compare/node-v0.3.0...node-v0.3.1) (2020-02-05)
## [0.4.1](https://github.com/huggingface/tokenizers/compare/node-v0.4.0...node-v0.4.1) (2020-02-11)
### Bug Fixes
- Fix punctuation in BertWordPieceTokenizer (Thanks to @Mansterteddy with [#134](https://github.com/huggingface/tokenizers/pull/134))
# [0.4.0](https://github.com/huggingface/tokenizers/compare/node-v0.3.1...node-v0.4.0) (2020-02-05)
### BREAKING CHANGES

2
bindings/node/package-lock.json generated
View File

@ -1,6 +1,6 @@
{
"name": "tokenizers",
"version": "0.4.0",
"version": "0.4.1",
"lockfileVersion": 1,
"requires": true,
"dependencies": {

2
bindings/node/package.json
View File

@ -1,6 +1,6 @@
{
"name": "tokenizers",
"version": "0.4.0",
"version": "0.4.1",
"description": "",
"main": "./dist/index.js",
"types": "./dist/index.d.ts",