mii/tokenizers
1
0
Fork 0
mirror of https://github.com/mii443/tokenizers.git synced 2025-08-22 16:25:30 +00:00
Code Issues Packages Projects Releases Wiki Activity

Typo in README.md

Browse Source 
an -> a
This commit is contained in:
Alan deLevie
2020-01-13 19:03:18 -05:00
committed by GitHub
parent b41ce0e9d6
commit 554d6f7fd9
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
README.md
View File

@ -59,7 +59,7 @@ Encoding(num_tokens=13, attributes=[ids, type_ids, tokens, offsets, attention_ma
'😁'
```
And training an new vocabulary is just as easy:
And training a new vocabulary is just as easy:
```python
# You can also train a BPE/Byte-levelBPE/WordPiece vocabulary on your own files