mii/tokenizers
1
0
Fork 0
mirror of https://github.com/mii443/tokenizers.git synced 2025-08-22 16:25:30 +00:00
Code Issues Packages Projects Releases Wiki Activity

Adding download counter

Browse Source
This commit is contained in:
Clement
2020-01-10 17:37:24 -05:00
committed by GitHub
parent d2833fc71d
commit 78b05a092f
1 changed files with 4 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

5
README.md
View File

@ -8,8 +8,11 @@
<a href="https://github.com/huggingface/tokenizers/blob/master/LICENSE">
<img alt="GitHub" src="https://img.shields.io/github/license/huggingface/tokenizers.svg?color=blue&cachedrop">
</a>
</a>
<img src="https://pepy.tech/badge/tokenizers/week" />
<a href="https://pepy.tech/project/tokenizers/week">
</a>
</p>
<br>
Provides an implementation of today's most used tokenizers, with a focus on performance and
versatility.