mii/tokenizers
1
0
Fork 0
mirror of https://github.com/mii443/tokenizers.git synced 2025-12-05 12:18:20 +00:00
Code Issues Packages Projects Releases Wiki Activity

Black pass.

Browse Source
This commit is contained in:
Nicolas Patry
2020-08-21 16:49:41 +02:00
committed by Anthony MOI
parent 7ed7f0f26a
commit 6887c0f04d
3 changed files with 42 additions and 32 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
bindings/python/py_src/tokenizers/pre_tokenizers/__init__.pyi
View File

@@ -128,7 +128,6 @@ class Punctuation(PreTokenizer):
""" Instantiate a new Punctuation PreTokenizer """
pass
class Sequence(PreTokenizer):
""" Sequence PreTokenizer