mii/tokenizers
1
0
Fork 0
mirror of https://github.com/mii443/tokenizers.git synced 2025-12-08 13:48:19 +00:00
Code Issues Packages Projects Releases Wiki Activity

Make name parameter Optional[str] on BaseTokenizer

Browse Source 
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>
This commit is contained in:
Morgan Funtowicz
2020-02-22 14:57:43 +01:00
parent d274a7691d
commit 817b760ab9
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
bindings/python/tokenizers/implementations/base_tokenizer.py
View File

@@ -209,7 +209,7 @@ class BaseTokenizer:
""" """
return self._tokenizer.id_to_token(id) return self._tokenizer.id_to_token(id)
def save(self, directory: str, name: str = None): def save(self, directory: str, name: Optional[str] = None):
""" Save the current model to the given directory """ Save the current model to the given directory
Args: Args: