mii/tokenizers
1
0
Fork 0
mirror of https://github.com/mii443/tokenizers.git synced 2025-08-23 08:45:38 +00:00
Code Issues Packages Projects Releases Wiki Activity

Merge pull request #988 from huggingface/mishig25-patch-1

Browse Source 
Update pipeline.mdx
This commit is contained in:
Mishig Davaadorj
2022-04-25 17:54:10 +02:00
committed by GitHub
parent e6cd73a291 6a84727368
commit 0bd4976dba
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
docs/source-doc-builder/pipeline.mdx
View File

@ -25,7 +25,7 @@ For the examples that require a `Tokenizer` we will use the tokenizer we trained
"language": "python", "language": "python",
"start-after": "START reload_tokenizer", "start-after": "START reload_tokenizer",
"end-before": "END reload_tokenizer", "end-before": "END reload_tokenizer",
"dedent": 8} "dedent": 12}
</literalinclude> </literalinclude>
</python> </python>
<rust> <rust>