mii/tokenizers
1
0
Fork 0
mirror of https://github.com/mii443/tokenizers.git synced 2025-08-22 16:25:30 +00:00
Code Issues Packages Projects Releases Wiki Activity

Update pipeline.mdx

Browse Source
This commit is contained in:
Mishig Davaadorj
2022-04-25 17:50:12 +02:00
committed by GitHub
parent e6cd73a291
commit 6a84727368
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
docs/source-doc-builder/pipeline.mdx
View File

@ -25,7 +25,7 @@ For the examples that require a `Tokenizer` we will use the tokenizer we trained
"language": "python", "language": "python",
"start-after": "START reload_tokenizer", "start-after": "START reload_tokenizer",
"end-before": "END reload_tokenizer", "end-before": "END reload_tokenizer",
"dedent": 8} "dedent": 12}
</literalinclude> </literalinclude>
</python> </python>
<rust> <rust>