Logo
Explore Help
Sign In
mii/tokenizers
1
0
Fork 0
You've already forked tokenizers
mirror of https://github.com/mii443/tokenizers.git synced 2025-08-22 16:25:30 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
fc0a50a272c3fad4ae2f07b4a5bd84e106d1e266
tokenizers/docs/source
History
Anthony MOI fc0a50a272 Update doc for Python 0.10.0
2021-01-12 16:47:56 -05:00
..
_ext
Doc - Add documentation for training from iterators
2021-01-12 15:51:38 -05:00
_static
Update doc for Python 0.10.0
2021-01-12 16:47:56 -05:00
api
Add a visualization utility to render tokens and annotations in a notebook (#508)
2020-12-04 10:25:56 -05:00
installation
Doc - Add installation steps
2020-11-02 17:07:27 -05:00
tutorials/python
Doc - Add documentation for training from iterators
2021-01-12 15:51:38 -05:00
components.rst
Split Pre-Tokenizer (#542)
2020-11-27 17:07:03 -05:00
conf.py
Doc - Add documentation for training from iterators
2021-01-12 15:51:38 -05:00
entities.inc
Doc - Update Decoder part of the Pipeline page
2020-11-02 17:07:27 -05:00
index.rst
Doc - Add documentation for training from iterators
2021-01-12 15:51:38 -05:00
pipeline.rst
Doc - Update Decoder part of the Pipeline page
2020-11-02 17:07:27 -05:00
quicktour.rst
Generate pyi, fix tests and clippy warnings
2020-11-20 13:30:44 -05:00
Powered by Gitea Version: 1.24.2 Page: 80ms Template: 7ms
English
Bahasa Indonesia Deutsch English Español Français Gaeilge Italiano Latviešu Magyar nyelv Nederlands Polski Português de Portugal Português do Brasil Suomi Svenska Türkçe Čeština Ελληνικά Български Русский Українська فارسی മലയാളം 日本語 简体中文 繁體中文(台灣) 繁體中文(香港) 한국어
Licenses API