Logo
Explore Help
Sign In
mii/tokenizers
1
0
Fork 0
You've already forked tokenizers
mirror of https://github.com/mii443/tokenizers.git synced 2025-08-23 00:35:35 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
91dae1de15f48b0c1fafc4e6017d2244700a309b
tokenizers/docs/source
History
Anthony MOI 91dae1de15 Doc - Add documentation for training from iterators
2021-01-12 15:51:38 -05:00
..
_ext
Doc - Add documentation for training from iterators
2021-01-12 15:51:38 -05:00
_static
Doc - Update for 0.9.4
2020-11-09 16:36:04 -05:00
api
Add a visualization utility to render tokens and annotations in a notebook (#508)
2020-12-04 10:25:56 -05:00
installation
Doc - Add installation steps
2020-11-02 17:07:27 -05:00
tutorials/python
Doc - Add documentation for training from iterators
2021-01-12 15:51:38 -05:00
components.rst
Split Pre-Tokenizer (#542)
2020-11-27 17:07:03 -05:00
conf.py
Doc - Add documentation for training from iterators
2021-01-12 15:51:38 -05:00
entities.inc
Doc - Update Decoder part of the Pipeline page
2020-11-02 17:07:27 -05:00
index.rst
Doc - Add documentation for training from iterators
2021-01-12 15:51:38 -05:00
pipeline.rst
Doc - Update Decoder part of the Pipeline page
2020-11-02 17:07:27 -05:00
quicktour.rst
Generate pyi, fix tests and clippy warnings
2020-11-20 13:30:44 -05:00
Powered by Gitea Version: 1.24.2 Page: 277ms Template: 8ms
English
Bahasa Indonesia Deutsch English Español Français Gaeilge Italiano Latviešu Magyar nyelv Nederlands Polski Português de Portugal Português do Brasil Suomi Svenska Türkçe Čeština Ελληνικά Български Русский Українська فارسی മലയാളം 日本語 简体中文 繁體中文(台灣) 繁體中文(香港) 한국어
Licenses API