mirror of
https://github.com/mii443/tokenizers.git
synced 2025-08-22 16:25:30 +00:00
a8738a95d1
* Arg name correction: auth_token -> token * Arg name correction in .rs: auth_token -> token * update from_pretrained.rs file as well --------- Co-authored-by: Rene Ravenel <rene@Renes-MacBook-Pro.local> Co-authored-by: Arthur Zucker <arthur.zucker@gmail.com>