sgugger
/

my-new-shiny-tokenizer

Model card Files Files and versions Community

my-new-shiny-tokenizer / tokenizer_config.json

Commit History

add tokenizer

ec1d381

sgugger commited on Jun 30, 2021