sgugger
/

my-new-shiny-tokenizer

Model card Files Files and versions Community

my-new-shiny-tokenizer / tokenizer.json

sgugger's picture

add tokenizer

ec1d381 almost 3 years ago

No virus

676 kB

File too large to display, you can check the raw version instead.