unigram-tokenizer-wikitext / tokenizer_config.json

Commit History

Upload tokenizer
54406d5

sayakpaul HF staff commited on

add tokenizer
99b7b7b

sayakpaul HF staff commited on