codeparrot-small-vocabulary / tokenizer_config.json

Commit History

add tokenizer
b8151ec

thomwolf HF staff commited on