santacoder / tokenizer_config.json

Commit History

add special tokens
1354bdd

RaymondLi commited on

Add max length to tokenizer
aaeed52

ncoop57 commited on

Upload tokenizer
ebb180e

lvwerra HF staff commited on