huggingface-course
/

code-search-net-tokenizer

Model card Files Files and versions Community

code-search-net-tokenizer / tokenizer_config.json

Commit History

Add tokenizer

2a84d67

sgugger commited on Oct 4, 2021