KELIP / tokenizer_config.json
Geonmo's picture
add tokenizer
027d7a6
{"tokenizer_class": "PreTrainedTokenizerFast"}