RITA_s / tokenizer_config.json

add tokenizer

8ca1e4f about 2 years ago

No virus

167 Bytes

{"special_tokens_map_file": "Seledorn/RITA_tokenizer/special_tokens_map.json", "name_or_path": "Seledorn/RITA_tokenizer", "tokenizer_class": "PreTrainedTokenizerFast"}