transfer-learning-gpt / tokenizer_config.json

add tokenizer

09488e2 almost 2 years ago

No virus

176 Bytes

{"unk_token": "<unk>", "special_tokens_map_file": null, "name_or_path": "/var/folders/c9/nlyjrmvd2m741ghn3g9l8v540000gn/T/tmpzwxhh1ys", "tokenizer_class": "OpenAIGPTTokenizer"}