tokenizer_config.json · DeepESP/gpt2-spanish at 07062af5e202907680a38cfd4f49fc20e1b63012

gpt2-spanish / tokenizer_config.json

New model

496d75e almost 3 years ago

No virus

115 Bytes

{"pad_token": "<|endoftext|>", "special_tokens_map_file": "./special_tokens_map.json", "full_tokenizer_file": null}