project-code-py / special_tokens_map.json
gagan3012's picture
Initial commit
ec1ffd7
{"bos_token": "<|endoftext|>", "eos_token": "<|endoftext|>", "unk_token": "<|endoftext|>"}