gpt-neo-1.3B-code-clippy / special_tokens_map.json
ncoop57's picture
Add new tokens to model
d4807ec
{"bos_token": "<|endoftext|>", "eos_token": "<|endoftext|>", "unk_token": "<|endoftext|>", "additional_special_tokens": ["\t\t", " ", " ", " "]}