t5-transition / special_tokens_map.json
stanleychu2's picture
add tokenizer
3188c73
{"eos_token": "</s>", "unk_token": "<unk>", "pad_token": "<PAD>", "additional_special_tokens": ["<context>", "</context>", "<future>", "</future>", "<blank>"]}