QAG_Pegasus_2ep_eval / special_tokens_map.json
nloc2578's picture
add tokenizer
1ec9304
{"eos_token": "</s>", "unk_token": "<unk>", "pad_token": "<pad>", "mask_token": "<mask_2>", "additional_special_tokens": ["[SEP]"]}