gpt2-tweet-paraphraser / special_tokens_map.json
filco306's picture
Added necessary files for twitter.
6f5d0b5
raw
history blame
214 Bytes
{"bos_token": "<bos>", "eos_token": "<eos>", "unk_token": "<|endoftext|>", "pad_token": "<pad>", "additional_special_tokens": ["<dense-vectors>", "<tokens>", "<verb>", "<ARG0>", "<ARG1>", "<global-dense-vectors>"]}