gpt2-tweet-paraphraser / special_tokens_map.json

Added necessary files for twitter.

6f5d0b5 over 2 years ago

No virus

214 Bytes

{"bos_token": "<bos>", "eos_token": "<eos>", "unk_token": "<|endoftext|>", "pad_token": "<pad>", "additional_special_tokens": ["<dense-vectors>", "<tokens>", "<verb>", "<ARG0>", "<ARG1>", "<global-dense-vectors>"]}