forward-dictionary-model / special_tokens_map.json

Update special_tokens_map.json

a01c815 about 4 years ago

No virus

175 Bytes

{"bos_token": "<|bod|>", "eos_token": "<|eod|>", "unk_token": "<|endoftext|>", "pad_token": "<|pad|>", "additional_special_tokens": ["<|bd|>", "<|be|>", "<|pos|>", "<|bto|>"]}