polyglot-ko-5.8b / special_tokens_map.json
jason9693's picture
Upload with huggingface_hub
602dc2f
raw
history blame
136 Bytes
{"eos_token": "<eos>", "pad_token": "<pad>", "additional_special_tokens": ["<|endoftext|>", "<|sep|>", "<|acc|>", "<|tel|>", "<|rrn|>"]}