polyglot-ko-3.8b / special_tokens_map.json
jason9693's picture
Upload with huggingface_hub
1b01a45
raw
history blame
136 Bytes
{"eos_token": "<eos>", "pad_token": "<pad>", "additional_special_tokens": ["<|endoftext|>", "<|sep|>", "<|acc|>", "<|tel|>", "<|rrn|>"]}