KELIP / special_tokens_map.json
Geonmo's picture
add tokenizer
027d7a6
{"bos_token": "[SOT]", "eos_token": "[EOT]"}