mnmt_decoder_ko / added_tokens.json
donggyu's picture
add tokenizer
1d4eb55
{"<|endoftext|>": 51200}