mnmt_decoder_ko / added_tokens.json
donggyu's picture
add tokenizer
1d4eb55
raw
history blame
No virus
24 Bytes
{"<|endoftext|>": 51200}