skt_kogpt2-base-v2 / tokenizer_config.json

Commit History

change bos token from </s> to <s>
aaf7887

byeongal commited on

add files for tokenizer
a0c3ba0

byeongal commited on