graduation-reserach-1-demo / added_tokens.json
leviethoang's picture
add tokenizer
467675c
{"<s>": 99, "</s>": 100, "<pad>": 101}