infinitejoy's picture
add tokenizer
a59aac8
{"<s>": 66, "</s>": 67}