gpt2-medium-bg / added_tokens.json
rmihaylov's picture
add tokenizer
3770f02
{"[MASK]": 50260, "[SEP]": 50258, "<pad>": 50259, "<unk>": 50261, "[CLS]": 50257}