Llama2_test_import / added_tokens.json
TopperThijs's picture
Upload tokenizer
5d6c885 verified
{
"<MASK>": 32000,
"[PAD]": 32001
}