melaura-v1-0 / tokenizer /added_tokens.json
DamarJati's picture
Create added_tokens.json
712244d
{
"<|endoftext|>": 49407,
"<|startoftext|>": 49406
}