scratch / added_tokens.json
RANITBAG's picture
Upload tokenizer
fcc3d93
raw
history blame
55 Bytes
{
"<|endoftext|>": 1001,
"<|startoftext|>": 1000
}