llama-13b-pretrained-dropout / added_tokens.json
dvruette's picture
Upload tokenizer
045c847
raw
history blame contribute delete
133 Bytes
{
"<|assistant|>": 32002,
"<|prefix_begin|>": 32000,
"<|prefix_end|>": 32001,
"<|prompter|>": 32003,
"<|system|>": 32004
}