llama-13b-pretrained / added_tokens.json
dvruette's picture
Upload tokenizer
84a4e29
{
"<|assistant|>": 32004,
"<|prefix_begin|>": 32003,
"<|prefix_end|>": 32000,
"<|prompter|>": 32002,
"<|system|>": 32001
}