merlinite-7b / added_tokens.json
abhi1092's picture
Adding Merlinite-7B weights and tokenizer
536ee75
raw
history blame
119 Bytes
{
"<|assistant|>": 32003,
"<|endoftext|>": 32000,
"<|pad|>": 32001,
"<|system|>": 32004,
"<|user|>": 32002
}