persian-llama2 / added_tokens.json
amirakhlaghiqqq's picture
Update added_tokens.json
e81b7b3 verified
raw
history blame
273 Bytes
{
"<|assistant|>": 36944,
"<|endoftext|>": 36943,
"<|end|>": 36950,
"<|EN|>": 36945,
"<|FA|>": 36946,
"<|placeholder3|>": 36947,
"<|placeholder4|>": 36948,
"<|placeholder5|>": 36951,
"<|placeholder6|>": 36952,
"<|system|>": 36949,
"<|user|>": 36953
}