persian-llama2 / tokenizer.json
amirakhlaghiqqq's picture
[Added] - Special Tokens to indicate Farsi and English text has been added
d6e48cb
raw
history
2.08 MB
File too large to display, you can check the raw version instead.