Hugging Face model: aloobun/IN-Llama-3-Tokenizer
Author: aloobun
Created: 2024-12-10 10:34:40
Last modified: 2025-03-07 22:06:59
Library: transformers
Likes: 0 | Downloads: 0
Tags: transformers, llama, tokenizer, bpe, Indic, license:llama3, endpoints_compatible, region:us
Card metadata:
license: llama3
tags: llama, tokenizer, bpe, Indic
library_name: transformers