Evaluating Tokenizer Performance of Large Language Models Across Official Indian Languages
Paper
•
2411.12240
•
Published
•
5
•
2
SAGAR TAMANG
tamang0000
·
AI & ML interests
Neural Machine Translation (NMT)
Recent Activity
authored
a paper
6 days ago
Enhancing Assamese NLP Capabilities: Introducing a Centralized Dataset
Repository
authored
a paper
6 days ago
Evaluating Tokenizer Performance of Large Language Models Across
Official Indian Languages
commented
a paper
6 days ago
Evaluating Tokenizer Performance of Large Language Models Across
Official Indian Languages
Organizations
None yet
tamang0000's activity
commented
a
paper
6 days ago