Hugging Face's logo

hiiamsid
/
hit5-base

Text2Text Generation Transformers PyTorch Hindi t5 hindi Inference Endpoints text-generation-inference
Model card Files Community
1
hit5-base / README.md
hiiamsid's picture
hiiamsid
Create README.md
7c89a22
preview code
|
raw history blame contribute delete
No virus
669 Bytes
metadata
language:
  - hi
tags:
  - hindi
license: mit

This is a smaller version of the google/mt5-base model with only hindi embeddings left.

  • The original model has 582M parameters, with 237M of them being input and output embeddings.
  • After shrinking the sentencepiece vocabulary from 250K to 25K (top 25K Hindi tokens) the number of model parameters reduced to 237M parameters, and model size reduced from 2.2GB to 0.9GB - 42% of the original one.

Citing & Authors