hiiamsid commited on
Commit
7c89a22
1 Parent(s): 71813dd

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +12 -0
README.md ADDED
@@ -0,0 +1,12 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language: ["hi"]
3
+ tags:
4
+ - hindi
5
+ license: mit
6
+ ---
7
+ This is a smaller version of the [google/mt5-base](https://huggingface.co/google/mt5-base) model with only hindi embeddings left.
8
+ * The original model has 582M parameters, with 237M of them being input and output embeddings.
9
+ * After shrinking the `sentencepiece` vocabulary from 250K to 25K (top 25K Hindi tokens) the number of model parameters reduced to 237M parameters, and model size reduced from 2.2GB to 0.9GB - 42% of the original one.
10
+ ## Citing & Authors
11
+ - Model : [google/mt5-base](https://huggingface.co/google/mt5-base)
12
+ - Reference: [cointegrated/rut5-base](https://huggingface.co/cointegrated/rut5-base)