system HF staff commited on
Commit
272b398
1 Parent(s): 0901777

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -14,7 +14,7 @@ language: "mr"
14
  - **Dataset** - 1M data samples are used to train this model from OSCAR page(https://oscar-corpus.com/) eventhough data set is of 2.7 GB due to resource constraint to train
15
  I have picked only 1M data from the total 2.7GB data set. If you are interested in collaboration and have computational resources to train on you are most welcome to do so.
16
 
17
- - **Preprocessing** - ByteLevelBPETokenizer is used to tokenize the sentences at character level and vocabulary size is set to 52k as per standard values given by 🤗
18
  <!-- - **Hyperparameters** - __ByteLevelBPETokenizer__ : vocabulary size = 52_000 and min_frequency = 2
19
  __Trainer__ : num_train_epochs=12 - trained for 12 epochs
20
  per_gpu_train_batch_size=64 - batch size for the datasamples is 64
@@ -25,4 +25,4 @@ I have picked only 1M data from the total 2.7GB data set. If you are interested
25
  this is for anyone who wants to make use of marathi language models for various tasks like language generation, translation and many more use cases.
26
 
27
  **Whatever else is helpful!**
28
- If you are intersted in collaboration feel free to reach me [Deepam](mailto:deepam8155@gmail.com)
 
14
  - **Dataset** - 1M data samples are used to train this model from OSCAR page(https://oscar-corpus.com/) eventhough data set is of 2.7 GB due to resource constraint to train
15
  I have picked only 1M data from the total 2.7GB data set. If you are interested in collaboration and have computational resources to train on you are most welcome to do so.
16
 
17
+ - **Preprocessing** - ByteLevelBPETokenizer is used to tokenize the sentences at character level and vocabulary size is set to 52k as per standard values given by 🤗
18
  <!-- - **Hyperparameters** - __ByteLevelBPETokenizer__ : vocabulary size = 52_000 and min_frequency = 2
19
  __Trainer__ : num_train_epochs=12 - trained for 12 epochs
20
  per_gpu_train_batch_size=64 - batch size for the datasamples is 64
 
25
  this is for anyone who wants to make use of marathi language models for various tasks like language generation, translation and many more use cases.
26
 
27
  **Whatever else is helpful!**
28
+ If you are intersted in collaboration feel free to reach me [Deepam](mailto:deepam8155@gmail.com)