Update README.md
Browse files
README.md
CHANGED
@@ -20,7 +20,7 @@ This is a Tamil finetuned version of Google's Gemma 2B model. This is an experim
|
|
20 |
1. The [Gemma base model](https://huggingface.co/google/gemma-2b) was continually pretrained on all available Tamil Wikipedia data for 3 epochs.
|
21 |
2. The updated model was then finetuned on a mix of English and Tamil alpaca datasets for 5 epochs.
|
22 |
|
23 |
-
> **Note:** This project is currently under development. The initial pretraining phase may not have been extensive enough, which suggests that the model's performance could improve by extending the pretraining on a larger dataset, such as CulturaX.
|
24 |
|
25 |
## Model description
|
26 |
|
|
|
20 |
1. The [Gemma base model](https://huggingface.co/google/gemma-2b) was continually pretrained on all available Tamil Wikipedia data for 3 epochs.
|
21 |
2. The updated model was then finetuned on a mix of English and Tamil alpaca datasets for 5 epochs.
|
22 |
|
23 |
+
> **Note:** This project is currently under development (FOR TAMIL). The initial pretraining phase may not have been extensive enough, which suggests that the model's performance could improve by extending the pretraining on a larger dataset, such as CulturaX.
|
24 |
|
25 |
## Model description
|
26 |
|