Update README.md
Browse files
README.md
CHANGED
@@ -41,7 +41,7 @@ We fine-tune OpenHathi base model on the aforementioned IndicInstruct dataset wi
|
|
41 |
- LoRA Rank: 16
|
42 |
- LoRA alpha: 32
|
43 |
- LoRA Dropout: 0.05
|
44 |
-
- LoRA Target Modules: ["q_proj", "v_proj", "k_proj", "
|
45 |
- Epochs: 4
|
46 |
- Learning rate: 5e-4
|
47 |
- Batch Size: 128
|
|
|
41 |
- LoRA Rank: 16
|
42 |
- LoRA alpha: 32
|
43 |
- LoRA Dropout: 0.05
|
44 |
+
- LoRA Target Modules: ["q_proj", "v_proj", "k_proj", "down_proj", "gate_proj", "up_proj"]
|
45 |
- Epochs: 4
|
46 |
- Learning rate: 5e-4
|
47 |
- Batch Size: 128
|