Update README.md
Browse files
README.md
CHANGED
@@ -68,7 +68,7 @@ with autocast():
|
|
68 |
* GPU: VGA NVIDIA Tesla P100 16GB
|
69 |
* SYSTEM RAM: 29GB
|
70 |
|
71 |
-
**Hours used:** ~
|
72 |
|
73 |
### Training Data
|
74 |
|
@@ -96,11 +96,11 @@ with autocast():
|
|
96 |
* QLora: rank: 64 /Q: 4-bit
|
97 |
|
98 |
- 250k examples of 70% Vietnamese 30% English for 3.37 epoch
|
99 |
-
- 350k examples of 60% Vietnamese 40% English for 1.
|
100 |
|
101 |
### Training loss
|
102 |
|
103 |
-
![image/png](https://cdn-uploads.huggingface.co/production/uploads/63905e87df447b438817b2cd/
|
104 |
|
105 |
## Evaluation
|
106 |
|
|
|
68 |
* GPU: VGA NVIDIA Tesla P100 16GB
|
69 |
* SYSTEM RAM: 29GB
|
70 |
|
71 |
+
**Hours used:** ~43.5 Approx*
|
72 |
|
73 |
### Training Data
|
74 |
|
|
|
96 |
* QLora: rank: 64 /Q: 4-bit
|
97 |
|
98 |
- 250k examples of 70% Vietnamese 30% English for 3.37 epoch
|
99 |
+
- 350k examples of 60% Vietnamese 40% English for 1.4 epoch
|
100 |
|
101 |
### Training loss
|
102 |
|
103 |
+
![image/png](https://cdn-uploads.huggingface.co/production/uploads/63905e87df447b438817b2cd/rV8Go_YFZv7QcR_FhFxp-.png)
|
104 |
|
105 |
## Evaluation
|
106 |
|