boumehdi commited on
Commit
bd04eb6
1 Parent(s): 521553d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +0 -66
README.md CHANGED
@@ -57,70 +57,4 @@ print(transcription)
57
 
58
  Here's the output: قالت ليا هاد السيد هادا ما كاينش بحالو
59
 
60
- ## Evaluation & Previous works
61
-
62
- ====================================
63
-
64
- -v5 working on it and might add some common French words (mais, alors, donc, ...)
65
-
66
- It is going to be hard to see a great improvement from now on with my Nvidia GTX1070 ti :(, my VRAM is only 8Gb.
67
-
68
- ====================================
69
-
70
- -v4
71
-
72
- **Wer**: 0.09
73
-
74
- **Training Loss**: 13.59
75
-
76
- **Validation Loss**: 0.07
77
-
78
- fixed a problem when dealing with أ and ى and إ
79
-
80
- ====================================
81
-
82
- -v3 (fine-tuned on 11 hours of audio + changed hyperparameters + discovered a huge mistake when using the letter 'ا' that has improved the WER dramatically)
83
-
84
- **Wer**: 22.86
85
-
86
- **Training Loss**: 12.09
87
-
88
- **Validation Loss**: 33.04
89
-
90
- The validation loss goes down as we add more data for training.
91
-
92
- Further training to decrease the training Loss makes this model overfit a little bit.
93
-
94
- ====================================
95
-
96
- -v2 (fine-tuned on 9 hours of audio + replaced أ and ى and إ with ا as it creates a lot of problems + tried to standardize the Moroccan Darija)
97
-
98
- **Wer**: 44.30
99
-
100
- **Training Loss**: 12.99
101
-
102
- **Validation Loss**: 36.93
103
-
104
- Validation Loss has decreased on this version which means that the model can more generalize for unknown data compared to the previous version.
105
-
106
- The validation loss is still high also because the validation data contains words that have never been trained before. The solution is to add more data and more hours of training.
107
-
108
- Further training to decrease the training Loss makes this model overfit a little bit.
109
-
110
- ====================================
111
-
112
- -v1 (fine-tuned on 6 hours of audio)
113
-
114
- **Wer**: 49.68
115
-
116
- **Training Loss**: 9.88
117
-
118
- **Validation Loss**: 45.24
119
-
120
- ====================================
121
-
122
- ## Future Work
123
-
124
- I am currently working on improving this model.
125
-
126
  email: souregh@gmail.com
 
57
 
58
  Here's the output: قالت ليا هاد السيد هادا ما كاينش بحالو
59
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
60
  email: souregh@gmail.com