RASMUS commited on
Commit
dcfda80
1 Parent(s): b0ae254

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +89 -0
README.md CHANGED
@@ -1,3 +1,92 @@
1
  ---
 
 
2
  license: apache-2.0
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ language:
3
+ - fi
4
  license: apache-2.0
5
+ tags:
6
+ - whisper-event
7
+ - finnish
8
+ datasets:
9
+ - mozilla-foundation/common_voice_11_0
10
+ - google/fleurs
11
+ metrics:
12
+ - wer
13
+ - cer
14
+ model-index:
15
+ - name: Whisper Large V3 Finnish
16
+ results:
17
+ - task:
18
+ name: Automatic Speech Recognition
19
+ type: automatic-speech-recognition
20
+ dataset:
21
+ name: Common Voice 11.0
22
+ type: mozilla-foundation/common_voice_11_0
23
+ config: fi
24
+ split: test
25
+ args: fi
26
+ metrics:
27
+ - name: Wer
28
+ type: wer
29
+ value: 8.23
30
+ - name: Cer
31
+ type: cer
32
+ value: 1.43
33
+ - task:
34
+ name: Automatic Speech Recognition
35
+ type: automatic-speech-recognition
36
+ dataset:
37
+ name: FLEURS
38
+ type: google/fleurs
39
+ config: fi_fi
40
+ split: test
41
+ args: fi_fi
42
+ metrics:
43
+ - name: Wer
44
+ type: wer
45
+ value: 8.21
46
+ - name: Cer
47
+ type: cer
48
+ value: 3.23
49
  ---
50
+
51
+
52
+ Original Whisper Large V3
53
+ CV11
54
+ WER: 14.81
55
+ WER NORMALIZED: 10.82
56
+ CER: 2.7
57
+ CER NORMALIZED: 2.07
58
+
59
+ Fleurs
60
+ WER: 12.04
61
+ WER NORMALIZED: 9.63
62
+ CER: 2.48
63
+ CER NORMALIZED: 3.64
64
+
65
+
66
+ After Finetuning:
67
+
68
+ @14000 steps
69
+ CV11
70
+ WER: 11.36
71
+ WER NORMALIZED: 8.31
72
+ CER: 1.93
73
+ CER NORMALIZED: 1.48
74
+
75
+ Fleurs
76
+ WER: 10.2
77
+ WER NORMALIZED: 8.56
78
+ CER: 2.26
79
+ CER NORMALIZED: 3.54
80
+
81
+ @32000 steps
82
+ CV11
83
+ WER: 11.47
84
+ WER NORMALIZED: 8.23
85
+ CER: 1.91
86
+ CER NORMALIZED: 1.43
87
+
88
+ Fleurs
89
+ WER: 10.1
90
+ WER NORMALIZED: 8.21
91
+ CER: 2.2
92
+ CER NORMALIZED: 3.23