File size: 1,373 Bytes
128fb53
dcfda80
 
128fb53
dcfda80
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
128fb53
dcfda80
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
---
language:
- fi
license: apache-2.0
tags:
- whisper-event
- finnish
datasets:
- mozilla-foundation/common_voice_11_0
- google/fleurs
metrics:
- wer
- cer
model-index:
- name: Whisper Large V3 Finnish
  results:
  - task:
      name: Automatic Speech Recognition
      type: automatic-speech-recognition
    dataset:
      name: Common Voice 11.0
      type: mozilla-foundation/common_voice_11_0
      config: fi
      split: test
      args: fi
    metrics:
    - name: Wer
      type: wer
      value: 8.23
    - name: Cer
      type: cer
      value: 1.43
  - task:
      name: Automatic Speech Recognition
      type: automatic-speech-recognition
    dataset:
      name: FLEURS
      type: google/fleurs
      config: fi_fi
      split: test
      args: fi_fi
    metrics:
    - name: Wer
      type: wer
      value: 8.21
    - name: Cer
      type: cer
      value: 3.23
---


Original Whisper Large V3
CV11
WER: 14.81
WER NORMALIZED: 10.82
CER: 2.7
CER NORMALIZED: 2.07

Fleurs
WER: 12.04
WER NORMALIZED: 9.63
CER: 2.48
CER NORMALIZED: 3.64


After Finetuning:

@14000 steps
CV11
WER: 11.36
WER NORMALIZED: 8.31
CER: 1.93
CER NORMALIZED: 1.48

Fleurs
WER: 10.2
WER NORMALIZED: 8.56
CER: 2.26
CER NORMALIZED: 3.54

@32000 steps
CV11
WER: 11.47
WER NORMALIZED: 8.23
CER: 1.91
CER NORMALIZED: 1.43

Fleurs
WER: 10.1
WER NORMALIZED: 8.21
CER: 2.2
CER NORMALIZED: 3.23