deepdml commited on
Commit
3031cda
1 Parent(s): 01de08e

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +26 -0
README.md CHANGED
@@ -57,6 +57,23 @@ model-index:
57
  - name: Cer
58
  type: cer
59
  value: 3.1561
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
60
  ---
61
 
62
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
@@ -69,6 +86,15 @@ It achieves the following results on the evaluation set:
69
  - Loss: 0.2599
70
  - Wer: 11.2278
71
 
 
 
 
 
 
 
 
 
 
72
  ## Model description
73
 
74
  More information needed
 
57
  - name: Cer
58
  type: cer
59
  value: 3.1561
60
+ - task:
61
+ type: Automatic Speech Recognition
62
+ name: speech-recognition
63
+ dataset:
64
+ name: VoxPopuli
65
+ type: facebook/voxpopuli
66
+ config: fr
67
+ split: test
68
+ args:
69
+ language: fr
70
+ metrics:
71
+ - name: WER
72
+ type: wer
73
+ value: 10.0653
74
+ - name: Cer
75
+ type: cer
76
+ value: 6.5456
77
  ---
78
 
79
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 
86
  - Loss: 0.2599
87
  - Wer: 11.2278
88
 
89
+ Using the [evalutaion script](https://github.com/huggingface/community-events/blob/main/whisper-fine-tuning-event/run_eval_whisper_streaming.py) provided in the Whisper Sprint the model achieves these results on the test sets (WER):
90
+
91
+ - **google/fleurs: 9.3526 %**
92
+ (python run_eval_whisper_streaming.py --model_id="deepdml/whisper-medium-mix-fr" --dataset="google/fleurs" --config="fr_fr" --device=0 --language="fr")
93
+ - **facebook/multilingual_librispeech: 6.3468 %**
94
+ (python run_eval_whisper_streaming.py --model_id="deepdml/whisper-medium-mix-fr" --dataset="facebook/multilingual_librispeech" --config="french" --device=0 --language="fr")
95
+ - **facebook/voxpopuli: 10.0653 %**
96
+ (python run_eval_whisper_streaming.py --model_id="deepdml/whisper-medium-mix-fr" --dataset="facebook/voxpopuli" --config="fr" --device=0 --language="fr")
97
+
98
  ## Model description
99
 
100
  More information needed