Hugging Face's logo

Plim
/
xls-r-1b-cv_8-fr

Automatic Speech Recognition
Transformers
PyTorch
French
wav2vec2
mozilla-foundation/common_voice_8_0
Generated from Trainer
robust-speech-event
hf-asr-leaderboard
Eval Results
Inference Endpoints
Model card Files Community
Plim commited on
Commit
fb4b2a8
•
1 Parent(s): 6dc53fd

add results on dev audio

Browse files
Files changed (10) hide show
  1. .gitattributes +1 -0
  2. README.md +21 -2
  3. log_mozilla-foundation_common_voice_8_0_fr_test_predictions.txt → eval_results_without_lm/log_mozilla-foundation_common_voice_8_0_fr_test_predictions.txt +0 -0
  4. log_mozilla-foundation_common_voice_8_0_fr_test_targets.txt → eval_results_without_lm/log_mozilla-foundation_common_voice_8_0_fr_test_targets.txt +0 -0
  5. log_speech-recognition-community-v2_dev_data_fr_validation_predictions.txt → eval_results_without_lm/log_speech-recognition-community-v2_dev_data_fr_validation_predictions.txt +0 -0
  6. eval_results_without_lm/log_speech-recognition-community-v2_dev_data_fr_validation_targets.txt +0 -0
  7. mozilla-foundation_common_voice_8_0_fr_test_eval_results.txt → eval_results_without_lm/mozilla-foundation_common_voice_8_0_fr_test_eval_results.txt +0 -0
  8. eval_results_without_lm/speech-recognition-community-v2_dev_data_fr_validation_eval_results.txt +2 -0
  9. log_speech-recognition-community-v2_dev_data_fr_validation_targets.txt +0 -0
  10. speech-recognition-community-v2_dev_data_fr_validation_eval_results.txt +0 -2
.gitattributes CHANGED
@@ -27,3 +27,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
27
  *tfevents* filter=lfs diff=lfs merge=lfs -text
28
  wandb/run-20220203_170643-2fkfdtzb/run-2fkfdtzb.wandb filter=lfs diff=lfs merge=lfs -text
29
  wandb/run-20220206_201634-uhiy9e2t/run-uhiy9e2t.wandb filter=lfs diff=lfs merge=lfs -text
 
 
27
  *tfevents* filter=lfs diff=lfs merge=lfs -text
28
  wandb/run-20220203_170643-2fkfdtzb/run-2fkfdtzb.wandb filter=lfs diff=lfs merge=lfs -text
29
  wandb/run-20220206_201634-uhiy9e2t/run-uhiy9e2t.wandb filter=lfs diff=lfs merge=lfs -text
30
+ pytorch_model.bin filter=lfs diff=lfs merge=lfs -text
README.md CHANGED
@@ -34,10 +34,11 @@ model-index:
34
  metrics:
35
  - name: Test WER
36
  type: wer
37
- value: 60.25
38
  - name: Test CER
39
  type: cer
40
- value: 15.68
 
41
  ---
42
 
43
  ## Model description
@@ -107,3 +108,21 @@ python eval.py --model_id Plim/xls-r-1b-cv_8-fr --dataset mozilla-foundation/com
107
  ```bash
108
  python eval.py --model_id Plim/xls-r-1b-cv_8-fr --dataset speech-recognition-community-v2/dev_data --config fr --split validation --chunk_length_s 5.0 --stride_length_s 1.0
109
  ```
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
34
  metrics:
35
  - name: Test WER
36
  type: wer
37
+ value: 31.33
38
  - name: Test CER
39
  type: cer
40
+ value: 13.20
41
+
42
  ---
43
 
44
  ## Model description
 
108
  ```bash
109
  python eval.py --model_id Plim/xls-r-1b-cv_8-fr --dataset speech-recognition-community-v2/dev_data --config fr --split validation --chunk_length_s 5.0 --stride_length_s 1.0
110
  ```
111
+
112
+ ### Evaluation Results
113
+
114
+ Without LM:
115
+
116
+ | Dataset | WER | CER |
117
+ |:----------:|:-----:|:-----:|
118
+ | TEST CV | 18.33 | 5.60 |
119
+ | DEV audio | 31.33 | 13.20 |
120
+ | TEST audio | / | / |
121
+
122
+ With LM:
123
+
124
+ | Dataset | WER | CER |
125
+ |:----------:|:-----:|:-----:|
126
+ | TEST CV | / | / |
127
+ | DEV audio | / | / |
128
+ | TEST audio | / | / |
log_mozilla-foundation_common_voice_8_0_fr_test_predictions.txt → eval_results_without_lm/log_mozilla-foundation_common_voice_8_0_fr_test_predictions.txt RENAMED
File without changes
log_mozilla-foundation_common_voice_8_0_fr_test_targets.txt → eval_results_without_lm/log_mozilla-foundation_common_voice_8_0_fr_test_targets.txt RENAMED
File without changes
log_speech-recognition-community-v2_dev_data_fr_validation_predictions.txt → eval_results_without_lm/log_speech-recognition-community-v2_dev_data_fr_validation_predictions.txt RENAMED
File without changes
eval_results_without_lm/log_speech-recognition-community-v2_dev_data_fr_validation_targets.txt ADDED
The diff for this file is too large to render. See raw diff
 
mozilla-foundation_common_voice_8_0_fr_test_eval_results.txt → eval_results_without_lm/mozilla-foundation_common_voice_8_0_fr_test_eval_results.txt RENAMED
File without changes
eval_results_without_lm/speech-recognition-community-v2_dev_data_fr_validation_eval_results.txt ADDED
@@ -0,0 +1,2 @@
 
 
 
1
+ WER: 0.31337028525077737
2
+ CER: 0.13196878974963547
log_speech-recognition-community-v2_dev_data_fr_validation_targets.txt DELETED
The diff for this file is too large to render. See raw diff
 
speech-recognition-community-v2_dev_data_fr_validation_eval_results.txt DELETED
@@ -1,2 +0,0 @@
1
- WER: 0.6024801374275285
2
- CER: 0.15675326436359865