jonatasgrosman commited on
Commit
7265264
1 Parent(s): 20902b6

update evaluation

Browse files
README.md CHANGED
@@ -22,16 +22,16 @@ model-index:
22
  metrics:
23
  - name: Test WER
24
  type: wer
25
- value: 10.06
26
  - name: Test CER
27
  type: cer
28
- value: 2.57
29
  - name: Test WER (+LM)
30
  type: wer
31
- value: 7.59
32
  - name: Test CER (+LM)
33
  type: cer
34
- value: 2.11
35
  - task:
36
  name: Automatic Speech Recognition
37
  type: automatic-speech-recognition
@@ -56,7 +56,12 @@ model-index:
56
 
57
  # XLS-R-1B-ITALIAN
58
 
59
- This model is a fine-tuned version of [facebook/wav2vec2-xls-r-1b](https://huggingface.co/facebook/wav2vec2-xls-r-1b) on the MOZILLA-FOUNDATION/COMMON_VOICE_8_0 - IT dataset.
 
 
 
 
 
60
 
61
 
62
  ## Evaluation Commands
 
22
  metrics:
23
  - name: Test WER
24
  type: wer
25
+ value: 9.04
26
  - name: Test CER
27
  type: cer
28
+ value: 2.20
29
  - name: Test WER (+LM)
30
  type: wer
31
+ value: 6.75
32
  - name: Test CER (+LM)
33
  type: cer
34
+ value: 1.76
35
  - task:
36
  name: Automatic Speech Recognition
37
  type: automatic-speech-recognition
 
56
 
57
  # XLS-R-1B-ITALIAN
58
 
59
+ Fine-tuned [facebook/wav2vec2-xls-r-1b](https://huggingface.co/facebook/wav2vec2-xls-r-1b) on Italian using the [Common Voice 8](https://huggingface.co/datasets/mozilla-foundation/common_voice_8_0).
60
+ When using this model, make sure that your speech input is sampled at 16kHz.
61
+
62
+ This model has been fine-tuned thanks to the GPU credits generously given by the [OVHcloud](https://www.ovhcloud.com/en/public-cloud/ai-training/) :)
63
+
64
+ The script used for training can be found here: https://github.com/jonatasgrosman/wav2vec2-sprint
65
 
66
 
67
  ## Evaluation Commands
log_mozilla-foundation_common_voice_8_0_it_test_predictions.txt CHANGED
The diff for this file is too large to render. See raw diff
 
log_mozilla-foundation_common_voice_8_0_it_test_predictions_greedy.txt CHANGED
The diff for this file is too large to render. See raw diff
 
mozilla-foundation_common_voice_8_0_it_test_eval_results.txt CHANGED
@@ -1,2 +1,2 @@
1
- WER: 0.07597760028374793
2
- CER: 0.021155387890476704
 
1
+ WER: 0.0675129084844723
2
+ CER: 0.01761353561922042
mozilla-foundation_common_voice_8_0_it_test_eval_results_greedy.txt CHANGED
@@ -1,2 +1,2 @@
1
- WER: 0.10066230586116814
2
- CER: 0.025768715741336004
 
1
+ WER: 0.09043783123819138
2
+ CER: 0.022088713826821264