jonatasgrosman commited on
Commit
7102579
1 Parent(s): 3446090

update evaluation

Browse files
README.md CHANGED
@@ -22,16 +22,16 @@ model-index:
22
  metrics:
23
  - name: Test WER
24
  type: wer
25
- value: 16.52
26
  - name: Test CER
27
  type: cer
28
- value: 4.62
29
  - name: Test WER (+LM)
30
  type: wer
31
- value: 12.46
32
  - name: Test CER (+LM)
33
  type: cer
34
- value: 3.98
35
  - task:
36
  name: Automatic Speech Recognition
37
  type: automatic-speech-recognition
@@ -56,8 +56,12 @@ model-index:
56
 
57
  # XLS-R-1B-RUSSIAN
58
 
59
- This model is a fine-tuned version of [facebook/wav2vec2-xls-r-1b](https://huggingface.co/facebook/wav2vec2-xls-r-1b) on the MOZILLA-FOUNDATION/COMMON_VOICE_8_0 - RU dataset.
 
60
 
 
 
 
61
 
62
  ## Evaluation Commands
63
 
22
  metrics:
23
  - name: Test WER
24
  type: wer
25
+ value: 9.82
26
  - name: Test CER
27
  type: cer
28
+ value: 2.30
29
  - name: Test WER (+LM)
30
  type: wer
31
+ value: 7.08
32
  - name: Test CER (+LM)
33
  type: cer
34
+ value: 1.87
35
  - task:
36
  name: Automatic Speech Recognition
37
  type: automatic-speech-recognition
56
 
57
  # XLS-R-1B-RUSSIAN
58
 
59
+ Fine-tuned [facebook/wav2vec2-xls-r-1b](https://huggingface.co/facebook/wav2vec2-xls-r-1b) on Russian using the [Common Voice 8](https://huggingface.co/datasets/mozilla-foundation/common_voice_8_0).
60
+ When using this model, make sure that your speech input is sampled at 16kHz.
61
 
62
+ This model has been fine-tuned thanks to the GPU credits generously given by the [OVHcloud](https://www.ovhcloud.com/en/public-cloud/ai-training/) :)
63
+
64
+ The script used for training can be found here: https://github.com/jonatasgrosman/wav2vec2-sprint
65
 
66
  ## Evaluation Commands
67
 
log_mozilla-foundation_common_voice_8_0_ru_test_predictions.txt CHANGED
The diff for this file is too large to render. See raw diff
log_mozilla-foundation_common_voice_8_0_ru_test_predictions_greedy.txt CHANGED
The diff for this file is too large to render. See raw diff
mozilla-foundation_common_voice_8_0_ru_test_eval_results.txt CHANGED
@@ -1,2 +1,2 @@
1
- WER: 0.12460567823343849
2
- CER: 0.039853492631028165
1
+ WER: 0.07080805629701528
2
+ CER: 0.018761424513993267
mozilla-foundation_common_voice_8_0_ru_test_eval_results_greedy.txt CHANGED
@@ -1,2 +1,2 @@
1
- WER: 0.16526328561028877
2
- CER: 0.04621616676669796
1
+ WER: 0.098277117204562
2
+ CER: 0.023070464777870683