marinone94 commited on
Commit
074846f
1 Parent(s): 70717e9

update model card README.md

Browse files
Files changed (1) hide show
  1. README.md +16 -7
README.md CHANGED
@@ -1,6 +1,7 @@
1
  ---
2
  language:
3
- - ab
 
4
  tags:
5
  - automatic-speech-recognition
6
  - mozilla-foundation/common_voice_7_0
@@ -17,10 +18,10 @@ should probably proofread and complete it, then remove this comment. -->
17
 
18
  #
19
 
20
- This model is a fine-tuned version of [hf-test/xls-r-dummy](https://huggingface.co/hf-test/xls-r-dummy) on the MOZILLA-FOUNDATION/COMMON_VOICE_7_0 - AB dataset.
21
  It achieves the following results on the evaluation set:
22
- - Loss: 156.8789
23
- - Wer: 1.3456
24
 
25
  ## Model description
26
 
@@ -39,17 +40,25 @@ More information needed
39
  ### Training hyperparameters
40
 
41
  The following hyperparameters were used during training:
42
- - learning_rate: 0.0003
43
- - train_batch_size: 2
44
  - eval_batch_size: 8
45
  - seed: 42
 
 
46
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
47
  - lr_scheduler_type: linear
48
- - training_steps: 10
 
49
  - mixed_precision_training: Native AMP
50
 
51
  ### Training results
52
 
 
 
 
 
 
53
 
54
 
55
  ### Framework versions
 
1
  ---
2
  language:
3
+ - sv-SE
4
+ license: apache-2.0
5
  tags:
6
  - automatic-speech-recognition
7
  - mozilla-foundation/common_voice_7_0
 
18
 
19
  #
20
 
21
+ This model is a fine-tuned version of [facebook/wav2vec2-xls-r-300m](https://huggingface.co/facebook/wav2vec2-xls-r-300m) on the MOZILLA-FOUNDATION/COMMON_VOICE_7_0 - SV-SE dataset.
22
  It achieves the following results on the evaluation set:
23
+ - Loss: 1.5563
24
+ - Wer: 0.9487
25
 
26
  ## Model description
27
 
 
40
  ### Training hyperparameters
41
 
42
  The following hyperparameters were used during training:
43
+ - learning_rate: 7.5e-05
44
+ - train_batch_size: 8
45
  - eval_batch_size: 8
46
  - seed: 42
47
+ - gradient_accumulation_steps: 4
48
+ - total_train_batch_size: 32
49
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
50
  - lr_scheduler_type: linear
51
+ - lr_scheduler_warmup_steps: 20
52
+ - num_epochs: 5.0
53
  - mixed_precision_training: Native AMP
54
 
55
  ### Training results
56
 
57
+ | Training Loss | Epoch | Step | Validation Loss | Wer |
58
+ |:-------------:|:-----:|:----:|:---------------:|:------:|
59
+ | 2.9069 | 1.45 | 500 | 2.9047 | 1.0 |
60
+ | 2.5875 | 2.91 | 1000 | 2.4159 | 1.1997 |
61
+ | 2.2043 | 4.36 | 1500 | 1.6192 | 0.9598 |
62
 
63
 
64
  ### Framework versions