kostissz commited on
Commit
4022dae
·
verified ·
1 Parent(s): 5b4778e

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +20 -80
README.md CHANGED
@@ -1,95 +1,35 @@
1
  ---
2
- library_name: transformers
3
- license: apache-2.0
4
  base_model: openai/whisper-small
5
- tags:
6
- - generated_from_trainer
7
  datasets:
8
- - common_voice_17_0
9
- metrics:
10
- - wer
 
11
  model-index:
12
- - name: whisper-small-gl
13
  results:
14
  - task:
15
- name: Automatic Speech Recognition
16
  type: automatic-speech-recognition
 
17
  dataset:
18
- name: common_voice_17_0
19
- type: common_voice_17_0
20
- config: gl
21
- split: None
22
- args: gl
23
  metrics:
24
- - name: Wer
25
- type: wer
26
- value: 13.681457327541507
27
  ---
28
 
29
- <!-- This model card has been generated automatically according to the information the Trainer had access to. You
30
- should probably proofread and complete it, then remove this comment. -->
31
-
32
- # whisper-small-gl
33
-
34
- This model is a fine-tuned version of [openai/whisper-small](https://huggingface.co/openai/whisper-small) on the common_voice_17_0 dataset.
35
- It achieves the following results on the evaluation set:
36
- - Loss: 0.2102
37
- - Model Preparation Time: 0.0048
38
- - Wer: 13.6815
39
-
40
- ## Model description
41
-
42
- More information needed
43
-
44
- ## Intended uses & limitations
45
-
46
- More information needed
47
-
48
- ## Training and evaluation data
49
-
50
- More information needed
51
-
52
- ## Training procedure
53
-
54
- ### Training hyperparameters
55
-
56
- The following hyperparameters were used during training:
57
- - learning_rate: 1e-05
58
- - train_batch_size: 16
59
- - eval_batch_size: 8
60
- - seed: 42
61
- - gradient_accumulation_steps: 2
62
- - total_train_batch_size: 32
63
- - optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
64
- - lr_scheduler_type: linear
65
- - lr_scheduler_warmup_steps: 50
66
- - training_steps: 1500
67
- - mixed_precision_training: Native AMP
68
-
69
- ### Training results
70
 
71
- | Training Loss | Epoch | Step | Validation Loss | Model Preparation Time | Wer |
72
- |:-------------:|:------:|:----:|:---------------:|:----------------------:|:-------:|
73
- | 0.6456 | 0.0910 | 100 | 0.3671 | 0.0048 | 22.6031 |
74
- | 0.3198 | 0.1821 | 200 | 0.3064 | 0.0048 | 19.2674 |
75
- | 0.2694 | 0.2731 | 300 | 0.2810 | 0.0048 | 17.8548 |
76
- | 0.2549 | 0.3641 | 400 | 0.2612 | 0.0048 | 16.6173 |
77
- | 0.2284 | 0.4552 | 500 | 0.2510 | 0.0048 | 16.0931 |
78
- | 0.2298 | 0.5462 | 600 | 0.2402 | 0.0048 | 15.4248 |
79
- | 0.2229 | 0.6372 | 700 | 0.2325 | 0.0048 | 15.1667 |
80
- | 0.2116 | 0.7283 | 800 | 0.2254 | 0.0048 | 14.8106 |
81
- | 0.2093 | 0.8193 | 900 | 0.2208 | 0.0048 | 14.4523 |
82
- | 0.199 | 0.9103 | 1000 | 0.2168 | 0.0048 | 14.2172 |
83
- | 0.1881 | 1.0009 | 1100 | 0.2140 | 0.0048 | 14.0444 |
84
- | 0.1189 | 1.0919 | 1200 | 0.2128 | 0.0048 | 13.8969 |
85
- | 0.118 | 1.1830 | 1300 | 0.2108 | 0.0048 | 14.2841 |
86
- | 0.1149 | 1.2740 | 1400 | 0.2107 | 0.0048 | 13.9568 |
87
- | 0.1141 | 1.3650 | 1500 | 0.2102 | 0.0048 | 13.6815 |
88
 
 
89
 
90
- ### Framework versions
 
 
91
 
92
- - Transformers 4.49.0
93
- - Pytorch 2.6.0+cu124
94
- - Datasets 3.3.1
95
- - Tokenizers 0.21.0
 
1
  ---
 
 
2
  base_model: openai/whisper-small
 
 
3
  datasets:
4
+ - mozilla-foundation/common_voice_17_0
5
+ language: gl
6
+ library_name: transformers
7
+ license: apache-2.0
8
  model-index:
9
+ - name: Finetuned openai/whisper-small on Galician
10
  results:
11
  - task:
 
12
  type: automatic-speech-recognition
13
+ name: Speech-to-Text
14
  dataset:
15
+ name: Common Voice (Galician)
16
+ type: common_voice
 
 
 
17
  metrics:
18
+ - type: wer
19
+ value: 13.681
 
20
  ---
21
 
22
+ # Finetuned openai/whisper-small on 35141 Galician training audio samples from mozilla-foundation/common_voice_17_0.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
23
 
24
+ This model was created from the Mozilla.ai Blueprint:
25
+ [speech-to-text-finetune](https://github.com/mozilla-ai/speech-to-text-finetune).
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
26
 
27
+ ## Evaluation results on 9990 audio samples of Galician:
28
 
29
+ ### Baseline model (before finetuning) on Galician
30
+ - Word Error Rate: 40.812
31
+ - Loss: 1.506
32
 
33
+ ### Finetuned model (after finetuning) on Galician
34
+ - Word Error Rate: 13.681
35
+ - Loss: 0.21