1rsh commited on
Commit
b73b51a
1 Parent(s): 95de290

End of training

Browse files
README.md ADDED
@@ -0,0 +1,79 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - gu
4
+ license: apache-2.0
5
+ base_model: openai/whisper-small
6
+ tags:
7
+ - hf-asr-leaderboard
8
+ - generated_from_trainer
9
+ datasets:
10
+ - 1rsh/gujarati-openslr
11
+ metrics:
12
+ - wer
13
+ model-index:
14
+ - name: Whisper Small Gujarati OpenSLR
15
+ results:
16
+ - task:
17
+ name: Automatic Speech Recognition
18
+ type: automatic-speech-recognition
19
+ dataset:
20
+ name: Gujarati OpenSLR
21
+ type: 1rsh/gujarati-openslr
22
+ args: 'split: train'
23
+ metrics:
24
+ - name: Wer
25
+ type: wer
26
+ value: 35.325794291868604
27
+ ---
28
+
29
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
30
+ should probably proofread and complete it, then remove this comment. -->
31
+
32
+ # Whisper Small Gujarati OpenSLR
33
+
34
+ This model is a fine-tuned version of [openai/whisper-small](https://huggingface.co/openai/whisper-small) on the Gujarati OpenSLR dataset.
35
+ It achieves the following results on the evaluation set:
36
+ - Loss: 0.0472
37
+ - Wer: 35.3258
38
+ - Cer: 22.3685
39
+
40
+ ## Model description
41
+
42
+ More information needed
43
+
44
+ ## Intended uses & limitations
45
+
46
+ More information needed
47
+
48
+ ## Training and evaluation data
49
+
50
+ More information needed
51
+
52
+ ## Training procedure
53
+
54
+ ### Training hyperparameters
55
+
56
+ The following hyperparameters were used during training:
57
+ - learning_rate: 1e-05
58
+ - train_batch_size: 16
59
+ - eval_batch_size: 8
60
+ - seed: 42
61
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
62
+ - lr_scheduler_type: linear
63
+ - lr_scheduler_warmup_steps: 500
64
+ - num_epochs: 5
65
+ - mixed_precision_training: Native AMP
66
+
67
+ ### Training results
68
+
69
+ | Training Loss | Epoch | Step | Validation Loss | Wer | Cer |
70
+ |:-------------:|:------:|:----:|:---------------:|:-------:|:-------:|
71
+ | 0.0018 | 4.9505 | 1000 | 0.0472 | 35.3258 | 22.3685 |
72
+
73
+
74
+ ### Framework versions
75
+
76
+ - Transformers 4.41.2
77
+ - Pytorch 2.3.0+cu121
78
+ - Datasets 2.20.0
79
+ - Tokenizers 0.19.1
generation_config.json ADDED
@@ -0,0 +1,28 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "begin_suppress_tokens": [
3
+ 220,
4
+ 50257
5
+ ],
6
+ "bos_token_id": 50257,
7
+ "decoder_start_token_id": 50258,
8
+ "eos_token_id": 50257,
9
+ "forced_decoder_ids": [
10
+ [
11
+ 1,
12
+ 50333
13
+ ],
14
+ [
15
+ 2,
16
+ 50359
17
+ ],
18
+ [
19
+ 3,
20
+ 50363
21
+ ]
22
+ ],
23
+ "max_length": 448,
24
+ "pad_token_id": 50257,
25
+ "suppress_tokens": [],
26
+ "transformers_version": "4.41.2",
27
+ "use_cache": false
28
+ }
runs/Jun21_18-52-07_9df806dc0345/events.out.tfevents.1718995938.9df806dc0345.881.1 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d3731164d265ecc9cedad6f7eb817621b78b1d8039fc1a1bf2031babac74c5f1
3
- size 14538
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f548104d83e604716b2ceeb9120557e7965c9ecb96c1cb67d65da00c62d5d519
3
+ size 14892
runs/Jun21_18-52-07_9df806dc0345/events.out.tfevents.1719002071.9df806dc0345.881.2 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4c56c2d7cacb34d4d0e99e41cd4757b139b9ea3d80f2ea4dc5dd4abd8f912af6
3
+ size 453