abbenedek commited on
Commit
11db9cd
1 Parent(s): 4b25dc8

End of training

Browse files
Files changed (3) hide show
  1. README.md +71 -0
  2. generation_config.json +137 -0
  3. model.safetensors +1 -1
README.md ADDED
@@ -0,0 +1,71 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ base_model: openai/whisper-base.en
4
+ tags:
5
+ - generated_from_trainer
6
+ metrics:
7
+ - wer
8
+ model-index:
9
+ - name: abbenedekwhisper-base.en-finetuning2-D3K
10
+ results: []
11
+ ---
12
+
13
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
14
+ should probably proofread and complete it, then remove this comment. -->
15
+
16
+ # abbenedekwhisper-base.en-finetuning2-D3K
17
+
18
+ This model is a fine-tuned version of [openai/whisper-base.en](https://huggingface.co/openai/whisper-base.en) on the None dataset.
19
+ It achieves the following results on the evaluation set:
20
+ - Loss: 6.9927
21
+ - Cer: 63.0495
22
+ - Wer: 127.1523
23
+ - Ser: 100.0
24
+ - Cer Clean: 4.3406
25
+ - Wer Clean: 7.2848
26
+ - Ser Clean: 9.6491
27
+
28
+ ## Model description
29
+
30
+ More information needed
31
+
32
+ ## Intended uses & limitations
33
+
34
+ More information needed
35
+
36
+ ## Training and evaluation data
37
+
38
+ More information needed
39
+
40
+ ## Training procedure
41
+
42
+ ### Training hyperparameters
43
+
44
+ The following hyperparameters were used during training:
45
+ - learning_rate: 1e-08
46
+ - train_batch_size: 16
47
+ - eval_batch_size: 64
48
+ - seed: 42
49
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
50
+ - lr_scheduler_type: linear
51
+ - lr_scheduler_warmup_steps: 5
52
+ - training_steps: 100
53
+ - mixed_precision_training: Native AMP
54
+
55
+ ### Training results
56
+
57
+ | Training Loss | Epoch | Step | Validation Loss | Cer | Wer | Ser | Cer Clean | Wer Clean | Ser Clean |
58
+ |:-------------:|:-----:|:----:|:---------------:|:-------:|:--------:|:-----:|:---------:|:---------:|:---------:|
59
+ | 7.8089 | 0.11 | 20 | 6.9970 | 63.0495 | 127.1523 | 100.0 | 4.3406 | 7.2848 | 9.6491 |
60
+ | 7.653 | 0.21 | 40 | 6.9963 | 63.3834 | 127.4834 | 100.0 | 4.6745 | 7.6159 | 10.5263 |
61
+ | 7.6425 | 0.32 | 60 | 6.9951 | 63.3834 | 127.4834 | 100.0 | 4.6745 | 7.6159 | 10.5263 |
62
+ | 7.6689 | 0.43 | 80 | 6.9952 | 63.0495 | 127.1523 | 100.0 | 4.3406 | 7.2848 | 9.6491 |
63
+ | 7.6972 | 0.53 | 100 | 6.9927 | 63.0495 | 127.1523 | 100.0 | 4.3406 | 7.2848 | 9.6491 |
64
+
65
+
66
+ ### Framework versions
67
+
68
+ - Transformers 4.39.3
69
+ - Pytorch 2.2.2+cu121
70
+ - Datasets 2.14.5
71
+ - Tokenizers 0.15.2
generation_config.json ADDED
@@ -0,0 +1,137 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "alignment_heads": [
3
+ [
4
+ 3,
5
+ 3
6
+ ],
7
+ [
8
+ 4,
9
+ 7
10
+ ],
11
+ [
12
+ 5,
13
+ 1
14
+ ],
15
+ [
16
+ 5,
17
+ 5
18
+ ],
19
+ [
20
+ 5,
21
+ 7
22
+ ]
23
+ ],
24
+ "begin_suppress_tokens": [
25
+ 220,
26
+ 50256
27
+ ],
28
+ "bos_token_id": 50257,
29
+ "decoder_start_token_id": 50257,
30
+ "eos_token_id": 50256,
31
+ "forced_decoder_ids": [
32
+ [
33
+ 1,
34
+ 50362
35
+ ]
36
+ ],
37
+ "is_multilingual": false,
38
+ "max_initial_timestamp_index": 50,
39
+ "max_length": 448,
40
+ "no_timestamps_token_id": 50362,
41
+ "pad_token_id": 50256,
42
+ "prev_sot_token_id": 50360,
43
+ "return_timestamps": false,
44
+ "suppress_tokens": [
45
+ 1,
46
+ 2,
47
+ 7,
48
+ 8,
49
+ 9,
50
+ 10,
51
+ 14,
52
+ 25,
53
+ 26,
54
+ 27,
55
+ 28,
56
+ 29,
57
+ 31,
58
+ 58,
59
+ 59,
60
+ 60,
61
+ 61,
62
+ 62,
63
+ 63,
64
+ 90,
65
+ 91,
66
+ 92,
67
+ 93,
68
+ 357,
69
+ 366,
70
+ 438,
71
+ 532,
72
+ 685,
73
+ 705,
74
+ 796,
75
+ 930,
76
+ 1058,
77
+ 1220,
78
+ 1267,
79
+ 1279,
80
+ 1303,
81
+ 1343,
82
+ 1377,
83
+ 1391,
84
+ 1635,
85
+ 1782,
86
+ 1875,
87
+ 2162,
88
+ 2361,
89
+ 2488,
90
+ 3467,
91
+ 4008,
92
+ 4211,
93
+ 4600,
94
+ 4808,
95
+ 5299,
96
+ 5855,
97
+ 6329,
98
+ 7203,
99
+ 9609,
100
+ 9959,
101
+ 10563,
102
+ 10786,
103
+ 11420,
104
+ 11709,
105
+ 11907,
106
+ 13163,
107
+ 13697,
108
+ 13700,
109
+ 14808,
110
+ 15306,
111
+ 16410,
112
+ 16791,
113
+ 17992,
114
+ 19203,
115
+ 19510,
116
+ 20724,
117
+ 22305,
118
+ 22935,
119
+ 27007,
120
+ 30109,
121
+ 30420,
122
+ 33409,
123
+ 34949,
124
+ 40283,
125
+ 40493,
126
+ 40549,
127
+ 47282,
128
+ 49146,
129
+ 50257,
130
+ 50357,
131
+ 50358,
132
+ 50359,
133
+ 50360,
134
+ 50361
135
+ ],
136
+ "transformers_version": "4.39.3"
137
+ }
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:64b021fde8ded304c7acf50bae8a5df0870e4b10d596fec7c688575161e5b362
3
  size 290401888
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:47d0e710bca1ce2e5743ec3917a1ccdc5e2a327e84b6313884a110ddb340dc84
3
  size 290401888