sqrk commited on
Commit
41a5810
·
verified ·
1 Parent(s): 03cb0d8

End of training

Browse files
Files changed (3) hide show
  1. README.md +159 -7
  2. adapter.uaspeech-eng.safetensors +1 -1
  3. model.safetensors +1 -1
README.md CHANGED
@@ -3,6 +3,8 @@ license: cc-by-nc-4.0
3
  base_model: facebook/mms-1b-all
4
  tags:
5
  - generated_from_trainer
 
 
6
  model-index:
7
  - name: uaspeech-mms1ball-Nov30
8
  results: []
@@ -15,13 +17,8 @@ should probably proofread and complete it, then remove this comment. -->
15
 
16
  This model is a fine-tuned version of [facebook/mms-1b-all](https://huggingface.co/facebook/mms-1b-all) on an unknown dataset.
17
  It achieves the following results on the evaluation set:
18
- - eval_loss: 1.1373
19
- - eval_wer: 0.5222
20
- - eval_runtime: 219.0768
21
- - eval_samples_per_second: 23.978
22
- - eval_steps_per_second: 5.998
23
- - epoch: 0.9455
24
- - step: 14900
25
 
26
  ## Model description
27
 
@@ -50,6 +47,161 @@ The following hyperparameters were used during training:
50
  - num_epochs: 100
51
  - mixed_precision_training: Native AMP
52
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
53
  ### Framework versions
54
 
55
  - Transformers 4.43.4
 
3
  base_model: facebook/mms-1b-all
4
  tags:
5
  - generated_from_trainer
6
+ metrics:
7
+ - wer
8
  model-index:
9
  - name: uaspeech-mms1ball-Nov30
10
  results: []
 
17
 
18
  This model is a fine-tuned version of [facebook/mms-1b-all](https://huggingface.co/facebook/mms-1b-all) on an unknown dataset.
19
  It achieves the following results on the evaluation set:
20
+ - Loss: 1.1373
21
+ - Wer: 0.5222
 
 
 
 
 
22
 
23
  ## Model description
24
 
 
47
  - num_epochs: 100
48
  - mixed_precision_training: Native AMP
49
 
50
+ ### Training results
51
+
52
+ | Training Loss | Epoch | Step | Validation Loss | Wer |
53
+ |:-------------:|:------:|:-----:|:---------------:|:------:|
54
+ | 45.2252 | 0.0063 | 100 | 3.7562 | 1.0 |
55
+ | 2.9851 | 0.0127 | 200 | 2.0328 | 0.8281 |
56
+ | 2.0067 | 0.0190 | 300 | 1.8614 | 0.6848 |
57
+ | 2.1249 | 0.0254 | 400 | 2.0929 | 0.7247 |
58
+ | 1.8786 | 0.0317 | 500 | 1.6966 | 0.6522 |
59
+ | 1.8295 | 0.0381 | 600 | 1.6550 | 0.6579 |
60
+ | 1.8186 | 0.0444 | 700 | 1.6961 | 0.6457 |
61
+ | 1.839 | 0.0508 | 800 | 1.7019 | 0.6642 |
62
+ | 1.8854 | 0.0571 | 900 | 1.6492 | 0.6455 |
63
+ | 2.0186 | 0.0635 | 1000 | 1.5746 | 0.6682 |
64
+ | 1.8061 | 0.0698 | 1100 | 1.5590 | 0.6345 |
65
+ | 1.6994 | 0.0761 | 1200 | 1.6544 | 0.6509 |
66
+ | 1.6444 | 0.0825 | 1300 | 1.6297 | 0.6115 |
67
+ | 1.7308 | 0.0888 | 1400 | 1.7002 | 0.6337 |
68
+ | 1.8179 | 0.0952 | 1500 | 1.5325 | 0.6179 |
69
+ | 1.7174 | 0.1015 | 1600 | 1.5668 | 0.6343 |
70
+ | 1.7043 | 0.1079 | 1700 | 1.5762 | 0.6415 |
71
+ | 1.5174 | 0.1142 | 1800 | 1.4478 | 0.5991 |
72
+ | 1.6108 | 0.1206 | 1900 | 1.4394 | 0.6054 |
73
+ | 1.6227 | 0.1269 | 2000 | 1.5185 | 0.5964 |
74
+ | 1.773 | 0.1333 | 2100 | 1.6450 | 0.6124 |
75
+ | 1.6231 | 0.1396 | 2200 | 1.3599 | 0.6016 |
76
+ | 1.6005 | 0.1459 | 2300 | 1.3782 | 0.5943 |
77
+ | 1.524 | 0.1523 | 2400 | 1.6099 | 0.5953 |
78
+ | 1.5881 | 0.1586 | 2500 | 1.4681 | 0.6160 |
79
+ | 1.5577 | 0.1650 | 2600 | 1.3934 | 0.6052 |
80
+ | 1.5556 | 0.1713 | 2700 | 1.3960 | 0.6099 |
81
+ | 1.609 | 0.1777 | 2800 | 1.4837 | 0.6008 |
82
+ | 1.3661 | 0.1840 | 2900 | 1.2992 | 0.5800 |
83
+ | 1.4908 | 0.1904 | 3000 | 1.3942 | 0.5844 |
84
+ | 1.6022 | 0.1967 | 3100 | 1.4685 | 0.5907 |
85
+ | 1.7082 | 0.2031 | 3200 | 1.4685 | 0.6214 |
86
+ | 1.5526 | 0.2094 | 3300 | 1.4331 | 0.6038 |
87
+ | 1.4424 | 0.2157 | 3400 | 1.3674 | 0.5791 |
88
+ | 1.3544 | 0.2221 | 3500 | 1.3960 | 0.5882 |
89
+ | 1.4868 | 0.2284 | 3600 | 1.3507 | 0.5882 |
90
+ | 1.5313 | 0.2348 | 3700 | 1.5923 | 0.5764 |
91
+ | 1.5763 | 0.2411 | 3800 | 1.3493 | 0.5681 |
92
+ | 1.3742 | 0.2475 | 3900 | 1.3979 | 0.5827 |
93
+ | 1.5003 | 0.2538 | 4000 | 1.4011 | 0.5886 |
94
+ | 1.5894 | 0.2602 | 4100 | 1.3652 | 0.5519 |
95
+ | 1.5496 | 0.2665 | 4200 | 1.2970 | 0.5860 |
96
+ | 1.6228 | 0.2729 | 4300 | 1.4056 | 0.5753 |
97
+ | 1.4173 | 0.2792 | 4400 | 1.3485 | 0.5515 |
98
+ | 1.5236 | 0.2856 | 4500 | 1.2558 | 0.5473 |
99
+ | 1.3976 | 0.2919 | 4600 | 1.3535 | 0.5505 |
100
+ | 1.4656 | 0.2982 | 4700 | 1.3634 | 0.5865 |
101
+ | 1.4089 | 0.3046 | 4800 | 1.3172 | 0.5458 |
102
+ | 1.2844 | 0.3109 | 4900 | 1.3553 | 0.5606 |
103
+ | 1.3984 | 0.3173 | 5000 | 1.2458 | 0.5679 |
104
+ | 1.4784 | 0.3236 | 5100 | 1.3808 | 0.5484 |
105
+ | 1.4339 | 0.3300 | 5200 | 1.3194 | 0.5578 |
106
+ | 1.6029 | 0.3363 | 5300 | 1.3393 | 0.5631 |
107
+ | 1.4778 | 0.3427 | 5400 | 1.3053 | 0.5639 |
108
+ | 1.5093 | 0.3490 | 5500 | 1.2234 | 0.5445 |
109
+ | 1.5348 | 0.3554 | 5600 | 1.2514 | 0.5583 |
110
+ | 1.5195 | 0.3617 | 5700 | 1.2954 | 0.5561 |
111
+ | 1.5035 | 0.3680 | 5800 | 1.1854 | 0.5435 |
112
+ | 1.532 | 0.3744 | 5900 | 1.2768 | 0.5486 |
113
+ | 1.5833 | 0.3807 | 6000 | 1.3575 | 0.5547 |
114
+ | 1.4789 | 0.3871 | 6100 | 1.2984 | 0.5418 |
115
+ | 1.3557 | 0.3934 | 6200 | 1.2763 | 0.5326 |
116
+ | 1.2738 | 0.3998 | 6300 | 1.3761 | 0.5351 |
117
+ | 1.454 | 0.4061 | 6400 | 1.3057 | 0.5325 |
118
+ | 1.403 | 0.4125 | 6500 | 1.3707 | 0.5662 |
119
+ | 1.5306 | 0.4188 | 6600 | 1.3330 | 0.5583 |
120
+ | 1.4576 | 0.4252 | 6700 | 1.2403 | 0.5349 |
121
+ | 1.4214 | 0.4315 | 6800 | 1.3175 | 0.5363 |
122
+ | 1.5853 | 0.4378 | 6900 | 1.2071 | 0.5281 |
123
+ | 1.522 | 0.4442 | 7000 | 1.2593 | 0.5387 |
124
+ | 1.2743 | 0.4505 | 7100 | 1.3154 | 0.5549 |
125
+ | 1.3778 | 0.4569 | 7200 | 1.2544 | 0.5365 |
126
+ | 1.2875 | 0.4632 | 7300 | 1.2312 | 0.5281 |
127
+ | 1.3484 | 0.4696 | 7400 | 1.2599 | 0.5340 |
128
+ | 1.5618 | 0.4759 | 7500 | 1.3038 | 0.5568 |
129
+ | 1.4391 | 0.4823 | 7600 | 1.2523 | 0.5355 |
130
+ | 1.4676 | 0.4886 | 7700 | 1.2205 | 0.5311 |
131
+ | 1.371 | 0.4950 | 7800 | 1.1996 | 0.5275 |
132
+ | 1.361 | 0.5013 | 7900 | 1.1635 | 0.5186 |
133
+ | 1.463 | 0.5076 | 8000 | 1.2232 | 0.5344 |
134
+ | 1.348 | 0.5140 | 8100 | 1.1407 | 0.5174 |
135
+ | 1.4943 | 0.5203 | 8200 | 1.3098 | 0.5361 |
136
+ | 1.3703 | 0.5267 | 8300 | 1.1393 | 0.5226 |
137
+ | 1.4188 | 0.5330 | 8400 | 1.1914 | 0.4995 |
138
+ | 1.3048 | 0.5394 | 8500 | 1.1555 | 0.5170 |
139
+ | 1.4468 | 0.5457 | 8600 | 1.1515 | 0.5149 |
140
+ | 1.2279 | 0.5521 | 8700 | 1.2047 | 0.5168 |
141
+ | 1.2367 | 0.5584 | 8800 | 1.1868 | 0.5208 |
142
+ | 1.3536 | 0.5648 | 8900 | 1.1398 | 0.5189 |
143
+ | 1.3496 | 0.5711 | 9000 | 1.2705 | 0.5176 |
144
+ | 1.4915 | 0.5774 | 9100 | 1.2007 | 0.5079 |
145
+ | 1.474 | 0.5838 | 9200 | 1.2192 | 0.5378 |
146
+ | 1.3093 | 0.5901 | 9300 | 1.1065 | 0.5125 |
147
+ | 1.1994 | 0.5965 | 9400 | 1.2120 | 0.5201 |
148
+ | 1.502 | 0.6028 | 9500 | 1.1464 | 0.5290 |
149
+ | 1.5327 | 0.6092 | 9600 | 1.2010 | 0.5384 |
150
+ | 1.4533 | 0.6155 | 9700 | 1.1614 | 0.5146 |
151
+ | 1.4554 | 0.6219 | 9800 | 1.1353 | 0.5155 |
152
+ | 1.3605 | 0.6282 | 9900 | 1.1788 | 0.5058 |
153
+ | 1.3606 | 0.6346 | 10000 | 1.1877 | 0.5178 |
154
+ | 1.3295 | 0.6409 | 10100 | 1.2601 | 0.5452 |
155
+ | 1.4172 | 0.6472 | 10200 | 1.1926 | 0.5083 |
156
+ | 1.4859 | 0.6536 | 10300 | 1.1426 | 0.5077 |
157
+ | 1.5264 | 0.6599 | 10400 | 1.1495 | 0.5121 |
158
+ | 1.3455 | 0.6663 | 10500 | 1.1535 | 0.5140 |
159
+ | 1.2375 | 0.6726 | 10600 | 1.1857 | 0.5087 |
160
+ | 1.2808 | 0.6790 | 10700 | 1.2156 | 0.5005 |
161
+ | 1.3358 | 0.6853 | 10800 | 1.1543 | 0.5075 |
162
+ | 1.361 | 0.6917 | 10900 | 1.2553 | 0.5290 |
163
+ | 1.3859 | 0.6980 | 11000 | 1.1458 | 0.5245 |
164
+ | 1.5061 | 0.7044 | 11100 | 1.1547 | 0.5399 |
165
+ | 1.2777 | 0.7107 | 11200 | 1.1677 | 0.5180 |
166
+ | 1.2645 | 0.7171 | 11300 | 1.2715 | 0.5191 |
167
+ | 1.3514 | 0.7234 | 11400 | 1.1811 | 0.5109 |
168
+ | 1.2733 | 0.7297 | 11500 | 1.1079 | 0.5134 |
169
+ | 1.2961 | 0.7361 | 11600 | 1.3171 | 0.5188 |
170
+ | 1.3744 | 0.7424 | 11700 | 1.1271 | 0.5106 |
171
+ | 1.2626 | 0.7488 | 11800 | 1.0821 | 0.5001 |
172
+ | 1.317 | 0.7551 | 11900 | 1.1156 | 0.5037 |
173
+ | 1.1732 | 0.7615 | 12000 | 1.1828 | 0.5287 |
174
+ | 1.3693 | 0.7678 | 12100 | 1.1063 | 0.5172 |
175
+ | 1.3227 | 0.7742 | 12200 | 1.1450 | 0.4948 |
176
+ | 1.41 | 0.7805 | 12300 | 1.0917 | 0.5079 |
177
+ | 1.2909 | 0.7869 | 12400 | 1.1321 | 0.5066 |
178
+ | 1.1509 | 0.7932 | 12500 | 1.1678 | 0.4921 |
179
+ | 1.3629 | 0.7995 | 12600 | 1.1482 | 0.4923 |
180
+ | 1.2959 | 0.8059 | 12700 | 1.1488 | 0.5064 |
181
+ | 1.3537 | 0.8122 | 12800 | 1.1356 | 0.5014 |
182
+ | 1.1468 | 0.8186 | 12900 | 1.0872 | 0.4970 |
183
+ | 1.3582 | 0.8249 | 13000 | 1.1221 | 0.4913 |
184
+ | 1.3872 | 0.8313 | 13100 | 1.2243 | 0.4925 |
185
+ | 1.4433 | 0.8376 | 13200 | 1.1536 | 0.5205 |
186
+ | 1.4121 | 0.8440 | 13300 | 1.1322 | 0.5050 |
187
+ | 1.0979 | 0.8503 | 13400 | 1.1252 | 0.4927 |
188
+ | 1.3989 | 0.8567 | 13500 | 1.0632 | 0.5035 |
189
+ | 1.1527 | 0.8630 | 13600 | 1.1041 | 0.4942 |
190
+ | 1.167 | 0.8693 | 13700 | 1.0895 | 0.4913 |
191
+ | 1.3945 | 0.8757 | 13800 | 1.1256 | 0.5050 |
192
+ | 1.2615 | 0.8820 | 13900 | 1.1768 | 0.5226 |
193
+ | 1.3221 | 0.8884 | 14000 | 1.2068 | 0.5050 |
194
+ | 1.4254 | 0.8947 | 14100 | 1.1757 | 0.5028 |
195
+ | 1.1403 | 0.9011 | 14200 | 1.1589 | 0.5161 |
196
+ | 1.304 | 0.9074 | 14300 | 1.1399 | 0.5140 |
197
+ | 1.3728 | 0.9138 | 14400 | 1.0997 | 0.5132 |
198
+ | 1.4233 | 0.9201 | 14500 | 1.0702 | 0.4948 |
199
+ | 1.1177 | 0.9265 | 14600 | 1.0930 | 0.4936 |
200
+ | 1.186 | 0.9328 | 14700 | 1.1956 | 0.4919 |
201
+ | 1.3834 | 0.9391 | 14800 | 1.1244 | 0.5007 |
202
+ | 1.3236 | 0.9455 | 14900 | 1.1373 | 0.5222 |
203
+
204
+
205
  ### Framework versions
206
 
207
  - Transformers 4.43.4
adapter.uaspeech-eng.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d60a13efb3ecf5450bfd517f2fdae87bf9923f4153d0a70dc055ee19d8218e1f
3
  size 8798532
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0ce4a51c2fa3973d077d5bbe349ad42cc260ddd12a9d4e9f188361a9d3c1c496
3
  size 8798532
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:563e5da66901860cdb1833f2811004f37c4b84a5e9aadfd73b92bdcef928f277
3
  size 3858890924
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:682c8fce5131be0ba16298fa1a0a750ccbcd8e321dc4ccab5b0917f46e564839
3
  size 3858890924