Commit
•
e7d7787
1
Parent(s):
23b7998
Model save
Browse files
README.md
CHANGED
|
@@ -2,8 +2,6 @@
|
|
| 2 |
license: apache-2.0
|
| 3 |
base_model: facebook/wav2vec2-large-xlsr-53
|
| 4 |
tags:
|
| 5 |
-
- automatic-speech-recognition
|
| 6 |
-
- DewiBrynJones/banc-trawsgrifiadau-bangor-clean-with-ccv
|
| 7 |
- generated_from_trainer
|
| 8 |
metrics:
|
| 9 |
- wer
|
|
@@ -17,10 +15,10 @@ should probably proofread and complete it, then remove this comment. -->
|
|
| 17 |
|
| 18 |
# wav2vec2-xlsr-53-ft-btb-ccv-cy
|
| 19 |
|
| 20 |
-
This model is a fine-tuned version of [facebook/wav2vec2-large-xlsr-53](https://huggingface.co/facebook/wav2vec2-large-xlsr-53) on
|
| 21 |
It achieves the following results on the evaluation set:
|
| 22 |
-
- Loss: 0.
|
| 23 |
-
- Wer: 0.
|
| 24 |
|
| 25 |
## Model description
|
| 26 |
|
|
@@ -46,318 +44,118 @@ The following hyperparameters were used during training:
|
|
| 46 |
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
|
| 47 |
- lr_scheduler_type: linear
|
| 48 |
- lr_scheduler_warmup_steps: 500
|
| 49 |
-
- training_steps:
|
| 50 |
- mixed_precision_training: Native AMP
|
| 51 |
|
| 52 |
### Training results
|
| 53 |
|
| 54 |
| Training Loss | Epoch | Step | Validation Loss | Wer |
|
| 55 |
|:-------------:|:------:|:-----:|:---------------:|:------:|
|
| 56 |
-
| No log | 0.0194 | 100 | 3.
|
| 57 |
-
| No log | 0.0387 | 200 | 3.
|
| 58 |
-
| No log | 0.0581 | 300 |
|
| 59 |
-
| No log | 0.0774 | 400 | 2.
|
| 60 |
-
| 4.
|
| 61 |
-
| 4.
|
| 62 |
-
| 4.
|
| 63 |
-
| 4.
|
| 64 |
-
| 4.
|
| 65 |
-
| 1.
|
| 66 |
-
| 1.
|
| 67 |
-
| 1.
|
| 68 |
-
| 1.
|
| 69 |
-
| 1.
|
| 70 |
-
| 0.
|
| 71 |
-
| 0.
|
| 72 |
-
| 0.
|
| 73 |
-
| 0.
|
| 74 |
-
| 0.
|
| 75 |
-
| 0.
|
| 76 |
-
| 0.
|
| 77 |
-
| 0.
|
| 78 |
-
| 0.
|
| 79 |
-
| 0.
|
| 80 |
-
| 0.
|
| 81 |
-
| 0.
|
| 82 |
-
| 0.
|
| 83 |
-
| 0.
|
| 84 |
-
| 0.
|
| 85 |
-
| 0.
|
| 86 |
-
| 0.
|
| 87 |
-
| 0.
|
| 88 |
-
| 0.
|
| 89 |
-
| 0.
|
| 90 |
-
| 0.
|
| 91 |
-
| 0.
|
| 92 |
-
| 0.
|
| 93 |
-
| 0.
|
| 94 |
-
| 0.
|
| 95 |
-
| 0.
|
| 96 |
-
| 0.
|
| 97 |
-
| 0.
|
| 98 |
-
| 0.
|
| 99 |
-
| 0.
|
| 100 |
-
| 0.
|
| 101 |
-
| 0.
|
| 102 |
-
| 0.
|
| 103 |
-
| 0.
|
| 104 |
-
| 0.
|
| 105 |
-
| 0.
|
| 106 |
-
| 0.
|
| 107 |
-
| 0.
|
| 108 |
-
| 0.
|
| 109 |
-
| 0.
|
| 110 |
-
| 0.
|
| 111 |
-
| 0.
|
| 112 |
-
| 0.
|
| 113 |
-
| 0.
|
| 114 |
-
| 0.
|
| 115 |
-
| 0.
|
| 116 |
-
| 0.
|
| 117 |
-
| 0.
|
| 118 |
-
| 0.
|
| 119 |
-
| 0.
|
| 120 |
-
| 0.
|
| 121 |
-
| 0.
|
| 122 |
-
| 0.
|
| 123 |
-
| 0.
|
| 124 |
-
| 0.
|
| 125 |
-
| 0.
|
| 126 |
-
| 0.
|
| 127 |
-
| 0.
|
| 128 |
-
| 0.
|
| 129 |
-
| 0.
|
| 130 |
-
| 0.
|
| 131 |
-
| 0.
|
| 132 |
-
| 0.
|
| 133 |
-
| 0.
|
| 134 |
-
| 0.
|
| 135 |
-
| 0.
|
| 136 |
-
| 0.
|
| 137 |
-
| 0.
|
| 138 |
-
| 0.
|
| 139 |
-
| 0.
|
| 140 |
-
| 0.
|
| 141 |
-
| 0.
|
| 142 |
-
| 0.
|
| 143 |
-
| 0.
|
| 144 |
-
| 0.
|
| 145 |
-
| 0.
|
| 146 |
-
| 0.
|
| 147 |
-
| 0.
|
| 148 |
-
| 0.
|
| 149 |
-
| 0.
|
| 150 |
-
| 0.
|
| 151 |
-
| 0.
|
| 152 |
-
| 0.
|
| 153 |
-
| 0.
|
| 154 |
-
| 0.
|
| 155 |
-
| 0.
|
| 156 |
-
| 0.4752 | 1.9551 | 10100 | 0.4891 | 0.3783 |
|
| 157 |
-
| 0.4752 | 1.9744 | 10200 | 0.4787 | 0.3783 |
|
| 158 |
-
| 0.4752 | 1.9938 | 10300 | 0.4726 | 0.3714 |
|
| 159 |
-
| 0.4752 | 2.0132 | 10400 | 0.4917 | 0.3732 |
|
| 160 |
-
| 0.4587 | 2.0325 | 10500 | 0.4802 | 0.3726 |
|
| 161 |
-
| 0.4587 | 2.0519 | 10600 | 0.4884 | 0.3825 |
|
| 162 |
-
| 0.4587 | 2.0712 | 10700 | 0.4841 | 0.3785 |
|
| 163 |
-
| 0.4587 | 2.0906 | 10800 | 0.4809 | 0.3738 |
|
| 164 |
-
| 0.4587 | 2.1099 | 10900 | 0.4797 | 0.3713 |
|
| 165 |
-
| 0.3967 | 2.1293 | 11000 | 0.4866 | 0.3750 |
|
| 166 |
-
| 0.3967 | 2.1487 | 11100 | 0.4938 | 0.3749 |
|
| 167 |
-
| 0.3967 | 2.1680 | 11200 | 0.4860 | 0.3680 |
|
| 168 |
-
| 0.3967 | 2.1874 | 11300 | 0.4849 | 0.3700 |
|
| 169 |
-
| 0.3967 | 2.2067 | 11400 | 0.4908 | 0.3638 |
|
| 170 |
-
| 0.406 | 2.2261 | 11500 | 0.4797 | 0.3679 |
|
| 171 |
-
| 0.406 | 2.2455 | 11600 | 0.4812 | 0.3759 |
|
| 172 |
-
| 0.406 | 2.2648 | 11700 | 0.4704 | 0.3613 |
|
| 173 |
-
| 0.406 | 2.2842 | 11800 | 0.4716 | 0.3635 |
|
| 174 |
-
| 0.406 | 2.3035 | 11900 | 0.4677 | 0.3635 |
|
| 175 |
-
| 0.4088 | 2.3229 | 12000 | 0.4705 | 0.3640 |
|
| 176 |
-
| 0.4088 | 2.3422 | 12100 | 0.4782 | 0.3591 |
|
| 177 |
-
| 0.4088 | 2.3616 | 12200 | 0.4796 | 0.3613 |
|
| 178 |
-
| 0.4088 | 2.3810 | 12300 | 0.4713 | 0.3558 |
|
| 179 |
-
| 0.4088 | 2.4003 | 12400 | 0.4763 | 0.3589 |
|
| 180 |
-
| 0.407 | 2.4197 | 12500 | 0.4690 | 0.3565 |
|
| 181 |
-
| 0.407 | 2.4390 | 12600 | 0.4686 | 0.3577 |
|
| 182 |
-
| 0.407 | 2.4584 | 12700 | 0.4677 | 0.3584 |
|
| 183 |
-
| 0.407 | 2.4777 | 12800 | 0.4614 | 0.3577 |
|
| 184 |
-
| 0.407 | 2.4971 | 12900 | 0.4558 | 0.3599 |
|
| 185 |
-
| 0.3855 | 2.5165 | 13000 | 0.4556 | 0.3565 |
|
| 186 |
-
| 0.3855 | 2.5358 | 13100 | 0.4601 | 0.3558 |
|
| 187 |
-
| 0.3855 | 2.5552 | 13200 | 0.4650 | 0.3543 |
|
| 188 |
-
| 0.3855 | 2.5745 | 13300 | 0.4737 | 0.3548 |
|
| 189 |
-
| 0.3855 | 2.5939 | 13400 | 0.4506 | 0.3534 |
|
| 190 |
-
| 0.3748 | 2.6132 | 13500 | 0.4607 | 0.3589 |
|
| 191 |
-
| 0.3748 | 2.6326 | 13600 | 0.4549 | 0.3537 |
|
| 192 |
-
| 0.3748 | 2.6520 | 13700 | 0.4563 | 0.3641 |
|
| 193 |
-
| 0.3748 | 2.6713 | 13800 | 0.4467 | 0.3437 |
|
| 194 |
-
| 0.3748 | 2.6907 | 13900 | 0.4536 | 0.3545 |
|
| 195 |
-
| 0.3888 | 2.7100 | 14000 | 0.4504 | 0.3510 |
|
| 196 |
-
| 0.3888 | 2.7294 | 14100 | 0.4470 | 0.3602 |
|
| 197 |
-
| 0.3888 | 2.7487 | 14200 | 0.4564 | 0.3539 |
|
| 198 |
-
| 0.3888 | 2.7681 | 14300 | 0.4521 | 0.3562 |
|
| 199 |
-
| 0.3888 | 2.7875 | 14400 | 0.4453 | 0.3522 |
|
| 200 |
-
| 0.376 | 2.8068 | 14500 | 0.4552 | 0.3517 |
|
| 201 |
-
| 0.376 | 2.8262 | 14600 | 0.4534 | 0.3550 |
|
| 202 |
-
| 0.376 | 2.8455 | 14700 | 0.4552 | 0.3405 |
|
| 203 |
-
| 0.376 | 2.8649 | 14800 | 0.4556 | 0.3514 |
|
| 204 |
-
| 0.376 | 2.8842 | 14900 | 0.4423 | 0.3468 |
|
| 205 |
-
| 0.379 | 2.9036 | 15000 | 0.4387 | 0.3427 |
|
| 206 |
-
| 0.379 | 2.9230 | 15100 | 0.4373 | 0.3436 |
|
| 207 |
-
| 0.379 | 2.9423 | 15200 | 0.4399 | 0.3387 |
|
| 208 |
-
| 0.379 | 2.9617 | 15300 | 0.4438 | 0.3380 |
|
| 209 |
-
| 0.379 | 2.9810 | 15400 | 0.4370 | 0.3431 |
|
| 210 |
-
| 0.3731 | 3.0004 | 15500 | 0.4381 | 0.3341 |
|
| 211 |
-
| 0.3731 | 3.0197 | 15600 | 0.4514 | 0.3286 |
|
| 212 |
-
| 0.3731 | 3.0391 | 15700 | 0.4378 | 0.3340 |
|
| 213 |
-
| 0.3731 | 3.0585 | 15800 | 0.4434 | 0.3441 |
|
| 214 |
-
| 0.3731 | 3.0778 | 15900 | 0.4419 | 0.3399 |
|
| 215 |
-
| 0.3176 | 3.0972 | 16000 | 0.4408 | 0.3335 |
|
| 216 |
-
| 0.3176 | 3.1165 | 16100 | 0.4368 | 0.3358 |
|
| 217 |
-
| 0.3176 | 3.1359 | 16200 | 0.4478 | 0.3401 |
|
| 218 |
-
| 0.3176 | 3.1552 | 16300 | 0.4414 | 0.3374 |
|
| 219 |
-
| 0.3176 | 3.1746 | 16400 | 0.4477 | 0.3350 |
|
| 220 |
-
| 0.3201 | 3.1940 | 16500 | 0.4306 | 0.3292 |
|
| 221 |
-
| 0.3201 | 3.2133 | 16600 | 0.4535 | 0.3294 |
|
| 222 |
-
| 0.3201 | 3.2327 | 16700 | 0.4380 | 0.3341 |
|
| 223 |
-
| 0.3201 | 3.2520 | 16800 | 0.4368 | 0.3325 |
|
| 224 |
-
| 0.3201 | 3.2714 | 16900 | 0.4360 | 0.3304 |
|
| 225 |
-
| 0.3101 | 3.2907 | 17000 | 0.4347 | 0.3281 |
|
| 226 |
-
| 0.3101 | 3.3101 | 17100 | 0.4375 | 0.3285 |
|
| 227 |
-
| 0.3101 | 3.3295 | 17200 | 0.4492 | 0.3303 |
|
| 228 |
-
| 0.3101 | 3.3488 | 17300 | 0.4268 | 0.3285 |
|
| 229 |
-
| 0.3101 | 3.3682 | 17400 | 0.4377 | 0.3270 |
|
| 230 |
-
| 0.2963 | 3.3875 | 17500 | 0.4249 | 0.3323 |
|
| 231 |
-
| 0.2963 | 3.4069 | 17600 | 0.4405 | 0.3339 |
|
| 232 |
-
| 0.2963 | 3.4262 | 17700 | 0.4364 | 0.3286 |
|
| 233 |
-
| 0.2963 | 3.4456 | 17800 | 0.4351 | 0.3309 |
|
| 234 |
-
| 0.2963 | 3.4650 | 17900 | 0.4300 | 0.3229 |
|
| 235 |
-
| 0.3062 | 3.4843 | 18000 | 0.4231 | 0.3252 |
|
| 236 |
-
| 0.3062 | 3.5037 | 18100 | 0.4326 | 0.3233 |
|
| 237 |
-
| 0.3062 | 3.5230 | 18200 | 0.4314 | 0.3282 |
|
| 238 |
-
| 0.3062 | 3.5424 | 18300 | 0.4344 | 0.3289 |
|
| 239 |
-
| 0.3062 | 3.5617 | 18400 | 0.4266 | 0.3221 |
|
| 240 |
-
| 0.2968 | 3.5811 | 18500 | 0.4306 | 0.3216 |
|
| 241 |
-
| 0.2968 | 3.6005 | 18600 | 0.4319 | 0.3239 |
|
| 242 |
-
| 0.2968 | 3.6198 | 18700 | 0.4271 | 0.3232 |
|
| 243 |
-
| 0.2968 | 3.6392 | 18800 | 0.4184 | 0.3264 |
|
| 244 |
-
| 0.2968 | 3.6585 | 18900 | 0.4238 | 0.3200 |
|
| 245 |
-
| 0.3191 | 3.6779 | 19000 | 0.4139 | 0.3226 |
|
| 246 |
-
| 0.3191 | 3.6973 | 19100 | 0.4238 | 0.3160 |
|
| 247 |
-
| 0.3191 | 3.7166 | 19200 | 0.4176 | 0.3193 |
|
| 248 |
-
| 0.3191 | 3.7360 | 19300 | 0.4196 | 0.3203 |
|
| 249 |
-
| 0.3191 | 3.7553 | 19400 | 0.4095 | 0.3182 |
|
| 250 |
-
| 0.2921 | 3.7747 | 19500 | 0.4121 | 0.3167 |
|
| 251 |
-
| 0.2921 | 3.7940 | 19600 | 0.4113 | 0.3146 |
|
| 252 |
-
| 0.2921 | 3.8134 | 19700 | 0.4094 | 0.3161 |
|
| 253 |
-
| 0.2921 | 3.8328 | 19800 | 0.4093 | 0.3139 |
|
| 254 |
-
| 0.2921 | 3.8521 | 19900 | 0.4112 | 0.3173 |
|
| 255 |
-
| 0.3007 | 3.8715 | 20000 | 0.4093 | 0.3159 |
|
| 256 |
-
| 0.3007 | 3.8908 | 20100 | 0.4148 | 0.3157 |
|
| 257 |
-
| 0.3007 | 3.9102 | 20200 | 0.4114 | 0.3150 |
|
| 258 |
-
| 0.3007 | 3.9295 | 20300 | 0.4155 | 0.3146 |
|
| 259 |
-
| 0.3007 | 3.9489 | 20400 | 0.4076 | 0.3136 |
|
| 260 |
-
| 0.296 | 3.9683 | 20500 | 0.4067 | 0.3126 |
|
| 261 |
-
| 0.296 | 3.9876 | 20600 | 0.4084 | 0.3150 |
|
| 262 |
-
| 0.296 | 4.0070 | 20700 | 0.4150 | 0.3124 |
|
| 263 |
-
| 0.296 | 4.0263 | 20800 | 0.4132 | 0.3133 |
|
| 264 |
-
| 0.296 | 4.0457 | 20900 | 0.4183 | 0.3146 |
|
| 265 |
-
| 0.2611 | 4.0650 | 21000 | 0.4184 | 0.3095 |
|
| 266 |
-
| 0.2611 | 4.0844 | 21100 | 0.4168 | 0.3085 |
|
| 267 |
-
| 0.2611 | 4.1038 | 21200 | 0.4224 | 0.3102 |
|
| 268 |
-
| 0.2611 | 4.1231 | 21300 | 0.4187 | 0.3046 |
|
| 269 |
-
| 0.2611 | 4.1425 | 21400 | 0.4145 | 0.3110 |
|
| 270 |
-
| 0.2431 | 4.1618 | 21500 | 0.4272 | 0.3107 |
|
| 271 |
-
| 0.2431 | 4.1812 | 21600 | 0.4174 | 0.3070 |
|
| 272 |
-
| 0.2431 | 4.2005 | 21700 | 0.4190 | 0.3086 |
|
| 273 |
-
| 0.2431 | 4.2199 | 21800 | 0.4164 | 0.3051 |
|
| 274 |
-
| 0.2431 | 4.2393 | 21900 | 0.4196 | 0.3078 |
|
| 275 |
-
| 0.2453 | 4.2586 | 22000 | 0.4249 | 0.3092 |
|
| 276 |
-
| 0.2453 | 4.2780 | 22100 | 0.4246 | 0.3074 |
|
| 277 |
-
| 0.2453 | 4.2973 | 22200 | 0.4166 | 0.3074 |
|
| 278 |
-
| 0.2453 | 4.3167 | 22300 | 0.4192 | 0.3028 |
|
| 279 |
-
| 0.2453 | 4.3360 | 22400 | 0.4186 | 0.3021 |
|
| 280 |
-
| 0.2336 | 4.3554 | 22500 | 0.4268 | 0.3084 |
|
| 281 |
-
| 0.2336 | 4.3748 | 22600 | 0.4347 | 0.3071 |
|
| 282 |
-
| 0.2336 | 4.3941 | 22700 | 0.4753 | 0.3209 |
|
| 283 |
-
| 0.2336 | 4.4135 | 22800 | 0.5824 | 0.4154 |
|
| 284 |
-
| 0.2336 | 4.4328 | 22900 | 0.5074 | 0.3415 |
|
| 285 |
-
| 0.3426 | 4.4522 | 23000 | 0.6242 | 0.4198 |
|
| 286 |
-
| 0.3426 | 4.4715 | 23100 | 0.5862 | 0.4201 |
|
| 287 |
-
| 0.3426 | 4.4909 | 23200 | 0.6151 | 0.3964 |
|
| 288 |
-
| 0.3426 | 4.5103 | 23300 | 0.5640 | 0.3686 |
|
| 289 |
-
| 0.3426 | 4.5296 | 23400 | 0.6590 | 0.4647 |
|
| 290 |
-
| 0.4541 | 4.5490 | 23500 | 0.6011 | 0.3960 |
|
| 291 |
-
| 0.4541 | 4.5683 | 23600 | 0.5803 | 0.3951 |
|
| 292 |
-
| 0.4541 | 4.5877 | 23700 | 0.5763 | 0.3911 |
|
| 293 |
-
| 0.4541 | 4.6070 | 23800 | 0.5418 | 0.3655 |
|
| 294 |
-
| 0.4541 | 4.6264 | 23900 | 0.5547 | 0.3888 |
|
| 295 |
-
| 0.4145 | 4.6458 | 24000 | 0.5301 | 0.3608 |
|
| 296 |
-
| 0.4145 | 4.6651 | 24100 | 0.5739 | 0.3993 |
|
| 297 |
-
| 0.4145 | 4.6845 | 24200 | 0.5776 | 0.3982 |
|
| 298 |
-
| 0.4145 | 4.7038 | 24300 | 0.5412 | 0.3708 |
|
| 299 |
-
| 0.4145 | 4.7232 | 24400 | 0.5329 | 0.3704 |
|
| 300 |
-
| 0.3834 | 4.7425 | 24500 | 0.5299 | 0.3732 |
|
| 301 |
-
| 0.3834 | 4.7619 | 24600 | 0.5425 | 0.3929 |
|
| 302 |
-
| 0.3834 | 4.7813 | 24700 | 0.5111 | 0.3585 |
|
| 303 |
-
| 0.3834 | 4.8006 | 24800 | 0.5076 | 0.3503 |
|
| 304 |
-
| 0.3834 | 4.8200 | 24900 | 0.5262 | 0.3681 |
|
| 305 |
-
| 0.3719 | 4.8393 | 25000 | 0.5474 | 0.3833 |
|
| 306 |
-
| 0.3719 | 4.8587 | 25100 | 0.5747 | 0.4039 |
|
| 307 |
-
| 0.3719 | 4.8780 | 25200 | 0.5188 | 0.3503 |
|
| 308 |
-
| 0.3719 | 4.8974 | 25300 | 0.5523 | 0.3866 |
|
| 309 |
-
| 0.3719 | 4.9168 | 25400 | 0.5302 | 0.3645 |
|
| 310 |
-
| 0.3798 | 4.9361 | 25500 | 0.5099 | 0.3500 |
|
| 311 |
-
| 0.3798 | 4.9555 | 25600 | 0.4823 | 0.3376 |
|
| 312 |
-
| 0.3798 | 4.9748 | 25700 | 0.4806 | 0.3357 |
|
| 313 |
-
| 0.3798 | 4.9942 | 25800 | 0.4943 | 0.3509 |
|
| 314 |
-
| 0.3798 | 5.0136 | 25900 | 0.4953 | 0.3525 |
|
| 315 |
-
| 0.3158 | 5.0329 | 26000 | 0.4853 | 0.3470 |
|
| 316 |
-
| 0.3158 | 5.0523 | 26100 | 0.5205 | 0.3618 |
|
| 317 |
-
| 0.3158 | 5.0716 | 26200 | 0.5013 | 0.3510 |
|
| 318 |
-
| 0.3158 | 5.0910 | 26300 | 0.4863 | 0.3397 |
|
| 319 |
-
| 0.3158 | 5.1103 | 26400 | 0.4715 | 0.3285 |
|
| 320 |
-
| 0.2993 | 5.1297 | 26500 | 0.4816 | 0.3327 |
|
| 321 |
-
| 0.2993 | 5.1491 | 26600 | 0.4806 | 0.3381 |
|
| 322 |
-
| 0.2993 | 5.1684 | 26700 | 0.4854 | 0.3342 |
|
| 323 |
-
| 0.2993 | 5.1878 | 26800 | 0.4955 | 0.3433 |
|
| 324 |
-
| 0.2993 | 5.2071 | 26900 | 0.4863 | 0.3434 |
|
| 325 |
-
| 0.2902 | 5.2265 | 27000 | 0.4867 | 0.3449 |
|
| 326 |
-
| 0.2902 | 5.2458 | 27100 | 0.4787 | 0.3378 |
|
| 327 |
-
| 0.2902 | 5.2652 | 27200 | 0.4862 | 0.3379 |
|
| 328 |
-
| 0.2902 | 5.2846 | 27300 | 0.4954 | 0.3468 |
|
| 329 |
-
| 0.2902 | 5.3039 | 27400 | 0.5726 | 0.4142 |
|
| 330 |
-
| 0.305 | 5.3233 | 27500 | 0.5180 | 0.3574 |
|
| 331 |
-
| 0.305 | 5.3426 | 27600 | 0.4997 | 0.3452 |
|
| 332 |
-
| 0.305 | 5.3620 | 27700 | 0.4950 | 0.3413 |
|
| 333 |
-
| 0.305 | 5.3813 | 27800 | 0.5071 | 0.3492 |
|
| 334 |
-
| 0.305 | 5.4007 | 27900 | 0.5096 | 0.3545 |
|
| 335 |
-
| 0.3163 | 5.4201 | 28000 | 0.5129 | 0.3566 |
|
| 336 |
-
| 0.3163 | 5.4394 | 28100 | 0.5067 | 0.3506 |
|
| 337 |
-
| 0.3163 | 5.4588 | 28200 | 0.5053 | 0.3500 |
|
| 338 |
-
| 0.3163 | 5.4781 | 28300 | 0.5078 | 0.3519 |
|
| 339 |
-
| 0.3163 | 5.4975 | 28400 | 0.4845 | 0.3375 |
|
| 340 |
-
| 0.3136 | 5.5168 | 28500 | 0.4930 | 0.3440 |
|
| 341 |
-
| 0.3136 | 5.5362 | 28600 | 0.5026 | 0.3512 |
|
| 342 |
-
| 0.3136 | 5.5556 | 28700 | 0.5056 | 0.3519 |
|
| 343 |
-
| 0.3136 | 5.5749 | 28800 | 0.5091 | 0.3546 |
|
| 344 |
-
| 0.3136 | 5.5943 | 28900 | 0.5028 | 0.3495 |
|
| 345 |
-
| 0.3092 | 5.6136 | 29000 | 0.5057 | 0.3510 |
|
| 346 |
-
| 0.3092 | 5.6330 | 29100 | 0.5086 | 0.3533 |
|
| 347 |
-
| 0.3092 | 5.6523 | 29200 | 0.5055 | 0.3514 |
|
| 348 |
-
| 0.3092 | 5.6717 | 29300 | 0.5133 | 0.3577 |
|
| 349 |
-
| 0.3092 | 5.6911 | 29400 | 0.5130 | 0.3570 |
|
| 350 |
-
| 0.3152 | 5.7104 | 29500 | 0.5148 | 0.3581 |
|
| 351 |
-
| 0.3152 | 5.7298 | 29600 | 0.5115 | 0.3555 |
|
| 352 |
-
| 0.3152 | 5.7491 | 29700 | 0.5054 | 0.3526 |
|
| 353 |
-
| 0.3152 | 5.7685 | 29800 | 0.5081 | 0.3536 |
|
| 354 |
-
| 0.3152 | 5.7878 | 29900 | 0.5077 | 0.3535 |
|
| 355 |
-
| 0.3085 | 5.8072 | 30000 | 0.5067 | 0.3522 |
|
| 356 |
|
| 357 |
|
| 358 |
### Framework versions
|
| 359 |
|
| 360 |
-
- Transformers 4.
|
| 361 |
-
- Pytorch 2.3.
|
| 362 |
-
- Datasets 2.19.
|
| 363 |
- Tokenizers 0.19.1
|
|
|
|
| 2 |
license: apache-2.0
|
| 3 |
base_model: facebook/wav2vec2-large-xlsr-53
|
| 4 |
tags:
|
|
|
|
|
|
|
| 5 |
- generated_from_trainer
|
| 6 |
metrics:
|
| 7 |
- wer
|
|
|
|
| 15 |
|
| 16 |
# wav2vec2-xlsr-53-ft-btb-ccv-cy
|
| 17 |
|
| 18 |
+
This model is a fine-tuned version of [facebook/wav2vec2-large-xlsr-53](https://huggingface.co/facebook/wav2vec2-large-xlsr-53) on an unknown dataset.
|
| 19 |
It achieves the following results on the evaluation set:
|
| 20 |
+
- Loss: 0.4118
|
| 21 |
+
- Wer: 0.3219
|
| 22 |
|
| 23 |
## Model description
|
| 24 |
|
|
|
|
| 44 |
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
|
| 45 |
- lr_scheduler_type: linear
|
| 46 |
- lr_scheduler_warmup_steps: 500
|
| 47 |
+
- training_steps: 10000
|
| 48 |
- mixed_precision_training: Native AMP
|
| 49 |
|
| 50 |
### Training results
|
| 51 |
|
| 52 |
| Training Loss | Epoch | Step | Validation Loss | Wer |
|
| 53 |
|:-------------:|:------:|:-----:|:---------------:|:------:|
|
| 54 |
+
| No log | 0.0194 | 100 | 3.5728 | 1.0 |
|
| 55 |
+
| No log | 0.0387 | 200 | 3.0768 | 1.0 |
|
| 56 |
+
| No log | 0.0581 | 300 | 3.5010 | 1.0 |
|
| 57 |
+
| No log | 0.0774 | 400 | 2.0594 | 0.9900 |
|
| 58 |
+
| 4.06 | 0.0968 | 500 | 1.4703 | 0.8800 |
|
| 59 |
+
| 4.06 | 0.1161 | 600 | 1.2464 | 0.8297 |
|
| 60 |
+
| 4.06 | 0.1355 | 700 | 1.0686 | 0.7493 |
|
| 61 |
+
| 4.06 | 0.1549 | 800 | 1.0069 | 0.7116 |
|
| 62 |
+
| 4.06 | 0.1742 | 900 | 0.9367 | 0.6888 |
|
| 63 |
+
| 1.0399 | 0.1936 | 1000 | 0.8961 | 0.6742 |
|
| 64 |
+
| 1.0399 | 0.2129 | 1100 | 0.8967 | 0.6413 |
|
| 65 |
+
| 1.0399 | 0.2323 | 1200 | 0.8311 | 0.6153 |
|
| 66 |
+
| 1.0399 | 0.2516 | 1300 | 0.8019 | 0.5965 |
|
| 67 |
+
| 1.0399 | 0.2710 | 1400 | 0.7925 | 0.5927 |
|
| 68 |
+
| 0.8395 | 0.2904 | 1500 | 0.8165 | 0.5987 |
|
| 69 |
+
| 0.8395 | 0.3097 | 1600 | 0.7696 | 0.6150 |
|
| 70 |
+
| 0.8395 | 0.3291 | 1700 | 0.7455 | 0.5624 |
|
| 71 |
+
| 0.8395 | 0.3484 | 1800 | 0.7681 | 0.5684 |
|
| 72 |
+
| 0.8395 | 0.3678 | 1900 | 0.7292 | 0.5609 |
|
| 73 |
+
| 0.7574 | 0.3871 | 2000 | 0.7305 | 0.5534 |
|
| 74 |
+
| 0.7574 | 0.4065 | 2100 | 0.7096 | 0.5363 |
|
| 75 |
+
| 0.7574 | 0.4259 | 2200 | 0.7108 | 0.5572 |
|
| 76 |
+
| 0.7574 | 0.4452 | 2300 | 0.6703 | 0.5175 |
|
| 77 |
+
| 0.7574 | 0.4646 | 2400 | 0.6596 | 0.5149 |
|
| 78 |
+
| 0.6864 | 0.4839 | 2500 | 0.6846 | 0.5336 |
|
| 79 |
+
| 0.6864 | 0.5033 | 2600 | 0.6666 | 0.5286 |
|
| 80 |
+
| 0.6864 | 0.5226 | 2700 | 0.6391 | 0.4949 |
|
| 81 |
+
| 0.6864 | 0.5420 | 2800 | 0.6296 | 0.4990 |
|
| 82 |
+
| 0.6864 | 0.5614 | 2900 | 0.6292 | 0.4957 |
|
| 83 |
+
| 0.6734 | 0.5807 | 3000 | 0.6164 | 0.4765 |
|
| 84 |
+
| 0.6734 | 0.6001 | 3100 | 0.6180 | 0.4778 |
|
| 85 |
+
| 0.6734 | 0.6194 | 3200 | 0.6132 | 0.4909 |
|
| 86 |
+
| 0.6734 | 0.6388 | 3300 | 0.6107 | 0.4683 |
|
| 87 |
+
| 0.6734 | 0.6581 | 3400 | 0.6068 | 0.4749 |
|
| 88 |
+
| 0.6433 | 0.6775 | 3500 | 0.6008 | 0.4773 |
|
| 89 |
+
| 0.6433 | 0.6969 | 3600 | 0.5917 | 0.4656 |
|
| 90 |
+
| 0.6433 | 0.7162 | 3700 | 0.5885 | 0.4601 |
|
| 91 |
+
| 0.6433 | 0.7356 | 3800 | 0.5848 | 0.4482 |
|
| 92 |
+
| 0.6433 | 0.7549 | 3900 | 0.5852 | 0.4496 |
|
| 93 |
+
| 0.6217 | 0.7743 | 4000 | 0.5772 | 0.4416 |
|
| 94 |
+
| 0.6217 | 0.7937 | 4100 | 0.5671 | 0.4469 |
|
| 95 |
+
| 0.6217 | 0.8130 | 4200 | 0.5668 | 0.4463 |
|
| 96 |
+
| 0.6217 | 0.8324 | 4300 | 0.5558 | 0.4401 |
|
| 97 |
+
| 0.6217 | 0.8517 | 4400 | 0.5652 | 0.4307 |
|
| 98 |
+
| 0.5954 | 0.8711 | 4500 | 0.5561 | 0.4307 |
|
| 99 |
+
| 0.5954 | 0.8904 | 4600 | 0.5432 | 0.4206 |
|
| 100 |
+
| 0.5954 | 0.9098 | 4700 | 0.5294 | 0.4137 |
|
| 101 |
+
| 0.5954 | 0.9292 | 4800 | 0.5444 | 0.4210 |
|
| 102 |
+
| 0.5954 | 0.9485 | 4900 | 0.5291 | 0.4157 |
|
| 103 |
+
| 0.5663 | 0.9679 | 5000 | 0.5429 | 0.4140 |
|
| 104 |
+
| 0.5663 | 0.9872 | 5100 | 0.5209 | 0.4116 |
|
| 105 |
+
| 0.5663 | 1.0066 | 5200 | 0.5282 | 0.4042 |
|
| 106 |
+
| 0.5663 | 1.0259 | 5300 | 0.5118 | 0.3918 |
|
| 107 |
+
| 0.5663 | 1.0453 | 5400 | 0.5089 | 0.3993 |
|
| 108 |
+
| 0.4941 | 1.0647 | 5500 | 0.5011 | 0.3921 |
|
| 109 |
+
| 0.4941 | 1.0840 | 5600 | 0.5022 | 0.3887 |
|
| 110 |
+
| 0.4941 | 1.1034 | 5700 | 0.5066 | 0.3853 |
|
| 111 |
+
| 0.4941 | 1.1227 | 5800 | 0.4907 | 0.3815 |
|
| 112 |
+
| 0.4941 | 1.1421 | 5900 | 0.4982 | 0.3809 |
|
| 113 |
+
| 0.4628 | 1.1614 | 6000 | 0.4913 | 0.3896 |
|
| 114 |
+
| 0.4628 | 1.1808 | 6100 | 0.4826 | 0.3734 |
|
| 115 |
+
| 0.4628 | 1.2002 | 6200 | 0.4884 | 0.3740 |
|
| 116 |
+
| 0.4628 | 1.2195 | 6300 | 0.4841 | 0.3700 |
|
| 117 |
+
| 0.4628 | 1.2389 | 6400 | 0.4828 | 0.3697 |
|
| 118 |
+
| 0.4435 | 1.2582 | 6500 | 0.4816 | 0.3739 |
|
| 119 |
+
| 0.4435 | 1.2776 | 6600 | 0.4793 | 0.3674 |
|
| 120 |
+
| 0.4435 | 1.2969 | 6700 | 0.4744 | 0.3669 |
|
| 121 |
+
| 0.4435 | 1.3163 | 6800 | 0.4682 | 0.3609 |
|
| 122 |
+
| 0.4435 | 1.3357 | 6900 | 0.4628 | 0.3594 |
|
| 123 |
+
| 0.4298 | 1.3550 | 7000 | 0.4663 | 0.3554 |
|
| 124 |
+
| 0.4298 | 1.3744 | 7100 | 0.4656 | 0.3584 |
|
| 125 |
+
| 0.4298 | 1.3937 | 7200 | 0.4593 | 0.3565 |
|
| 126 |
+
| 0.4298 | 1.4131 | 7300 | 0.4599 | 0.3566 |
|
| 127 |
+
| 0.4298 | 1.4324 | 7400 | 0.4613 | 0.3521 |
|
| 128 |
+
| 0.4292 | 1.4518 | 7500 | 0.4521 | 0.3475 |
|
| 129 |
+
| 0.4292 | 1.4712 | 7600 | 0.4512 | 0.3491 |
|
| 130 |
+
| 0.4292 | 1.4905 | 7700 | 0.4478 | 0.3518 |
|
| 131 |
+
| 0.4292 | 1.5099 | 7800 | 0.4416 | 0.3421 |
|
| 132 |
+
| 0.4292 | 1.5292 | 7900 | 0.4427 | 0.3459 |
|
| 133 |
+
| 0.4072 | 1.5486 | 8000 | 0.4388 | 0.3457 |
|
| 134 |
+
| 0.4072 | 1.5679 | 8100 | 0.4401 | 0.3453 |
|
| 135 |
+
| 0.4072 | 1.5873 | 8200 | 0.4365 | 0.3434 |
|
| 136 |
+
| 0.4072 | 1.6067 | 8300 | 0.4346 | 0.3397 |
|
| 137 |
+
| 0.4072 | 1.6260 | 8400 | 0.4325 | 0.3360 |
|
| 138 |
+
| 0.3991 | 1.6454 | 8500 | 0.4320 | 0.3358 |
|
| 139 |
+
| 0.3991 | 1.6647 | 8600 | 0.4287 | 0.3355 |
|
| 140 |
+
| 0.3991 | 1.6841 | 8700 | 0.4293 | 0.3334 |
|
| 141 |
+
| 0.3991 | 1.7034 | 8800 | 0.4272 | 0.3333 |
|
| 142 |
+
| 0.3991 | 1.7228 | 8900 | 0.4220 | 0.3303 |
|
| 143 |
+
| 0.3916 | 1.7422 | 9000 | 0.4238 | 0.3292 |
|
| 144 |
+
| 0.3916 | 1.7615 | 9100 | 0.4215 | 0.3281 |
|
| 145 |
+
| 0.3916 | 1.7809 | 9200 | 0.4177 | 0.3266 |
|
| 146 |
+
| 0.3916 | 1.8002 | 9300 | 0.4188 | 0.3257 |
|
| 147 |
+
| 0.3916 | 1.8196 | 9400 | 0.4164 | 0.3247 |
|
| 148 |
+
| 0.3687 | 1.8389 | 9500 | 0.4163 | 0.3243 |
|
| 149 |
+
| 0.3687 | 1.8583 | 9600 | 0.4140 | 0.3239 |
|
| 150 |
+
| 0.3687 | 1.8777 | 9700 | 0.4132 | 0.3247 |
|
| 151 |
+
| 0.3687 | 1.8970 | 9800 | 0.4122 | 0.3224 |
|
| 152 |
+
| 0.3687 | 1.9164 | 9900 | 0.4117 | 0.3219 |
|
| 153 |
+
| 0.3707 | 1.9357 | 10000 | 0.4118 | 0.3219 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 154 |
|
| 155 |
|
| 156 |
### Framework versions
|
| 157 |
|
| 158 |
+
- Transformers 4.41.2
|
| 159 |
+
- Pytorch 2.3.1+cu121
|
| 160 |
+
- Datasets 2.19.2
|
| 161 |
- Tokenizers 0.19.1
|