|
--- |
|
license: apache-2.0 |
|
base_model: openai/whisper-tiny |
|
tags: |
|
- generated_from_trainer |
|
model-index: |
|
- name: whisper-tiny-kor-430k-hf-ep100 |
|
results: [] |
|
--- |
|
|
|
<!-- This model card has been generated automatically according to the information the Trainer had access to. You |
|
should probably proofread and complete it, then remove this comment. --> |
|
|
|
# whisper-tiny-kor-430k-hf-ep100 |
|
|
|
This model is a fine-tuned version of [openai/whisper-tiny](https://huggingface.co/openai/whisper-tiny) on the None dataset. |
|
It achieves the following results on the evaluation set: |
|
- Loss: 0.4802 |
|
- Cer: 7.0810 |
|
|
|
## Model description |
|
|
|
More information needed |
|
|
|
## Intended uses & limitations |
|
|
|
More information needed |
|
|
|
## Training and evaluation data |
|
|
|
More information needed |
|
|
|
## Training procedure |
|
|
|
### Training hyperparameters |
|
|
|
The following hyperparameters were used during training: |
|
- learning_rate: 5e-05 |
|
- train_batch_size: 128 |
|
- eval_batch_size: 32 |
|
- seed: 42 |
|
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08 |
|
- lr_scheduler_type: linear |
|
- lr_scheduler_warmup_steps: 500 |
|
- num_epochs: 100 |
|
- mixed_precision_training: Native AMP |
|
|
|
### Training results |
|
|
|
| Training Loss | Epoch | Step | Validation Loss | Cer | |
|
|:-------------:|:-----:|:------:|:---------------:|:-------:| |
|
| 0.0276 | 1.0 | 2969 | 0.1394 | 10.5081 | |
|
| 0.0115 | 2.0 | 5938 | 0.1684 | 9.0941 | |
|
| 0.0082 | 3.0 | 8907 | 0.1932 | 8.4145 | |
|
| 0.0063 | 4.0 | 11876 | 0.2197 | 7.8659 | |
|
| 0.0052 | 5.0 | 14845 | 0.2516 | 7.7668 | |
|
| 0.0047 | 6.0 | 17814 | 0.2314 | 8.0565 | |
|
| 0.004 | 7.0 | 20783 | 0.2270 | 8.3521 | |
|
| 0.0037 | 8.0 | 23752 | 0.2540 | 7.8283 | |
|
| 0.0033 | 9.0 | 26721 | 0.2586 | 7.9098 | |
|
| 0.0028 | 10.0 | 29690 | 0.2891 | 7.4437 | |
|
| 0.0029 | 11.0 | 32659 | 0.2796 | 7.7976 | |
|
| 0.0025 | 12.0 | 35628 | 0.2630 | 8.2731 | |
|
| 0.0025 | 13.0 | 38597 | 0.2955 | 7.8518 | |
|
| 0.0025 | 14.0 | 41566 | 0.2812 | 7.4797 | |
|
| 0.002 | 15.0 | 44535 | 0.2859 | 7.9954 | |
|
| 0.0023 | 16.0 | 47504 | 0.3172 | 7.2374 | |
|
| 0.002 | 17.0 | 50473 | 0.3382 | 7.5966 | |
|
| 0.0018 | 18.0 | 53442 | 0.3320 | 7.6383 | |
|
| 0.0018 | 19.0 | 56411 | 0.3197 | 7.6900 | |
|
| 0.0015 | 20.0 | 59380 | 0.3305 | 8.3678 | |
|
| 0.0016 | 21.0 | 62349 | 0.3409 | 7.5117 | |
|
| 0.0015 | 22.0 | 65318 | 0.3382 | 7.8556 | |
|
| 0.0016 | 23.0 | 68287 | 0.3282 | 7.5863 | |
|
| 0.0015 | 24.0 | 71256 | 0.3220 | 8.2449 | |
|
| 0.0013 | 25.0 | 74225 | 0.3272 | 7.7731 | |
|
| 0.0015 | 26.0 | 77194 | 0.3557 | 7.8019 | |
|
| 0.0014 | 27.0 | 80163 | 0.3807 | 7.3311 | |
|
| 0.0012 | 28.0 | 83132 | 0.3398 | 7.8117 | |
|
| 0.0013 | 29.0 | 86101 | 0.3892 | 7.6089 | |
|
| 0.001 | 30.0 | 89070 | 0.3876 | 7.7875 | |
|
| 0.0011 | 31.0 | 92039 | 0.3942 | 7.3922 | |
|
| 0.0012 | 32.0 | 95008 | 0.3836 | 8.0308 | |
|
| 0.0011 | 33.0 | 97977 | 0.3745 | 7.9775 | |
|
| 0.001 | 34.0 | 100946 | 0.3605 | 8.0117 | |
|
| 0.001 | 35.0 | 103915 | 0.3615 | 7.4853 | |
|
| 0.001 | 36.0 | 106884 | 0.3563 | 7.5916 | |
|
| 0.0009 | 37.0 | 109853 | 0.3469 | 7.4750 | |
|
| 0.0009 | 38.0 | 112822 | 0.3940 | 7.5919 | |
|
| 0.0009 | 39.0 | 115791 | 0.3771 | 7.5443 | |
|
| 0.0009 | 40.0 | 118760 | 0.3392 | 7.6593 | |
|
| 0.0009 | 41.0 | 121729 | 0.3498 | 7.6393 | |
|
| 0.0009 | 42.0 | 124698 | 0.3705 | 7.4474 | |
|
| 0.0008 | 43.0 | 127667 | 0.3758 | 7.2274 | |
|
| 0.0008 | 44.0 | 130636 | 0.3944 | 7.6919 | |
|
| 0.0009 | 45.0 | 133605 | 0.3885 | 7.5565 | |
|
| 0.0008 | 46.0 | 136574 | 0.3830 | 7.4628 | |
|
| 0.0008 | 47.0 | 139543 | 0.3972 | 7.8546 | |
|
| 0.0008 | 48.0 | 142512 | 0.3875 | 7.4916 | |
|
| 0.0007 | 49.0 | 145481 | 0.3438 | 7.2606 | |
|
| 0.0007 | 50.0 | 148450 | 0.3540 | 7.1581 | |
|
| 0.0008 | 51.0 | 151419 | 0.3768 | 7.1712 | |
|
| 0.0007 | 52.0 | 154388 | 0.4050 | 7.2286 | |
|
| 0.0007 | 53.0 | 157357 | 0.3785 | 7.4637 | |
|
| 0.0008 | 54.0 | 160326 | 0.4145 | 7.4800 | |
|
| 0.0008 | 55.0 | 163295 | 0.4042 | 7.3791 | |
|
| 0.0006 | 56.0 | 166264 | 0.3885 | 7.6994 | |
|
| 0.0006 | 57.0 | 169233 | 0.4153 | 7.5440 | |
|
| 0.0006 | 58.0 | 172202 | 0.4111 | 7.3408 | |
|
| 0.0006 | 59.0 | 175171 | 0.4147 | 7.2872 | |
|
| 0.0006 | 60.0 | 178140 | 0.4209 | 7.6270 | |
|
| 0.0006 | 61.0 | 181109 | 0.4041 | 7.4258 | |
|
| 0.0006 | 62.0 | 184078 | 0.4032 | 7.5324 | |
|
| 0.0006 | 63.0 | 187047 | 0.4214 | 7.3687 | |
|
| 0.0005 | 64.0 | 190016 | 0.3991 | 7.2750 | |
|
| 0.0005 | 65.0 | 192985 | 0.3885 | 7.1731 | |
|
| 0.0006 | 66.0 | 195954 | 0.4087 | 7.5063 | |
|
| 0.0005 | 67.0 | 198923 | 0.3760 | 7.4913 | |
|
| 0.0005 | 68.0 | 201892 | 0.3929 | 7.3314 | |
|
| 0.0005 | 69.0 | 204861 | 0.4044 | 7.5173 | |
|
| 0.0005 | 70.0 | 207830 | 0.4075 | 7.2712 | |
|
| 0.0005 | 71.0 | 210799 | 0.4170 | 7.2415 | |
|
| 0.0005 | 72.0 | 213768 | 0.4148 | 7.1142 | |
|
| 0.0005 | 73.0 | 216737 | 0.4271 | 7.3020 | |
|
| 0.0005 | 74.0 | 219706 | 0.4281 | 7.1863 | |
|
| 0.0004 | 75.0 | 222675 | 0.4202 | 7.1543 | |
|
| 0.0005 | 76.0 | 225644 | 0.4320 | 7.2910 | |
|
| 0.0005 | 77.0 | 228613 | 0.4328 | 7.3995 | |
|
| 0.0005 | 78.0 | 231582 | 0.4304 | 7.2255 | |
|
| 0.0005 | 79.0 | 234551 | 0.4537 | 7.0023 | |
|
| 0.0005 | 80.0 | 237520 | 0.4544 | 7.2048 | |
|
| 0.0004 | 81.0 | 240489 | 0.4485 | 7.2167 | |
|
| 0.0005 | 82.0 | 243458 | 0.4564 | 7.1794 | |
|
| 0.0004 | 83.0 | 246427 | 0.4608 | 7.2145 | |
|
| 0.0004 | 84.0 | 249396 | 0.4724 | 7.2098 | |
|
| 0.0004 | 85.0 | 252365 | 0.4726 | 7.1424 | |
|
| 0.0004 | 86.0 | 255334 | 0.4754 | 7.2832 | |
|
| 0.0005 | 87.0 | 258303 | 0.4765 | 7.1709 | |
|
| 0.0004 | 88.0 | 261272 | 0.4610 | 7.1358 | |
|
| 0.0004 | 89.0 | 264241 | 0.4697 | 7.0797 | |
|
| 0.0004 | 90.0 | 267210 | 0.4717 | 7.0913 | |
|
| 0.0004 | 91.0 | 270179 | 0.4756 | 7.1017 | |
|
| 0.0004 | 92.0 | 273148 | 0.4766 | 7.2089 | |
|
| 0.0004 | 93.0 | 276117 | 0.4763 | 7.1057 | |
|
| 0.0004 | 94.0 | 279086 | 0.4764 | 7.1101 | |
|
| 0.0004 | 95.0 | 282055 | 0.4759 | 7.2170 | |
|
| 0.0004 | 96.0 | 285024 | 0.4772 | 7.1104 | |
|
| 0.0004 | 97.0 | 287993 | 0.4781 | 7.0819 | |
|
| 0.0004 | 98.0 | 290962 | 0.4798 | 7.0897 | |
|
| 0.0004 | 99.0 | 293931 | 0.4800 | 7.0872 | |
|
| 0.0004 | 100.0 | 296900 | 0.4802 | 7.0810 | |
|
|
|
|
|
### Framework versions |
|
|
|
- Transformers 4.36.2 |
|
- Pytorch 2.0.1+cu117 |
|
- Datasets 2.16.1 |
|
- Tokenizers 0.15.0 |
|
|
