|
--- |
|
license: apache-2.0 |
|
base_model: openai/whisper-tiny.en |
|
tags: |
|
- generated_from_trainer |
|
metrics: |
|
- wer |
|
model-index: |
|
- name: whisper2 |
|
results: [] |
|
--- |
|
|
|
<!-- This model card has been generated automatically according to the information the Trainer had access to. You |
|
should probably proofread and complete it, then remove this comment. --> |
|
|
|
# whisper2 |
|
|
|
This model is a fine-tuned version of [openai/whisper-tiny.en](https://huggingface.co/openai/whisper-tiny.en) on an unknown dataset. |
|
It achieves the following results on the evaluation set: |
|
- Loss: 0.5233 |
|
- Wer: 31.1083 |
|
|
|
## Model description |
|
|
|
More information needed |
|
|
|
## Intended uses & limitations |
|
|
|
More information needed |
|
|
|
## Training and evaluation data |
|
|
|
More information needed |
|
|
|
## Training procedure |
|
|
|
### Training hyperparameters |
|
|
|
The following hyperparameters were used during training: |
|
- learning_rate: 1e-05 |
|
- train_batch_size: 64 |
|
- eval_batch_size: 8 |
|
- seed: 42 |
|
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08 |
|
- lr_scheduler_type: linear |
|
- lr_scheduler_warmup_steps: 500 |
|
- training_steps: 500 |
|
|
|
### Training results |
|
|
|
| Training Loss | Epoch | Step | Validation Loss | Wer | |
|
|:-------------:|:------:|:----:|:---------------:|:-------:| |
|
| 3.9553 | 0.1408 | 10 | 3.9646 | 74.8741 | |
|
| 3.9548 | 0.2817 | 20 | 3.8794 | 77.6763 | |
|
| 3.8127 | 0.4225 | 30 | 3.7405 | 76.4169 | |
|
| 3.6178 | 0.5634 | 40 | 3.5547 | 75.3149 | |
|
| 3.3992 | 0.7042 | 50 | 3.3235 | 70.2771 | |
|
| 3.1416 | 0.8451 | 60 | 3.0402 | 67.8526 | |
|
| 2.8052 | 0.9859 | 70 | 2.6852 | 65.9635 | |
|
| 2.3513 | 1.1268 | 80 | 2.2235 | 68.3249 | |
|
| 1.893 | 1.2676 | 90 | 1.6708 | 63.8224 | |
|
| 1.2871 | 1.4085 | 100 | 1.1645 | 63.2557 | |
|
| 0.9146 | 1.5493 | 110 | 0.8785 | 56.8325 | |
|
| 0.8044 | 1.6901 | 120 | 0.7907 | 46.9773 | |
|
| 0.6634 | 1.8310 | 130 | 0.7425 | 47.4811 | |
|
| 0.6722 | 1.9718 | 140 | 0.7100 | 45.9068 | |
|
| 0.6823 | 2.1127 | 150 | 0.6854 | 42.4118 | |
|
| 0.5802 | 2.2535 | 160 | 0.6659 | 40.4282 | |
|
| 0.6084 | 2.3944 | 170 | 0.6503 | 40.8375 | |
|
| 0.6038 | 2.5352 | 180 | 0.6346 | 41.4987 | |
|
| 0.5095 | 2.6761 | 190 | 0.6247 | 42.0340 | |
|
| 0.5251 | 2.8169 | 200 | 0.6155 | 39.3577 | |
|
| 0.5699 | 2.9577 | 210 | 0.6046 | 38.3501 | |
|
| 0.4839 | 3.0986 | 220 | 0.5945 | 37.2796 | |
|
| 0.4843 | 3.2394 | 230 | 0.5861 | 48.3942 | |
|
| 0.4538 | 3.3803 | 240 | 0.5794 | 34.6662 | |
|
| 0.4741 | 3.5211 | 250 | 0.5737 | 33.8161 | |
|
| 0.4542 | 3.6620 | 260 | 0.5663 | 41.9710 | |
|
| 0.4163 | 3.8028 | 270 | 0.5623 | 46.0957 | |
|
| 0.3496 | 3.9437 | 280 | 0.5605 | 42.2544 | |
|
| 0.3835 | 4.0845 | 290 | 0.5557 | 41.6562 | |
|
| 0.3462 | 4.2254 | 300 | 0.5507 | 36.3980 | |
|
| 0.3133 | 4.3662 | 310 | 0.5452 | 42.5693 | |
|
| 0.3638 | 4.5070 | 320 | 0.5435 | 35.9572 | |
|
| 0.3826 | 4.6479 | 330 | 0.5396 | 31.9584 | |
|
| 0.3581 | 4.7887 | 340 | 0.5361 | 33.7846 | |
|
| 0.3127 | 4.9296 | 350 | 0.5339 | 37.3426 | |
|
| 0.2988 | 5.0704 | 360 | 0.5348 | 38.7280 | |
|
| 0.2807 | 5.2113 | 370 | 0.5344 | 35.5164 | |
|
| 0.2612 | 5.3521 | 380 | 0.5305 | 34.6662 | |
|
| 0.2762 | 5.4930 | 390 | 0.5306 | 32.2733 | |
|
| 0.299 | 5.6338 | 400 | 0.5267 | 36.8703 | |
|
| 0.2718 | 5.7746 | 410 | 0.5232 | 41.6877 | |
|
| 0.2618 | 5.9155 | 420 | 0.5208 | 34.0995 | |
|
| 0.2121 | 6.0563 | 430 | 0.5220 | 28.0542 | |
|
| 0.1929 | 6.1972 | 440 | 0.5256 | 35.7997 | |
|
| 0.2504 | 6.3380 | 450 | 0.5296 | 32.8715 | |
|
| 0.2064 | 6.4789 | 460 | 0.5265 | 35.3904 | |
|
| 0.2044 | 6.6197 | 470 | 0.5267 | 38.3186 | |
|
| 0.1844 | 6.7606 | 480 | 0.5231 | 35.1071 | |
|
| 0.1867 | 6.9014 | 490 | 0.5235 | 31.5806 | |
|
| 0.1562 | 7.0423 | 500 | 0.5233 | 31.1083 | |
|
|
|
|
|
### Framework versions |
|
|
|
- Transformers 4.40.1 |
|
- Pytorch 2.2.1+cu121 |
|
- Datasets 2.19.1.dev0 |
|
- Tokenizers 0.19.1 |
|
|
