|
--- |
|
tags: |
|
- automatic-speech-recognition |
|
- gary109/AI_Light_Dance |
|
- generated_from_trainer |
|
datasets: |
|
- ai_light_dance |
|
metrics: |
|
- wer |
|
model-index: |
|
- name: ai-light-dance_drums_ft_pretrain_wav2vec2-base-new_onset-idmt-2_8k |
|
results: [] |
|
--- |
|
|
|
<!-- This model card has been generated automatically according to the information the Trainer had access to. You |
|
should probably proofread and complete it, then remove this comment. --> |
|
|
|
# ai-light-dance_drums_ft_pretrain_wav2vec2-base-new_onset-idmt-2_8k |
|
|
|
This model is a fine-tuned version of [gary109/ai-light-dance_drums_pretrain_wav2vec2-base-new](https://huggingface.co/gary109/ai-light-dance_drums_pretrain_wav2vec2-base-new) on the GARY109/AI_LIGHT_DANCE - ONSET-IDMT-2 dataset. |
|
It achieves the following results on the evaluation set: |
|
- Loss: 0.5029 |
|
- Wer: 0.3178 |
|
|
|
## Model description |
|
|
|
More information needed |
|
|
|
## Intended uses & limitations |
|
|
|
More information needed |
|
|
|
## Training and evaluation data |
|
|
|
More information needed |
|
|
|
## Training procedure |
|
|
|
### Training hyperparameters |
|
|
|
The following hyperparameters were used during training: |
|
- learning_rate: 0.0003 |
|
- train_batch_size: 4 |
|
- eval_batch_size: 4 |
|
- seed: 42 |
|
- gradient_accumulation_steps: 4 |
|
- total_train_batch_size: 16 |
|
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08 |
|
- lr_scheduler_type: linear |
|
- lr_scheduler_warmup_steps: 30 |
|
- num_epochs: 100.0 |
|
- mixed_precision_training: Native AMP |
|
|
|
### Training results |
|
|
|
| Training Loss | Epoch | Step | Validation Loss | Wer | |
|
|:-------------:|:-----:|:----:|:---------------:|:------:| |
|
| No log | 1.0 | 9 | 101.8046 | 0.98 | |
|
| 17.4958 | 2.0 | 18 | 82.4920 | 1.0 | |
|
| 16.2087 | 3.0 | 27 | 36.1388 | 1.0 | |
|
| 6.2942 | 4.0 | 36 | 8.3267 | 1.0 | |
|
| 2.0411 | 5.0 | 45 | 6.8215 | 1.0 | |
|
| 1.554 | 6.0 | 54 | 5.3847 | 1.0 | |
|
| 1.6215 | 7.0 | 63 | 4.4645 | 1.0 | |
|
| 1.4962 | 8.0 | 72 | 3.2211 | 1.0 | |
|
| 1.3825 | 9.0 | 81 | 2.5513 | 1.0 | |
|
| 1.3443 | 10.0 | 90 | 2.8582 | 1.0 | |
|
| 1.3443 | 11.0 | 99 | 2.5446 | 1.0 | |
|
| 1.3096 | 12.0 | 108 | 2.0211 | 0.9956 | |
|
| 1.3361 | 13.0 | 117 | 1.8110 | 0.9944 | |
|
| 1.2862 | 14.0 | 126 | 1.7796 | 0.9933 | |
|
| 1.2556 | 15.0 | 135 | 1.7301 | 0.9922 | |
|
| 1.1959 | 16.0 | 144 | 1.4245 | 0.9989 | |
|
| 1.1161 | 17.0 | 153 | 1.1932 | 0.5678 | |
|
| 0.8853 | 18.0 | 162 | 1.2726 | 0.4922 | |
|
| 0.7996 | 19.0 | 171 | 1.0841 | 0.5511 | |
|
| 0.8165 | 20.0 | 180 | 1.4062 | 0.4411 | |
|
| 0.8165 | 21.0 | 189 | 1.4219 | 0.3367 | |
|
| 0.6807 | 22.0 | 198 | 1.2107 | 0.3344 | |
|
| 0.7315 | 23.0 | 207 | 1.1420 | 0.3189 | |
|
| 0.6203 | 24.0 | 216 | 1.0770 | 0.3778 | |
|
| 0.6552 | 25.0 | 225 | 1.1095 | 0.3789 | |
|
| 0.5618 | 26.0 | 234 | 1.0004 | 0.3478 | |
|
| 0.5311 | 27.0 | 243 | 0.8811 | 0.3311 | |
|
| 0.5391 | 28.0 | 252 | 0.8163 | 0.3678 | |
|
| 0.5275 | 29.0 | 261 | 1.0000 | 0.3311 | |
|
| 0.4965 | 30.0 | 270 | 0.7320 | 0.37 | |
|
| 0.4965 | 31.0 | 279 | 0.9643 | 0.3389 | |
|
| 0.4909 | 32.0 | 288 | 0.7663 | 0.3589 | |
|
| 0.5218 | 33.0 | 297 | 0.9004 | 0.3489 | |
|
| 0.4991 | 34.0 | 306 | 0.7342 | 0.38 | |
|
| 0.4883 | 35.0 | 315 | 0.7959 | 0.3389 | |
|
| 0.4902 | 36.0 | 324 | 0.6892 | 0.3378 | |
|
| 0.4447 | 37.0 | 333 | 0.6480 | 0.3333 | |
|
| 0.4458 | 38.0 | 342 | 0.6198 | 0.3333 | |
|
| 0.4607 | 39.0 | 351 | 0.6081 | 0.3111 | |
|
| 0.4352 | 40.0 | 360 | 0.6748 | 0.3156 | |
|
| 0.4352 | 41.0 | 369 | 0.6885 | 0.3256 | |
|
| 0.4286 | 42.0 | 378 | 0.6806 | 0.3333 | |
|
| 0.4314 | 43.0 | 387 | 0.7855 | 0.3222 | |
|
| 0.4476 | 44.0 | 396 | 0.6569 | 0.3144 | |
|
| 0.4815 | 45.0 | 405 | 0.5389 | 0.3033 | |
|
| 0.36 | 46.0 | 414 | 0.5550 | 0.3011 | |
|
| 0.4516 | 47.0 | 423 | 0.5924 | 0.3144 | |
|
| 0.3682 | 48.0 | 432 | 0.7275 | 0.3056 | |
|
| 0.4371 | 49.0 | 441 | 0.7051 | 0.3089 | |
|
| 0.4004 | 50.0 | 450 | 0.5669 | 0.3078 | |
|
| 0.4004 | 51.0 | 459 | 0.5029 | 0.3178 | |
|
| 0.3298 | 52.0 | 468 | 0.6150 | 0.32 | |
|
| 0.4083 | 53.0 | 477 | 0.5882 | 0.33 | |
|
| 0.4022 | 54.0 | 486 | 0.7253 | 0.3144 | |
|
| 0.4465 | 55.0 | 495 | 0.6808 | 0.3111 | |
|
| 0.3955 | 56.0 | 504 | 0.6002 | 0.3133 | |
|
| 0.3877 | 57.0 | 513 | 0.7593 | 0.3056 | |
|
| 0.3486 | 58.0 | 522 | 0.6764 | 0.3189 | |
|
| 0.3782 | 59.0 | 531 | 0.6772 | 0.3133 | |
|
| 0.3599 | 60.0 | 540 | 0.8846 | 0.3111 | |
|
| 0.3599 | 61.0 | 549 | 0.9458 | 0.3233 | |
|
| 0.3424 | 62.0 | 558 | 0.8399 | 0.3233 | |
|
| 0.3652 | 63.0 | 567 | 0.8266 | 0.3133 | |
|
| 0.3327 | 64.0 | 576 | 0.7813 | 0.3078 | |
|
| 0.3603 | 65.0 | 585 | 0.8066 | 0.3156 | |
|
| 0.3401 | 66.0 | 594 | 0.7960 | 0.3067 | |
|
| 0.3797 | 67.0 | 603 | 0.8513 | 0.2989 | |
|
| 0.3353 | 68.0 | 612 | 0.8319 | 0.2722 | |
|
| 0.3909 | 69.0 | 621 | 0.8244 | 0.2878 | |
|
| 0.3263 | 70.0 | 630 | 0.9539 | 0.3022 | |
|
| 0.3263 | 71.0 | 639 | 1.0030 | 0.2922 | |
|
| 0.3102 | 72.0 | 648 | 0.9875 | 0.3044 | |
|
| 0.3577 | 73.0 | 657 | 0.9030 | 0.2978 | |
|
| 0.2953 | 74.0 | 666 | 0.9392 | 0.2889 | |
|
| 0.3644 | 75.0 | 675 | 0.9089 | 0.2878 | |
|
| 0.3231 | 76.0 | 684 | 0.9264 | 0.2844 | |
|
| 0.3078 | 77.0 | 693 | 1.0536 | 0.2911 | |
|
| 0.4503 | 78.0 | 702 | 0.9473 | 0.2967 | |
|
| 0.3492 | 79.0 | 711 | 0.8909 | 0.3089 | |
|
| 0.347 | 80.0 | 720 | 0.8532 | 0.3067 | |
|
| 0.347 | 81.0 | 729 | 0.9553 | 0.2833 | |
|
| 0.2949 | 82.0 | 738 | 1.0111 | 0.2867 | |
|
| 0.3447 | 83.0 | 747 | 0.9160 | 0.3011 | |
|
| 0.2878 | 84.0 | 756 | 0.8401 | 0.2989 | |
|
| 0.3229 | 85.0 | 765 | 0.8815 | 0.2911 | |
|
| 0.276 | 86.0 | 774 | 0.8802 | 0.2911 | |
|
| 0.3469 | 87.0 | 783 | 0.9121 | 0.29 | |
|
| 0.3044 | 88.0 | 792 | 0.8934 | 0.2933 | |
|
| 0.2885 | 89.0 | 801 | 0.8806 | 0.2967 | |
|
| 0.3365 | 90.0 | 810 | 0.9037 | 0.2844 | |
|
| 0.3365 | 91.0 | 819 | 0.9218 | 0.2867 | |
|
| 0.3239 | 92.0 | 828 | 0.9228 | 0.2844 | |
|
| 0.3219 | 93.0 | 837 | 0.9167 | 0.2844 | |
|
| 0.2736 | 94.0 | 846 | 0.9495 | 0.2878 | |
|
| 0.3587 | 95.0 | 855 | 0.9997 | 0.2844 | |
|
| 0.3386 | 96.0 | 864 | 0.9977 | 0.2856 | |
|
| 0.2895 | 97.0 | 873 | 0.9964 | 0.2889 | |
|
| 0.3496 | 98.0 | 882 | 0.9765 | 0.2889 | |
|
| 0.2789 | 99.0 | 891 | 0.9713 | 0.2878 | |
|
| 0.3284 | 100.0 | 900 | 0.9687 | 0.2889 | |
|
|
|
|
|
### Framework versions |
|
|
|
- Transformers 4.25.0.dev0 |
|
- Pytorch 1.8.1+cu111 |
|
- Datasets 2.7.1.dev0 |
|
- Tokenizers 0.13.2 |
|
|
