Hugging Face's logo

gary109
/
ai-light-dance_drums_ft_pretrain_wav2vec2-base

Automatic Speech Recognition
Transformers
PyTorch
TensorBoard
wav2vec2
gary109/AI_Light_Dance
Generated from Trainer
Inference Endpoints
Model card Files Metrics Community
ai-light-dance_drums_ft_pretrain_wav2vec2-base / README.md
gary109's picture
gary109
update model card README.md
872aa8c
preview code
|
raw
history blame
13.6 kB
metadata
tags:
  - automatic-speech-recognition
  - gary109/AI_Light_Dance
  - generated_from_trainer
datasets:
  - ai_light_dance
model-index:
  - name: ai-light-dance_drums_ft_pretrain_wav2vec2-base
    results: []

ai-light-dance_drums_ft_pretrain_wav2vec2-base

This model is a fine-tuned version of gary109/ai-light-dance_drums_pretrain_wav2vec2-base on the GARY109/AI_LIGHT_DANCE - ONSET-DRUMS dataset. It achieves the following results on the evaluation set:

  • Loss: 2.3263
  • Wer: 0.7803

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 0.0004
  • train_batch_size: 8
  • eval_batch_size: 8
  • seed: 42
  • gradient_accumulation_steps: 8
  • total_train_batch_size: 64
  • optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • lr_scheduler_type: linear
  • lr_scheduler_warmup_steps: 20
  • num_epochs: 200.0
  • mixed_precision_training: Native AMP

Training results

Training Loss Epoch Step Validation Loss Wer
No log 0.9 8 129.7304 1.0826
58.4765 1.9 16 92.1020 1.3475
37.6409 2.9 24 23.8801 1.0
6.3535 3.9 32 13.2330 1.0
5.0319 4.9 40 8.3613 1.0
5.0319 5.9 48 5.5184 1.0
4.7733 6.9 56 4.1720 1.0
3.8911 7.9 64 3.9397 0.9994
3.6 8.9 72 4.0742 0.9994
3.1586 9.9 80 3.8396 0.9997
3.1586 10.9 88 3.8821 0.9994
3.3812 11.9 96 3.9755 0.9979
3.0088 12.9 104 4.5299 0.9970
2.7633 13.9 112 4.1392 0.9964
2.6359 14.9 120 3.8528 0.9985
2.6359 15.9 128 3.4156 0.9973
3.1964 16.9 136 3.3741 0.9967
2.4962 17.9 144 3.6132 0.9922
2.4907 18.9 152 3.5363 0.9958
2.413 19.9 160 3.6351 0.9928
2.413 20.9 168 3.6113 0.9925
2.5555 21.9 176 3.7120 0.9904
2.2909 22.9 184 3.4334 0.9913
2.298 23.9 192 3.5458 0.9913
2.2366 24.9 200 3.7105 0.9898
2.2366 25.9 208 4.2298 0.9865
2.3428 26.9 216 3.3207 0.9889
2.2519 27.9 224 3.1548 0.9895
2.0429 28.9 232 3.7694 0.9877
2.1886 29.9 240 3.5341 0.9877
2.1886 30.9 248 3.1388 0.9850
2.2182 31.9 256 2.9390 0.9817
1.9479 32.9 264 3.0060 0.9826
1.9703 33.9 272 3.2571 0.9787
1.9385 34.9 280 3.1086 0.9776
1.9385 35.9 288 2.8231 0.9656
2.0297 36.9 296 2.8961 0.9668
1.8406 37.9 304 2.8829 0.9671
1.8707 38.9 312 3.1194 0.9584
1.7798 39.9 320 3.0686 0.9599
1.7798 40.9 328 2.7280 0.9527
1.9163 41.9 336 2.6321 0.9476
1.7248 42.9 344 2.6813 0.9413
1.7602 43.9 352 2.7252 0.9419
1.7357 44.9 360 3.0335 0.9398
1.7357 45.9 368 2.8732 0.9345
1.7997 46.9 376 2.7709 0.9353
1.6268 47.9 384 2.7681 0.9279
1.6527 48.9 392 2.8259 0.9303
1.5715 49.9 400 2.8841 0.9342
1.5715 50.9 408 2.7944 0.9222
1.6903 51.9 416 3.1597 0.9204
1.5722 52.9 424 2.5595 0.9213
1.539 53.9 432 2.8160 0.9117
1.538 54.9 440 2.5656 0.9168
1.538 55.9 448 2.9077 0.9075
1.624 56.9 456 2.8725 0.8985
1.5052 57.9 464 2.6217 0.8902
1.4367 58.9 472 2.5043 0.8976
1.4814 59.9 480 3.0905 0.8949
1.4814 60.9 488 2.7213 0.8991
1.5696 61.9 496 2.6882 0.8913
1.4408 62.9 504 2.7322 0.8737
1.4065 63.9 512 2.7024 0.8827
1.3989 64.9 520 2.6809 0.8806
1.3989 65.9 528 2.6340 0.8866
1.5102 66.9 536 2.8651 0.8851
1.4158 67.9 544 2.7928 0.8758
1.3322 68.9 552 2.7549 0.8800
1.4226 69.9 560 2.6618 0.8776
1.4226 70.9 568 2.6937 0.8650
1.4735 71.9 576 2.6285 0.8668
1.338 72.9 584 2.5628 0.8668
1.335 73.9 592 2.4783 0.8608
1.3433 74.9 600 2.6549 0.8605
1.3433 75.9 608 2.3851 0.8536
1.4341 76.9 616 2.6057 0.8641
1.3036 77.9 624 2.4144 0.8614
1.2617 78.9 632 2.5002 0.8596
1.308 79.9 640 2.4929 0.8575
1.308 80.9 648 2.6993 0.8462
1.3877 81.9 656 2.5874 0.8509
1.2553 82.9 664 2.6430 0.8536
1.211 83.9 672 3.0369 0.8497
1.2647 84.9 680 2.7012 0.8438
1.2647 85.9 688 2.5129 0.8581
1.3168 86.9 696 2.5123 0.8453
1.1997 87.9 704 2.4592 0.8503
1.1866 88.9 712 2.6306 0.8420
1.2396 89.9 720 2.4730 0.8459
1.2396 90.9 728 2.6146 0.8488
1.3184 91.9 736 2.6204 0.8423
1.1704 92.9 744 2.8896 0.8441
1.1436 93.9 752 2.9971 0.8390
1.1716 94.9 760 2.7293 0.8479
1.1716 95.9 768 2.9620 0.8426
1.2487 96.9 776 2.6880 0.8333
1.118 97.9 784 2.6754 0.8321
1.186 98.9 792 2.6925 0.8342
1.1373 99.9 800 2.9207 0.8339
1.1373 100.9 808 2.8559 0.8354
1.2086 101.9 816 2.9774 0.8336
1.1227 102.9 824 3.0108 0.8192
1.1446 103.9 832 2.8997 0.8270
1.1142 104.9 840 2.6626 0.8306
1.1142 105.9 848 2.7737 0.8195
1.1665 106.9 856 2.5447 0.8186
1.1 107.9 864 2.4472 0.8312
1.0674 108.9 872 2.4062 0.8225
1.0556 109.9 880 2.4098 0.8246
1.0556 110.9 888 2.3447 0.8255
1.1834 111.9 896 2.5571 0.8066
1.0533 112.9 904 2.5983 0.8150
1.101 113.9 912 2.6911 0.7950
1.0633 114.9 920 2.5733 0.8078
1.0633 115.9 928 2.5813 0.8192
1.1512 116.9 936 2.6237 0.8135
1.0317 117.9 944 2.5566 0.8031
1.0117 118.9 952 2.5485 0.8016
1.0556 119.9 960 2.4271 0.7980
1.0556 120.9 968 2.6579 0.7941
1.1204 121.9 976 2.6150 0.7944
1.0378 122.9 984 2.5499 0.8025
1.0213 123.9 992 2.7273 0.7938
1.0247 124.9 1000 2.7522 0.7863
1.0247 125.9 1008 2.9163 0.7971
1.0939 126.9 1016 2.6221 0.7896
1.0399 127.9 1024 2.9418 0.8004
1.0233 128.9 1032 2.7558 0.7857
0.9702 129.9 1040 2.5745 0.7905
0.9702 130.9 1048 2.6720 0.7899
1.0676 131.9 1056 2.6901 0.8022
1.0044 132.9 1064 2.6594 0.7773
1.0276 133.9 1072 2.4739 0.7932
0.949 134.9 1080 2.5398 0.7755
0.949 135.9 1088 2.6267 0.7797
1.0508 136.9 1096 2.4829 0.7722
0.9937 137.9 1104 2.4289 0.7776
0.9677 138.9 1112 2.5845 0.7815
1.0115 139.9 1120 2.7132 0.7704
1.0115 140.9 1128 2.4297 0.7836
1.049 141.9 1136 2.3430 0.7830
0.9412 142.9 1144 2.6202 0.7698
0.9647 143.9 1152 2.5072 0.7710
0.9839 144.9 1160 2.3640 0.7752
0.9839 145.9 1168 2.3263 0.7803
1.0245 146.9 1176 2.4205 0.7683
0.9537 147.9 1184 2.3593 0.7833
0.9787 148.9 1192 2.5319 0.7740
0.9443 149.9 1200 2.4923 0.7734
0.9443 150.9 1208 2.3936 0.7725
1.0125 151.9 1216 2.4754 0.7614
0.943 152.9 1224 2.4341 0.7701
0.9482 153.9 1232 2.4232 0.7698
0.8958 154.9 1240 2.4942 0.7516
0.8958 155.9 1248 2.5161 0.7680
1.0073 156.9 1256 2.5339 0.7698
0.9784 157.9 1264 2.4987 0.7561
0.904 158.9 1272 2.4729 0.7561
0.9352 159.9 1280 2.4668 0.7591
0.9352 160.9 1288 2.4547 0.7558
1.0036 161.9 1296 2.6065 0.7647
0.9437 162.9 1304 2.5466 0.7641
0.8998 163.9 1312 2.5044 0.7629
0.9195 164.9 1320 2.4214 0.7632
0.9195 165.9 1328 2.3591 0.7609
0.9795 166.9 1336 2.4736 0.7543
0.9041 167.9 1344 2.4043 0.7597
0.9111 168.9 1352 2.4594 0.7417
0.8902 169.9 1360 2.4252 0.7492
0.8902 170.9 1368 2.4007 0.7543
0.9956 171.9 1376 2.3503 0.7606
0.8645 172.9 1384 2.3733 0.7471
0.8989 173.9 1392 2.3426 0.7546
0.8961 174.9 1400 2.4074 0.7522
0.8961 175.9 1408 2.4200 0.7546
0.9481 176.9 1416 2.3616 0.7504
0.9347 177.9 1424 2.3545 0.7540
0.9105 178.9 1432 2.3841 0.7540
0.8936 179.9 1440 2.4328 0.7531
0.8936 180.9 1448 2.4596 0.7474
0.9511 181.9 1456 2.4178 0.7510
0.8743 182.9 1464 2.4075 0.7513
0.8905 183.9 1472 2.3900 0.7525
0.8968 184.9 1480 2.4383 0.7543
0.8968 185.9 1488 2.4401 0.7519
0.9459 186.9 1496 2.4344 0.7498
0.9273 187.9 1504 2.4179 0.7450
0.9523 188.9 1512 2.4077 0.7525
0.8903 189.9 1520 2.4482 0.7522
0.8903 190.9 1528 2.4507 0.7573
0.9759 191.9 1536 2.4391 0.7564
0.887 192.9 1544 2.4516 0.7522
0.8796 193.9 1552 2.4404 0.7543
0.861 194.9 1560 2.4268 0.7519
0.861 195.9 1568 2.4319 0.7507
0.9349 196.9 1576 2.4230 0.7540
0.9154 197.9 1584 2.4296 0.7558
0.8695 198.9 1592 2.4308 0.7558
0.8754 199.9 1600 2.4280 0.7546

Framework versions

  • Transformers 4.24.0.dev0
  • Pytorch 1.12.1+cu113
  • Datasets 2.6.1
  • Tokenizers 0.13.1