README.md

metadata

tags:
  - generated_from_trainer
datasets:
  - ai_light_dance
metrics:
  - wer
model-index:
  - name: ai-light-dance_drums_ft_pretrain_wav2vec2-base-new_onset-idmt-2_8k
    results:
      - task:
          name: Automatic Speech Recognition
          type: automatic-speech-recognition
        dataset:
          name: ai_light_dance
          type: ai_light_dance
          config: onset-idmt-2
          split: train
          args: onset-idmt-2
        metrics:
          - name: Wer
            type: wer
            value: 0.28888888888888886

ai-light-dance_drums_ft_pretrain_wav2vec2-base-new_onset-idmt-2_8k

This model is a fine-tuned version of gary109/ai-light-dance_drums_pretrain_wav2vec2-base-new on the ai_light_dance dataset. It achieves the following results on the evaluation set:

• Loss: 0.9687
• Wer: 0.2889

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 0.0003
• train_batch_size: 4
• eval_batch_size: 4
• seed: 42
• gradient_accumulation_steps: 4
• total_train_batch_size: 16
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• lr_scheduler_warmup_steps: 30
• num_epochs: 100.0
• mixed_precision_training: Native AMP

Training results

Training Loss	Epoch	Step	Validation Loss	Wer
No log	1.0	9	101.8046	0.98
17.4958	2.0	18	82.4920	1.0
16.2087	3.0	27	36.1388	1.0
6.2942	4.0	36	8.3267	1.0
2.0411	5.0	45	6.8215	1.0
1.554	6.0	54	5.3847	1.0
1.6215	7.0	63	4.4645	1.0
1.4962	8.0	72	3.2211	1.0
1.3825	9.0	81	2.5513	1.0
1.3443	10.0	90	2.8582	1.0
1.3443	11.0	99	2.5446	1.0
1.3096	12.0	108	2.0211	0.9956
1.3361	13.0	117	1.8110	0.9944
1.2862	14.0	126	1.7796	0.9933
1.2556	15.0	135	1.7301	0.9922
1.1959	16.0	144	1.4245	0.9989
1.1161	17.0	153	1.1932	0.5678
0.8853	18.0	162	1.2726	0.4922
0.7996	19.0	171	1.0841	0.5511
0.8165	20.0	180	1.4062	0.4411
0.8165	21.0	189	1.4219	0.3367
0.6807	22.0	198	1.2107	0.3344
0.7315	23.0	207	1.1420	0.3189
0.6203	24.0	216	1.0770	0.3778
0.6552	25.0	225	1.1095	0.3789
0.5618	26.0	234	1.0004	0.3478
0.5311	27.0	243	0.8811	0.3311
0.5391	28.0	252	0.8163	0.3678
0.5275	29.0	261	1.0000	0.3311
0.4965	30.0	270	0.7320	0.37
0.4965	31.0	279	0.9643	0.3389
0.4909	32.0	288	0.7663	0.3589
0.5218	33.0	297	0.9004	0.3489
0.4991	34.0	306	0.7342	0.38
0.4883	35.0	315	0.7959	0.3389
0.4902	36.0	324	0.6892	0.3378
0.4447	37.0	333	0.6480	0.3333
0.4458	38.0	342	0.6198	0.3333
0.4607	39.0	351	0.6081	0.3111
0.4352	40.0	360	0.6748	0.3156
0.4352	41.0	369	0.6885	0.3256
0.4286	42.0	378	0.6806	0.3333
0.4314	43.0	387	0.7855	0.3222
0.4476	44.0	396	0.6569	0.3144
0.4815	45.0	405	0.5389	0.3033
0.36	46.0	414	0.5550	0.3011
0.4516	47.0	423	0.5924	0.3144
0.3682	48.0	432	0.7275	0.3056
0.4371	49.0	441	0.7051	0.3089
0.4004	50.0	450	0.5669	0.3078
0.4004	51.0	459	0.5029	0.3178
0.3298	52.0	468	0.6150	0.32
0.4083	53.0	477	0.5882	0.33
0.4022	54.0	486	0.7253	0.3144
0.4465	55.0	495	0.6808	0.3111
0.3955	56.0	504	0.6002	0.3133
0.3877	57.0	513	0.7593	0.3056
0.3486	58.0	522	0.6764	0.3189
0.3782	59.0	531	0.6772	0.3133
0.3599	60.0	540	0.8846	0.3111
0.3599	61.0	549	0.9458	0.3233
0.3424	62.0	558	0.8399	0.3233
0.3652	63.0	567	0.8266	0.3133
0.3327	64.0	576	0.7813	0.3078
0.3603	65.0	585	0.8066	0.3156
0.3401	66.0	594	0.7960	0.3067
0.3797	67.0	603	0.8513	0.2989
0.3353	68.0	612	0.8319	0.2722
0.3909	69.0	621	0.8244	0.2878
0.3263	70.0	630	0.9539	0.3022
0.3263	71.0	639	1.0030	0.2922
0.3102	72.0	648	0.9875	0.3044
0.3577	73.0	657	0.9030	0.2978
0.2953	74.0	666	0.9392	0.2889
0.3644	75.0	675	0.9089	0.2878
0.3231	76.0	684	0.9264	0.2844
0.3078	77.0	693	1.0536	0.2911
0.4503	78.0	702	0.9473	0.2967
0.3492	79.0	711	0.8909	0.3089
0.347	80.0	720	0.8532	0.3067
0.347	81.0	729	0.9553	0.2833
0.2949	82.0	738	1.0111	0.2867
0.3447	83.0	747	0.9160	0.3011
0.2878	84.0	756	0.8401	0.2989
0.3229	85.0	765	0.8815	0.2911
0.276	86.0	774	0.8802	0.2911
0.3469	87.0	783	0.9121	0.29
0.3044	88.0	792	0.8934	0.2933
0.2885	89.0	801	0.8806	0.2967
0.3365	90.0	810	0.9037	0.2844
0.3365	91.0	819	0.9218	0.2867
0.3239	92.0	828	0.9228	0.2844
0.3219	93.0	837	0.9167	0.2844
0.2736	94.0	846	0.9495	0.2878
0.3587	95.0	855	0.9997	0.2844
0.3386	96.0	864	0.9977	0.2856
0.2895	97.0	873	0.9964	0.2889
0.3496	98.0	882	0.9765	0.2889
0.2789	99.0	891	0.9713	0.2878
0.3284	100.0	900	0.9687	0.2889

Framework versions

• Transformers 4.25.0.dev0
• Pytorch 1.8.1+cu111
• Datasets 2.7.1.dev0
• Tokenizers 0.13.2