--- language: - myv license: apache-2.0 tags: - automatic-speech-recognition - mozilla-foundation/common_voice_8_0 - generated_from_trainer - myv - robust-speech-event - model_for_talk - hf-asr-leaderboard datasets: - mozilla-foundation/common_voice_8_0 model-index: - name: wav2vec2-large-xls-r-300m-myv-v1 results: - task: name: Automatic Speech Recognition type: automatic-speech-recognition dataset: name: Common Voice 8 type: mozilla-foundation/common_voice_8_0 args: myv metrics: - name: Test WER type: wer value: 0.599548532731377 - name: Test CER type: cer value: 0.12953851902597 - task: name: Automatic Speech Recognition type: automatic-speech-recognition dataset: name: Robust Speech Event - Dev Data type: speech-recognition-community-v2/dev_data args: myv metrics: - name: Test WER type: wer value: NA - name: Test CER type: cer value: NA --- # wav2vec2-large-xls-r-300m-myv-v1 This model is a fine-tuned version of [facebook/wav2vec2-xls-r-300m](https://huggingface.co/facebook/wav2vec2-xls-r-300m) on the MOZILLA-FOUNDATION/COMMON_VOICE_8_0 - MYV dataset. It achieves the following results on the evaluation set: - Loss: 0.8537 - Wer: 0.6160 ### Evaluation Commands 1. To evaluate on mozilla-foundation/common_voice_8_0 with test split python eval.py --model_id DrishtiSharma/wav2vec2-large-xls-r-300m-myv-v1 --dataset mozilla-foundation/common_voice_8_0 --config myv --split test --log_outputs 2. To evaluate on speech-recognition-community-v2/dev_data Erzya language not found in speech-recognition-community-v2/dev_data! ### Training hyperparameters The following hyperparameters were used during training: - learning_rate: 0.000222 - train_batch_size: 16 - eval_batch_size: 8 - seed: 42 - gradient_accumulation_steps: 2 - total_train_batch_size: 32 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08 - lr_scheduler_type: linear - lr_scheduler_warmup_steps: 1000 - num_epochs: 150 - mixed_precision_training: Native AMP ### Training results | Training Loss | Epoch | Step | Validation Loss | Wer | |:-------------:|:------:|:----:|:---------------:|:------:| | 19.453 | 1.92 | 50 | 16.4001 | 1.0 | | 9.6875 | 3.85 | 100 | 5.4468 | 1.0 | | 4.9988 | 5.77 | 150 | 4.3507 | 1.0 | | 4.1148 | 7.69 | 200 | 3.6753 | 1.0 | | 3.4922 | 9.62 | 250 | 3.3103 | 1.0 | | 3.2443 | 11.54 | 300 | 3.1741 | 1.0 | | 3.164 | 13.46 | 350 | 3.1346 | 1.0 | | 3.0954 | 15.38 | 400 | 3.0428 | 1.0 | | 3.0076 | 17.31 | 450 | 2.9137 | 1.0 | | 2.6883 | 19.23 | 500 | 2.1476 | 0.9978 | | 1.5124 | 21.15 | 550 | 0.8955 | 0.8225 | | 0.8711 | 23.08 | 600 | 0.6948 | 0.7591 | | 0.6695 | 25.0 | 650 | 0.6683 | 0.7636 | | 0.5606 | 26.92 | 700 | 0.6821 | 0.7435 | | 0.503 | 28.85 | 750 | 0.7220 | 0.7516 | | 0.4528 | 30.77 | 800 | 0.6638 | 0.7324 | | 0.4219 | 32.69 | 850 | 0.7120 | 0.7435 | | 0.4109 | 34.62 | 900 | 0.7122 | 0.7511 | | 0.3887 | 36.54 | 950 | 0.7179 | 0.7199 | | 0.3895 | 38.46 | 1000 | 0.7322 | 0.7525 | | 0.391 | 40.38 | 1050 | 0.6850 | 0.7364 | | 0.3537 | 42.31 | 1100 | 0.7571 | 0.7279 | | 0.3267 | 44.23 | 1150 | 0.7575 | 0.7257 | | 0.3195 | 46.15 | 1200 | 0.7580 | 0.6998 | | 0.2891 | 48.08 | 1250 | 0.7452 | 0.7101 | | 0.294 | 50.0 | 1300 | 0.7316 | 0.6945 | | 0.2854 | 51.92 | 1350 | 0.7241 | 0.6757 | | 0.2801 | 53.85 | 1400 | 0.7532 | 0.6887 | | 0.2502 | 55.77 | 1450 | 0.7587 | 0.6811 | | 0.2427 | 57.69 | 1500 | 0.7231 | 0.6851 | | 0.2311 | 59.62 | 1550 | 0.7288 | 0.6632 | | 0.2176 | 61.54 | 1600 | 0.7711 | 0.6664 | | 0.2117 | 63.46 | 1650 | 0.7914 | 0.6940 | | 0.2114 | 65.38 | 1700 | 0.8065 | 0.6918 | | 0.1913 | 67.31 | 1750 | 0.8372 | 0.6945 | | 0.1897 | 69.23 | 1800 | 0.8051 | 0.6869 | | 0.1865 | 71.15 | 1850 | 0.8076 | 0.6740 | | 0.1844 | 73.08 | 1900 | 0.7935 | 0.6708 | | 0.1757 | 75.0 | 1950 | 0.8015 | 0.6610 | | 0.1636 | 76.92 | 2000 | 0.7614 | 0.6414 | | 0.1637 | 78.85 | 2050 | 0.8123 | 0.6592 | | 0.1599 | 80.77 | 2100 | 0.7907 | 0.6566 | | 0.1498 | 82.69 | 2150 | 0.8641 | 0.6757 | | 0.1545 | 84.62 | 2200 | 0.7438 | 0.6682 | | 0.1433 | 86.54 | 2250 | 0.8014 | 0.6624 | | 0.1427 | 88.46 | 2300 | 0.7758 | 0.6646 | | 0.1423 | 90.38 | 2350 | 0.7741 | 0.6423 | | 0.1298 | 92.31 | 2400 | 0.7938 | 0.6414 | | 0.1111 | 94.23 | 2450 | 0.7976 | 0.6467 | | 0.1243 | 96.15 | 2500 | 0.7916 | 0.6481 | | 0.1215 | 98.08 | 2550 | 0.7594 | 0.6392 | | 0.113 | 100.0 | 2600 | 0.8236 | 0.6392 | | 0.1077 | 101.92 | 2650 | 0.7959 | 0.6347 | | 0.0988 | 103.85 | 2700 | 0.8189 | 0.6392 | | 0.0953 | 105.77 | 2750 | 0.8157 | 0.6414 | | 0.0889 | 107.69 | 2800 | 0.7946 | 0.6369 | | 0.0929 | 109.62 | 2850 | 0.8255 | 0.6360 | | 0.0822 | 111.54 | 2900 | 0.8320 | 0.6334 | | 0.086 | 113.46 | 2950 | 0.8539 | 0.6490 | | 0.0825 | 115.38 | 3000 | 0.8438 | 0.6418 | | 0.0727 | 117.31 | 3050 | 0.8568 | 0.6481 | | 0.0717 | 119.23 | 3100 | 0.8447 | 0.6512 | | 0.0815 | 121.15 | 3150 | 0.8470 | 0.6445 | | 0.0689 | 123.08 | 3200 | 0.8264 | 0.6249 | | 0.0726 | 125.0 | 3250 | 0.7981 | 0.6169 | | 0.0648 | 126.92 | 3300 | 0.8237 | 0.6200 | | 0.0632 | 128.85 | 3350 | 0.8416 | 0.6249 | | 0.06 | 130.77 | 3400 | 0.8276 | 0.6173 | | 0.0616 | 132.69 | 3450 | 0.8429 | 0.6209 | | 0.0614 | 134.62 | 3500 | 0.8485 | 0.6271 | | 0.0539 | 136.54 | 3550 | 0.8598 | 0.6218 | | 0.0555 | 138.46 | 3600 | 0.8557 | 0.6169 | | 0.0604 | 140.38 | 3650 | 0.8436 | 0.6186 | | 0.0556 | 142.31 | 3700 | 0.8428 | 0.6178 | | 0.051 | 144.23 | 3750 | 0.8440 | 0.6142 | | 0.0526 | 146.15 | 3800 | 0.8566 | 0.6142 | | 0.052 | 148.08 | 3850 | 0.8544 | 0.6178 | | 0.0519 | 150.0 | 3900 | 0.8537 | 0.6160 | ### Framework versions - Transformers 4.16.2 - Pytorch 1.10.0+cu111 - Datasets 1.18.2 - Tokenizers 0.11.0