evaluation results

README.md

@@ -73,6 +73,19 @@ The following hyperparameters were used during training:
 | 0.019         | 100.0 | 5500 | 0.4164          | 0.3098 | 0.0764 |
 
 
+## Evaluation Commands
+Please install [unicode_tr](https://pypi.org/project/unicode_tr/) package before running evaluation. It is used for Turkish text processing.
+1. To evaluate on `mozilla-foundation/common_voice_7_0` with split `test`
+```bash
+python eval.py --model_id Baybars/wav2vec2-xls-r-300m-cv8-turkish --dataset mozilla-foundation/common_voice_8_0 --config tr --split test
+```
+
+2. To evaluate on `speech-recognition-community-v2/dev_data`
+
+```bash
+python eval.py --model_id Baybars/wav2vec2-xls-r-300m-cv8-turkish --dataset speech-recognition-community-v2/dev_data --config tr --split validation --chunk_length_s 5.0 --stride_length_s 1.0
+```
+
 ### Framework versions
 
 - Transformers 4.17.0.dev0

mozilla-foundation_common_voice_8_0_tr_test_eval_results.txt

@@ -0,0 +1,2 @@
+WER: 0.32167655888351626
+CER: 0.07570061459502155

preprocessor_config.json

@@ -5,5 +5,6 @@
   "padding_side": "right",
   "padding_value": 0,
   "return_attention_mask": true,
-  "sampling_rate": 16000
+  "sampling_rate": 16000,
+  "processor_class":"Wav2Vec2ProcessorWithLM"
 }