---
language:
- uz
license: apache-2.0
tags:
- automatic-speech-recognition
- generated_from_trainer
- hf-asr-leaderboard
- mozilla-foundation/common_voice_8_0
- robust-speech-event
datasets:
- mozilla-foundation/common_voice_8_0
base_model: facebook/wav2vec2-xls-r-300m
model-index:
- name: XLS-R-300M Uzbek CV8
  results:
  - task:
      type: automatic-speech-recognition
      name: Automatic Speech Recognition
    dataset:
      name: Common Voice 8
      type: mozilla-foundation/common_voice_8_0
      args: uz
    metrics:
    - type: wer
      value: 15.065
      name: Test WER (with LM)
    - type: cer
      value: 3.077
      name: Test CER (with LM)
    - type: wer
      value: 32.88
      name: Test WER (no LM)
    - type: cer
      value: 6.53
      name: Test CER (no LM)
---

# XLS-R-300M Uzbek CV8

Ushbu model [facebook/wav2vec2-xls-r-300m](https://huggingface.co/facebook/wav2vec2-xls-r-300m) asosida MOZILLA-FOUNDATION/COMMON_VOICE_8_0 - UZ datasetidan foydalangan holda Transfer Learning usuli orqali ngramm modeli asosida o'zbek tili uchun fine-tuning qilingan.
Model quydagi natijalarga erishgan:
- Loss: 0.3063
- Wer: 0.3852
- Cer: 0.0777

## Model haqida

Model arxitekturasi haqida ko'prom ma'lumot olish uchun ushbu [facebook/wav2vec2-xls-r-300m](https://huggingface.co/facebook/wav2vec2-xls-r-300m) havola orqali o'ting

Ushbu modelning lugʻati oʻzbek tili  zamonaviy lotin alifbosidan iborat boʻlib, tinish belgilari olib tashlangan(https://en.wikipedia.org/wiki/Uzbek_alphabet). 
Shuni ta'kidlash kerakki, <‘> va <’> belgilar tinish belgisi sifatida hisoblanmaydi, qachonki mana shunday belgilar \<o\> va \<g\> dan so'ng kelganda ularni  <‘> bilan o‘zgartirilgan.

Dekoder common_voice matniga asoslangan kenlm tili modelidan foydalanadi.

## Foydalanish yo'nalishilari va cheklovlar

Ushbu model quyidagi foydalanish holatlari uchun foydali bo'lishi kutilmoqda:
- Video subtitr uchun
- yozib olingan eshittirishlarni indekslash

Model jonli efirdagi uchrashuvlar yoki ko'rsatuvlarni subtitrini aniqlash uchun kerakli ravishda mos emas va undan Common Voice maʼlumotlar toʻplamiga yoki boshqa hissa qoʻshuvchilarning shaxsiy hayotini xafvga qo'yadigan holatlar uchun ishlatilmasligi kerak.

## Training va baholash ma'lumotlari

The 50% of the `train` common voice official split was used as training data. The 50% of the official `dev` split was used as validation data, and the full `test` set was used for final evaluation of the model without LM, while the model with LM was evaluated only on 500 examples from the `test` set.

The kenlm language model was compiled from the target sentences of the train + other dataset splits.

### Training giperparametrlari

Training jarayonida quyidagi giperparametrlardan foydalanildi:
- learning_rate: 3e-05
- train_batch_size: 32
- eval_batch_size: 8
- seed: 42
- gradient_accumulation_steps: 4
- total_train_batch_size: 128
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- lr_scheduler_warmup_steps: 500
- num_epochs: 100.0
- mixed_precision_training: Native AMP

### Training natijalari

| Training Loss | Epoch | Step  | Validation Loss | Wer    | Cer    |
|:-------------:|:-----:|:-----:|:---------------:|:------:|:------:|
| 3.1401        | 3.25  | 500   | 3.1146          | 1.0    | 1.0    |
| 2.7484        | 6.49  | 1000  | 2.2842          | 1.0065 | 0.7069 |
| 1.0899        | 9.74  | 1500  | 0.5414          | 0.6125 | 0.1351 |
| 0.9465        | 12.99 | 2000  | 0.4566          | 0.5635 | 0.1223 |
| 0.8771        | 16.23 | 2500  | 0.4212          | 0.5366 | 0.1161 |
| 0.8346        | 19.48 | 3000  | 0.3994          | 0.5144 | 0.1102 |
| 0.8127        | 22.73 | 3500  | 0.3819          | 0.4944 | 0.1051 |
| 0.7833        | 25.97 | 4000  | 0.3705          | 0.4798 | 0.1011 |
| 0.7603        | 29.22 | 4500  | 0.3661          | 0.4704 | 0.0992 |
| 0.7424        | 32.47 | 5000  | 0.3529          | 0.4577 | 0.0957 |
| 0.7251        | 35.71 | 5500  | 0.3410          | 0.4473 | 0.0928 |
| 0.7106        | 38.96 | 6000  | 0.3401          | 0.4428 | 0.0919 |
| 0.7027        | 42.21 | 6500  | 0.3355          | 0.4353 | 0.0905 |
| 0.6927        | 45.45 | 7000  | 0.3308          | 0.4296 | 0.0885 |
| 0.6828        | 48.7  | 7500  | 0.3246          | 0.4204 | 0.0863 |
| 0.6706        | 51.95 | 8000  | 0.3250          | 0.4233 | 0.0868 |
| 0.6629        | 55.19 | 8500  | 0.3264          | 0.4159 | 0.0849 |
| 0.6556        | 58.44 | 9000  | 0.3213          | 0.4100 | 0.0835 |
| 0.6484        | 61.69 | 9500  | 0.3182          | 0.4124 | 0.0837 |
| 0.6407        | 64.93 | 10000 | 0.3171          | 0.4050 | 0.0825 |
| 0.6375        | 68.18 | 10500 | 0.3150          | 0.4039 | 0.0822 |
| 0.6363        | 71.43 | 11000 | 0.3129          | 0.3991 | 0.0810 |
| 0.6307        | 74.67 | 11500 | 0.3114          | 0.3986 | 0.0807 |
| 0.6232        | 77.92 | 12000 | 0.3103          | 0.3895 | 0.0790 |
| 0.6216        | 81.17 | 12500 | 0.3086          | 0.3891 | 0.0790 |
| 0.6174        | 84.41 | 13000 | 0.3082          | 0.3881 | 0.0785 |
| 0.6196        | 87.66 | 13500 | 0.3059          | 0.3875 | 0.0782 |
| 0.6174        | 90.91 | 14000 | 0.3084          | 0.3862 | 0.0780 |
| 0.6169        | 94.16 | 14500 | 0.3070          | 0.3860 | 0.0779 |
| 0.6166        | 97.4  | 15000 | 0.3066          | 0.3855 | 0.0778 |


### Framework versions

- Transformers 4.16.2
- Pytorch 1.10.2+cu102
- Datasets 1.18.3
- Tokenizers 0.11.0