End of training

README.md

@@ -8,36 +8,35 @@ tags:
 - generated_from_trainer
 datasets:
 - mozilla-foundation/common_voice_16_1
-- google/fleurs
 metrics:
 - wer
 model-index:
-- name: Whisper Large MN - Ankhbayasgalan Davaadorj
+- name: 'Whisper Small MN - Ankhbayasgalan Davaadorj '
   results:
   - task:
       name: Automatic Speech Recognition
       type: automatic-speech-recognition
     dataset:
-      name: Common Voice 16.1 & FLEURS
+      name: Common Voice 16.1
       type: mozilla-foundation/common_voice_16_1
       config: mn
-      split: None
+      split: test
       args: 'config: mn, split: test+validation'
     metrics:
     - name: Wer
       type: wer
-      value: 56.63604862218799
+      value: 67.84162771514984
 ---
 
 <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 should probably proofread and complete it, then remove this comment. -->
 
-# Whisper Large MN - Ankhbayasgalan Davaadorj
+# Whisper Small MN - Ankhbayasgalan Davaadorj 
 
-This model is a fine-tuned version of [openai/whisper-large-v3](https://huggingface.co/openai/whisper-large-v3) on the Common Voice 16.1 & FLEURS dataset.
+This model is a fine-tuned version of [openai/whisper-large-v3](https://huggingface.co/openai/whisper-large-v3) on the Common Voice 16.1 dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.5084
-- Wer: 56.6360
+- Loss: 0.5096
+- Wer: 67.8416
 
 ## Model description
 
@@ -62,15 +61,17 @@ The following hyperparameters were used during training:
 - seed: 42
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: linear
-- lr_scheduler_warmup_steps: 10
-- training_steps: 100
+- lr_scheduler_warmup_steps: 500
+- training_steps: 3000
 - mixed_precision_training: Native AMP
 
 ### Training results
 
 | Training Loss | Epoch | Step | Validation Loss | Wer     |
 |:-------------:|:-----:|:----:|:---------------:|:-------:|
-| 0.3906        | 0.6   | 100  | 0.5084          | 56.6360 |
+| 0.0832        | 3.94  | 1000 | 0.3988          | 73.6211 |
+| 0.0051        | 7.87  | 2000 | 0.4563          | 66.0654 |
+| 0.0004        | 11.81 | 3000 | 0.5096          | 67.8416 |
 
 
 ### Framework versions

model-00001-of-00002.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:451cc1384f41fc345d67c819672d6fa00e6a78015a4014e5378d4c3754210656
+oid sha256:251938c11d5bfca4c98a1801d66c846319a6d84858176ac07698aa7a96410ccc
 size 4993448880

model-00002-of-00002.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:1b53cc62b97d6c53bdea1b2ab0bcd56537d3009e6c55fdfa16a62a8ceb29d7d2
+oid sha256:28e6dda3318792106e6dafc0ea5b7cca313d19f34a5029a6e42894c6fdb80445
 size 1180663192