End of training

README.md

@@ -1,13 +1,28 @@
 ---
-base_model: facebook/wav2vec2-base
 license: apache-2.0
-metrics:
-- wer
+base_model: facebook/wav2vec2-base
 tags:
 - generated_from_trainer
+datasets:
+- common_voice_13_0
+metrics:
+- wer
 model-index:
 - name: wav2vec2-large-xls-r-vi-colab
-  results: []
+  results:
+  - task:
+      name: Automatic Speech Recognition
+      type: automatic-speech-recognition
+    dataset:
+      name: common_voice_13_0
+      type: common_voice_13_0
+      config: vi
+      split: test[:50%]
+      args: vi
+    metrics:
+    - name: Wer
+      type: wer
+      value: 0.9155054191550542
 ---
 
 <!-- This model card has been generated automatically according to the information the Trainer had access to. You
@@ -15,11 +30,11 @@ should probably proofread and complete it, then remove this comment. -->
 
 # wav2vec2-large-xls-r-vi-colab
 
-This model is a fine-tuned version of [facebook/wav2vec2-base](https://huggingface.co/facebook/wav2vec2-base) on an unknown dataset.
+This model is a fine-tuned version of [facebook/wav2vec2-base](https://huggingface.co/facebook/wav2vec2-base) on the common_voice_13_0 dataset.
 It achieves the following results on the evaluation set:
-- Loss: 4.5540
-- Wer: 1.0
-- Cer: 1.0
+- Loss: 2.0995
+- Wer: 0.9155
+- Cer: 0.4345
 
 ## Model description
 
@@ -38,32 +53,28 @@ More information needed
 ### Training hyperparameters
 
 The following hyperparameters were used during training:
-- learning_rate: 0.0001
-- train_batch_size: 8
+- learning_rate: 3e-05
+- train_batch_size: 16
 - eval_batch_size: 8
 - seed: 42
+- gradient_accumulation_steps: 2
+- total_train_batch_size: 32
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: linear
-- lr_scheduler_warmup_steps: 500
+- lr_scheduler_warmup_steps: 400
 - num_epochs: 30
 - mixed_precision_training: Native AMP
 
 ### Training results
 
-| Training Loss | Epoch   | Step | Validation Loss | Wer | Cer |
-|:-------------:|:-------:|:----:|:---------------:|:---:|:---:|
-| 9.6481        | 2.3864  | 315  | 4.4676          | 1.0 | 1.0 |
-| 3.8703        | 4.7727  | 630  | 4.4033          | 1.0 | 1.0 |
-| 3.4149        | 7.1591  | 945  | 4.7546          | 1.0 | 1.0 |
-| 3.4323        | 9.5455  | 1260 | 4.2532          | 1.0 | 1.0 |
-| 3.4127        | 11.9318 | 1575 | 4.6692          | 1.0 | 1.0 |
-| 3.4185        | 14.3182 | 1890 | 4.3411          | 1.0 | 1.0 |
-| 3.4112        | 16.7045 | 2205 | 4.5614          | 1.0 | 1.0 |
-| 3.4074        | 19.0909 | 2520 | 4.3545          | 1.0 | 1.0 |
-| 3.4073        | 21.4773 | 2835 | 4.4929          | 1.0 | 1.0 |
-| 3.4004        | 23.8636 | 3150 | 4.6089          | 1.0 | 1.0 |
-| 3.4099        | 26.25   | 3465 | 4.5189          | 1.0 | 1.0 |
-| 3.3972        | 28.6364 | 3780 | 4.5540          | 1.0 | 1.0 |
+| Training Loss | Epoch   | Step | Validation Loss | Wer    | Cer    |
+|:-------------:|:-------:|:----:|:---------------:|:------:|:------:|
+| 14.8797       | 4.4444  | 200  | 4.6129          | 1.0    | 1.0    |
+| 3.9436        | 8.8889  | 400  | 3.5521          | 1.0    | 1.0    |
+| 3.4845        | 13.3333 | 600  | 3.4997          | 1.0    | 1.0    |
+| 3.1358        | 17.7778 | 800  | 2.7899          | 1.0011 | 0.7023 |
+| 2.0727        | 22.2222 | 1000 | 2.2606          | 0.9600 | 0.4680 |
+| 1.5218        | 26.6667 | 1200 | 2.0995          | 0.9155 | 0.4345 |
 
 
 ### Framework versions

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:7477493f4612945a51cd7293ae24b7e2abf27783a06ece488f4f188396581282
+oid sha256:aa45cd4b97890476b42e8c26b766ca76273cab6d8d650392301be034cb9f44ab
 size 377811068

runs/Jul02_14-43-23_6883efef1353/events.out.tfevents.1719931446.6883efef1353.2517.0

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:1792e0501d28216453edafcadc4fed2b1a1d07f1109108fcf54e8aab2e7a9ec9
-size 10002
+oid sha256:c82096ec49a33a5aa4d544efc3b207920acca7564fe2a31709221e00c7abb761
+size 10356