End of training

README.md

@@ -1,8 +1,10 @@
 ---
 license: apache-2.0
-base_model: facebook/wav2vec2-base
+base_model: Thienpkae/wav2vec2-large-xls-r-vi-colab
 tags:
 - generated_from_trainer
+metrics:
+- wer
 model-index:
 - name: wav2vec2-large-xls-r-vi-colab
   results: []
@@ -13,7 +15,11 @@ should probably proofread and complete it, then remove this comment. -->
 
 # wav2vec2-large-xls-r-vi-colab
 
-This model is a fine-tuned version of [facebook/wav2vec2-base](https://huggingface.co/facebook/wav2vec2-base) on an unknown dataset.
+This model is a fine-tuned version of [Thienpkae/wav2vec2-large-xls-r-vi-colab](https://huggingface.co/Thienpkae/wav2vec2-large-xls-r-vi-colab) on an unknown dataset.
+It achieves the following results on the evaluation set:
+- Loss: 1.8989
+- Wer: 0.9376
+- Cer: 0.3861
 
 ## Model description
 
@@ -32,20 +38,24 @@ More information needed
 ### Training hyperparameters
 
 The following hyperparameters were used during training:
-- learning_rate: 0.0003
-- train_batch_size: 16
+- learning_rate: 0.0001
+- train_batch_size: 8
 - eval_batch_size: 8
 - seed: 42
-- gradient_accumulation_steps: 2
-- total_train_batch_size: 32
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: linear
-- lr_scheduler_warmup_steps: 500
+- lr_scheduler_warmup_steps: 330
 - num_epochs: 30
 - mixed_precision_training: Native AMP
 
 ### Training results
 
+| Training Loss | Epoch | Step | Validation Loss | Wer    | Cer    |
+|:-------------:|:-----:|:----:|:---------------:|:------:|:------:|
+| 3.533         | 7.5   | 165  | 3.3635          | 1.0    | 1.0    |
+| 3.5135        | 15.0  | 330  | 3.3336          | 1.0    | 1.0    |
+| 3.6414        | 22.5  | 495  | 3.0578          | 0.9995 | 0.8722 |
+| 2.1098        | 30.0  | 660  | 1.8989          | 0.9376 | 0.3861 |
 
 
 ### Framework versions

config.json

@@ -1,5 +1,5 @@
 {
-  "_name_or_path": "facebook/wav2vec2-base",
+  "_name_or_path": "Thienpkae/wav2vec2-large-xls-r-vi-colab",
   "activation_dropout": 0.0,
   "adapter_attn_dim": null,
   "adapter_kernel_size": 3,

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:b822566cdbefb3e6a0cf578dfed79aaedb5f674c383793778fbf17233ce840f8
+oid sha256:1852cda5ba479a97363810a19a078b2b915cbe7c427159e2b83da631e434ce9f
 size 377807992

runs/Jun23_11-23-57_d5a25a5fd0bf/events.out.tfevents.1719141863.d5a25a5fd0bf.226.1

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7b7574d6e4b2a481a88a9e766cfbeb5ac97e467ab50c3a278659569652c77cb9
+size 6587

runs/Jun23_11-31-12_d5a25a5fd0bf/events.out.tfevents.1719142295.d5a25a5fd0bf.226.2

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ca371cdecb95c6f1c484e46dd03f271ec69481aa8e57ea6e6a0a4944f50627a0
+size 9244

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:748ea3b99de7f68050ebcfe25bf624e5fafd25379eeb17c14a615004d439b865
+oid sha256:1bbb4c33245ac2ddda00f5a988bf816feb4ce96aa0a1c3bd1818957816c58043
 size 5112