End of training

README.md

@@ -1,6 +1,6 @@
 ---
 license: apache-2.0
-base_model: facebook/wav2vec2-large-xlsr-53
+base_model: paruwka/wav2vec2-base-timit-demo-google-colab
 tags:
 - generated_from_trainer
 metrics:
@@ -15,10 +15,10 @@ should probably proofread and complete it, then remove this comment. -->
 
 # wav2vec2-base-timit-demo-google-colab
 
-This model is a fine-tuned version of [facebook/wav2vec2-large-xlsr-53](https://huggingface.co/facebook/wav2vec2-large-xlsr-53) on the None dataset.
+This model is a fine-tuned version of [paruwka/wav2vec2-base-timit-demo-google-colab](https://huggingface.co/paruwka/wav2vec2-base-timit-demo-google-colab) on the None dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.9022
-- Wer: 0.7197
+- Loss: 1.0015
+- Wer: 0.5828
 
 ## Model description
 
@@ -37,23 +37,31 @@ More information needed
 ### Training hyperparameters
 
 The following hyperparameters were used during training:
-- learning_rate: 0.0001
-- train_batch_size: 8
+- learning_rate: 3e-05
+- train_batch_size: 4
 - eval_batch_size: 8
 - seed: 42
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: linear
-- lr_scheduler_warmup_steps: 1000
-- num_epochs: 30
+- lr_scheduler_warmup_steps: 500
+- num_epochs: 50
 - mixed_precision_training: Native AMP
 
 ### Training results
 
 | Training Loss | Epoch | Step | Validation Loss | Wer    |
 |:-------------:|:-----:|:----:|:---------------:|:------:|
-| 9.9291        | 8.93  | 500  | 3.1984          | 1.0    |
-| 2.9471        | 17.86 | 1000 | 2.8526          | 1.0    |
-| 1.5367        | 26.79 | 1500 | 0.9022          | 0.7197 |
+| 0.4127        | 4.46  | 500  | 0.8997          | 0.6221 |
+| 0.38          | 8.93  | 1000 | 0.9162          | 0.6091 |
+| 0.3382        | 13.39 | 1500 | 0.9044          | 0.6011 |
+| 0.3074        | 17.86 | 2000 | 0.9529          | 0.6030 |
+| 0.274         | 22.32 | 2500 | 0.9327          | 0.5919 |
+| 0.2558        | 26.79 | 3000 | 0.9906          | 0.5895 |
+| 0.2462        | 31.25 | 3500 | 0.9873          | 0.5854 |
+| 0.2215        | 35.71 | 4000 | 1.0059          | 0.5839 |
+| 0.2313        | 40.18 | 4500 | 1.0142          | 0.5823 |
+| 0.2182        | 44.64 | 5000 | 0.9998          | 0.5804 |
+| 0.2123        | 49.11 | 5500 | 1.0015          | 0.5828 |
 
 
 ### Framework versions

config.json

@@ -1,5 +1,5 @@
 {
-  "_name_or_path": "facebook/wav2vec2-large-xlsr-53",
+  "_name_or_path": "paruwka/wav2vec2-base-timit-demo-google-colab",
   "activation_dropout": 0.0,
   "adapter_attn_dim": null,
   "adapter_kernel_size": 3,

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:189b0cad850baa88393909a48e7174665a184ef754f72146c0a340715eabe05a
+oid sha256:25c57b40a49657db7423cca0768535f00e5c70164d2ae0a6b5eb9f0003e2be70
 size 1262073980

runs/May26_01-07-46_95fc9086696a/events.out.tfevents.1716685684.95fc9086696a.34.2

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1afe88f93450c2362c97c69237c7264d60cd95c0575090d1e899786c25ad9288
+size 8303

runs/May26_01-46-10_95fc9086696a/events.out.tfevents.1716687989.95fc9086696a.34.3

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c826cd95aa7836bb427d418442c17b385ba525d1bfc05ab7b0a59da0b7a7a67a
+size 12534

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:070cd8a669f30108a2a693d99bbef862c1bd4f914569ba0172f4d0898b6fda25
+oid sha256:640119fe9ad7b83ca8c9edcd0742999a1f0971d383a00f6ed87c02dc0cc192c4
 size 4920