denden commited on
Commit
987f2d3
1 Parent(s): a9d1367

update model card README.md

Browse files
Files changed (1) hide show
  1. README.md +67 -0
README.md ADDED
@@ -0,0 +1,67 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ tags:
4
+ - generated_from_trainer
5
+ model-index:
6
+ name: iloko_model
7
+ ---
8
+
9
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
10
+ should probably proofread and complete it, then remove this comment. -->
11
+
12
+ # iloko_model
13
+
14
+ This model is a fine-tuned version of [facebook/wav2vec2-large-xlsr-53](https://huggingface.co/facebook/wav2vec2-large-xlsr-53) on an unknown dataset.
15
+ It achieves the following results on the evaluation set:
16
+ - Loss: 0.0663
17
+ - Wer: 0.1235
18
+
19
+ ## Model description
20
+
21
+ More information needed
22
+
23
+ ## Intended uses & limitations
24
+
25
+ More information needed
26
+
27
+ ## Training and evaluation data
28
+
29
+ More information needed
30
+
31
+ ## Training procedure
32
+
33
+ ### Training hyperparameters
34
+
35
+ The following hyperparameters were used during training:
36
+ - learning_rate: 0.0003
37
+ - train_batch_size: 8
38
+ - eval_batch_size: 8
39
+ - seed: 42
40
+ - gradient_accumulation_steps: 2
41
+ - total_train_batch_size: 16
42
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
43
+ - lr_scheduler_type: linear
44
+ - lr_scheduler_warmup_steps: 500
45
+ - num_epochs: 10
46
+
47
+ ### Training results
48
+
49
+ | Training Loss | Epoch | Step | Validation Loss | Wer |
50
+ |:-------------:|:-----:|:----:|:---------------:|:------:|
51
+ | 3.4454 | 1.11 | 100 | 3.0569 | 1.0 |
52
+ | 2.6883 | 2.22 | 200 | 2.6725 | 1.0 |
53
+ | 2.6082 | 3.33 | 300 | 2.6133 | 1.0 |
54
+ | 1.7907 | 4.44 | 400 | 1.4020 | 0.9996 |
55
+ | 0.5616 | 5.56 | 500 | 0.2521 | 0.3217 |
56
+ | 0.2554 | 6.67 | 600 | 0.1373 | 0.1981 |
57
+ | 0.1604 | 7.78 | 700 | 0.0904 | 0.1468 |
58
+ | 0.1507 | 8.89 | 800 | 0.0740 | 0.1308 |
59
+ | 0.1012 | 10.0 | 900 | 0.0663 | 0.1235 |
60
+
61
+
62
+ ### Framework versions
63
+
64
+ - Transformers 4.11.3
65
+ - Pytorch 1.10.0+cu102
66
+ - Datasets 1.13.3
67
+ - Tokenizers 0.10.3