emre commited on
Commit
7e8302e
1 Parent(s): d19e1a7

update readme.md

Browse files
Files changed (1) hide show
  1. README.md +32 -4
README.md CHANGED
@@ -45,8 +45,36 @@ model = Wav2Vec2ForCTC.from_pretrained("emre/wav2vec-tr-lite-AG")
45
 
46
  resampler = torchaudio.transforms.Resample(48_000, 16_000)
47
 
48
- **Test Result**: 27.30 %
49
-
50
-
51
- [here](https://adresgezgini.com)
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
52
 
 
45
 
46
  resampler = torchaudio.transforms.Resample(48_000, 16_000)
47
 
48
+ ### Training hyperparameters
49
+ The following hyperparameters were used during training:
50
+ - learning_rate: 0.00005
51
+ - train_batch_size: 2
52
+ - eval_batch_size: 8
53
+ - seed: 42
54
+ - distributed_type: multi-GPU
55
+ - num_devices: 2
56
+ - gradient_accumulation_steps: 8
57
+ - total_train_batch_size: 32
58
+ - total_eval_batch_size: 16
59
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
60
+ - lr_scheduler_type: linear
61
+ - lr_scheduler_warmup_steps: 500
62
+ - num_epochs: 30.0
63
+ - mixed_precision_training: Native AMP
64
+ ### Training results
65
+ | Training Loss | Epoch | Step | Validation Loss | Wer |
66
+ |:-------------:|:-----:|:----:|:---------------:|:------:|
67
+ | 0.4388 | 3.7 | 400 | 1.366 | 0.9701 |
68
+ | 0.3766 | 7.4 | 800 | 0.4914 | 0.5374 |
69
+ | 0.2295 | 11.11 | 1200 | 0.3934 | 0.4125 |
70
+ | 0.1121 | 14.81 | 1600 | 0.3264 | 0.2904 |
71
+ | 0.1473 | 18.51 | 2000 | 0.3103 | 0.2671 |
72
+ | 0.1013 | 22.22 | 2400 | 0.2589 | 0.2324 |
73
+ | 0.0704 | 25.92 | 2800 | 0.2826 | 0.2339 |
74
+ | 0.0537 | 29.63 | 3200 | 0.2704 | 0.2309 |
75
+ ### Framework versions
76
+ - Transformers 4.12.0.dev0
77
+ - Pytorch 1.8.1
78
+ - Datasets 1.14.1.dev0
79
+ - Tokenizers 0.10.3
80