Oysiyl commited on
Commit
bf92cea
1 Parent(s): d2af5d1

End of training

Browse files
README.md CHANGED
@@ -2,8 +2,8 @@
2
  base_model: ylacombe/w2v-bert-2.0
3
  tags:
4
  - generated_from_trainer
5
- datasets:
6
- - common_voice_16_0
7
  model-index:
8
  - name: w2v-bert-2.0-ukrainian-colab-CV16.0
9
  results: []
@@ -14,7 +14,10 @@ should probably proofread and complete it, then remove this comment. -->
14
 
15
  # w2v-bert-2.0-ukrainian-colab-CV16.0
16
 
17
- This model is a fine-tuned version of [ylacombe/w2v-bert-2.0](https://huggingface.co/ylacombe/w2v-bert-2.0) on the common_voice_16_0 dataset.
 
 
 
18
 
19
  ## Model description
20
 
@@ -42,11 +45,18 @@ The following hyperparameters were used during training:
42
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
43
  - lr_scheduler_type: linear
44
  - lr_scheduler_warmup_steps: 500
45
- - num_epochs: 1
46
  - mixed_precision_training: Native AMP
47
 
48
  ### Training results
49
 
 
 
 
 
 
 
 
50
 
51
 
52
  ### Framework versions
 
2
  base_model: ylacombe/w2v-bert-2.0
3
  tags:
4
  - generated_from_trainer
5
+ metrics:
6
+ - wer
7
  model-index:
8
  - name: w2v-bert-2.0-ukrainian-colab-CV16.0
9
  results: []
 
14
 
15
  # w2v-bert-2.0-ukrainian-colab-CV16.0
16
 
17
+ This model is a fine-tuned version of [ylacombe/w2v-bert-2.0](https://huggingface.co/ylacombe/w2v-bert-2.0) on the None dataset.
18
+ It achieves the following results on the evaluation set:
19
+ - Loss: 0.1408
20
+ - Wer: 0.0965
21
 
22
  ## Model description
23
 
 
45
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
46
  - lr_scheduler_type: linear
47
  - lr_scheduler_warmup_steps: 500
48
+ - num_epochs: 10
49
  - mixed_precision_training: Native AMP
50
 
51
  ### Training results
52
 
53
+ | Training Loss | Epoch | Step | Validation Loss | Wer |
54
+ |:-------------:|:-----:|:----:|:---------------:|:------:|
55
+ | 0.8623 | 1.98 | 520 | 0.1485 | 0.1552 |
56
+ | 0.0716 | 3.96 | 1040 | 0.1323 | 0.1285 |
57
+ | 0.0383 | 5.94 | 1560 | 0.1214 | 0.1044 |
58
+ | 0.0222 | 7.92 | 2080 | 0.1267 | 0.0984 |
59
+ | 0.0127 | 9.9 | 2600 | 0.1408 | 0.0965 |
60
 
61
 
62
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:42a1b5f40624a482f8ced0d630284222701dfc5dee47b03d5858ac0658052a58
3
  size 2422970360
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9a75bf069ba2a2cd492856a75f23b6e8bcb53ab192642f42570c9f36672c1b32
3
  size 2422970360
runs/Jan31_15-57-30_nzdu7szc80/events.out.tfevents.1706717148.nzdu7szc80.32.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:9751804ad7d02b10618d4d211f658d02d4130066f1c8d82716e3ac55ddf15695
3
- size 8034
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7a53bc8393aad9230e286be6c46608bdd3b179dff8d598d0bad07932ff4830bb
3
+ size 8388