Judah04 commited on
Commit
c101fd5
1 Parent(s): 270c8df

End of training

Browse files
README.md ADDED
@@ -0,0 +1,83 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: transformers
3
+ license: mit
4
+ base_model: microsoft/speecht5_tts
5
+ tags:
6
+ - generated_from_trainer
7
+ datasets:
8
+ - common_voice_17_0
9
+ model-index:
10
+ - name: SpeechT5-Hausa-5
11
+ results: []
12
+ ---
13
+
14
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
15
+ should probably proofread and complete it, then remove this comment. -->
16
+
17
+ # SpeechT5-Hausa-5
18
+
19
+ This model is a fine-tuned version of [microsoft/speecht5_tts](https://huggingface.co/microsoft/speecht5_tts) on the common_voice_17_0 dataset.
20
+ It achieves the following results on the evaluation set:
21
+ - Loss: 0.4702
22
+
23
+ ## Model description
24
+
25
+ More information needed
26
+
27
+ ## Intended uses & limitations
28
+
29
+ More information needed
30
+
31
+ ## Training and evaluation data
32
+
33
+ More information needed
34
+
35
+ ## Training procedure
36
+
37
+ ### Training hyperparameters
38
+
39
+ The following hyperparameters were used during training:
40
+ - learning_rate: 0.0001
41
+ - train_batch_size: 4
42
+ - eval_batch_size: 2
43
+ - seed: 42
44
+ - gradient_accumulation_steps: 8
45
+ - total_train_batch_size: 32
46
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
47
+ - lr_scheduler_type: linear
48
+ - lr_scheduler_warmup_steps: 200
49
+ - training_steps: 2000
50
+ - mixed_precision_training: Native AMP
51
+
52
+ ### Training results
53
+
54
+ | Training Loss | Epoch | Step | Validation Loss |
55
+ |:-------------:|:-------:|:----:|:---------------:|
56
+ | 0.6245 | 1.8476 | 100 | 0.5508 |
57
+ | 0.5758 | 3.6952 | 200 | 0.5566 |
58
+ | 0.5463 | 5.5427 | 300 | 0.5015 |
59
+ | 0.5299 | 7.3903 | 400 | 0.4968 |
60
+ | 0.5139 | 9.2379 | 500 | 0.4792 |
61
+ | 0.5132 | 11.0855 | 600 | 0.4823 |
62
+ | 0.4982 | 12.9330 | 700 | 0.4640 |
63
+ | 0.4889 | 14.7806 | 800 | 0.4649 |
64
+ | 0.4841 | 16.6282 | 900 | 0.4601 |
65
+ | 0.4795 | 18.4758 | 1000 | 0.4631 |
66
+ | 0.4779 | 20.3233 | 1100 | 0.4592 |
67
+ | 0.4642 | 22.1709 | 1200 | 0.4651 |
68
+ | 0.4618 | 24.0185 | 1300 | 0.4599 |
69
+ | 0.4583 | 25.8661 | 1400 | 0.4634 |
70
+ | 0.4584 | 27.7136 | 1500 | 0.4592 |
71
+ | 0.4539 | 29.5612 | 1600 | 0.4604 |
72
+ | 0.4498 | 31.4088 | 1700 | 0.4642 |
73
+ | 0.4428 | 33.2564 | 1800 | 0.4677 |
74
+ | 0.4517 | 35.1039 | 1900 | 0.4705 |
75
+ | 0.4371 | 36.9515 | 2000 | 0.4702 |
76
+
77
+
78
+ ### Framework versions
79
+
80
+ - Transformers 4.44.2
81
+ - Pytorch 2.4.1+cu121
82
+ - Datasets 3.0.0
83
+ - Tokenizers 0.19.1
generation_config.json ADDED
@@ -0,0 +1,9 @@
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_from_model_config": true,
3
+ "bos_token_id": 0,
4
+ "decoder_start_token_id": 2,
5
+ "eos_token_id": 2,
6
+ "max_length": 1876,
7
+ "pad_token_id": 1,
8
+ "transformers_version": "4.44.2"
9
+ }
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:15cff9f9c65ed8b3801c72bc2a514950563516b2fe69964fb9458bc25ef8890e
3
  size 577789320
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e5ba5098d6e77a0c3f13907eb1801deadde93e8e2dd1a55c92fa76c8634ab6d9
3
  size 577789320
runs/Sep24_19-03-36_af4b4aad8c4a/events.out.tfevents.1727204618.af4b4aad8c4a.712.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4560373dd8e7186e4a1f233f8cff5476cebc0fa703817f140bdd9dafe6c7781c
3
- size 27754
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:aff060e91e7e7d8176b6012f631c9a6c6976106a767ddfdcdc419e1e0a565aba
3
+ size 29223