File size: 1,941 Bytes
1ad20a2
3919e78
 
 
 
 
1ad20a2
3919e78
979ab0d
 
54fd7f8
979ab0d
54fd7f8
979ab0d
3919e78
793e40d
 
 
3919e78
 
 
979ab0d
3919e78
 
 
979ab0d
a7d67c8
bbd7189
f680768
979ab0d
6fd137f
979ab0d
3919e78
 
 
979ab0d
5f4f05a
f2c092d
bfe9086
f2c092d
979ab0d
54fd7f8
 
979ab0d
793e40d
 
 
 
 
 
 
 
 
979ab0d
3919e78
 
979ab0d
 
3919e78
f680768
979ab0d
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
---
tags:
- generated_from_keras_callback
model-index:
- name: juancopi81/mutopia_guitar_mmm
  results: []
---

<!-- This model card has been generated automatically according to the information Keras had access to. You should
probably proofread and complete it, then remove this comment. -->

# juancopi81/mutopia_guitar_mmm

This model was trained from scratch on an unknown dataset.
It achieves the following results on the evaluation set:
- Train Loss: 2.5011
- Validation Loss: 2.6970
- Epoch: 9

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- optimizer: {'name': 'AdamWeightDecay', 'learning_rate': {'class_name': 'WarmUp', 'config': {'initial_learning_rate': 5e-07, 'decay_schedule_fn': {'class_name': 'PolynomialDecay', 'config': {'initial_learning_rate': 5e-07, 'decay_steps': 350, 'end_learning_rate': 0.0, 'power': 1.0, 'cycle': False, 'name': None}, '__passive_serialization__': True}, 'warmup_steps': 1000, 'power': 1.0, 'name': None}}, 'decay': 0.0, 'beta_1': 0.9, 'beta_2': 0.999, 'epsilon': 1e-08, 'amsgrad': False, 'weight_decay_rate': 0.01}
- training_precision: mixed_float16

### Training results

| Train Loss | Validation Loss | Epoch |
|:----------:|:---------------:|:-----:|
| 2.6769     | 2.8894          | 0     |
| 2.6719     | 2.8791          | 1     |
| 2.6612     | 2.8638          | 2     |
| 2.6465     | 2.8439          | 3     |
| 2.6242     | 2.8174          | 4     |
| 2.6006     | 2.7877          | 5     |
| 2.5679     | 2.7554          | 6     |
| 2.5387     | 2.7223          | 7     |
| 2.5115     | 2.7029          | 8     |
| 2.5011     | 2.6970          | 9     |


### Framework versions

- Transformers 4.22.2
- TensorFlow 2.8.2
- Datasets 2.5.1
- Tokenizers 0.12.1