durgaphaniteja985 commited on
Commit
a78be4e
1 Parent(s): 8efaa3c

Training complete

Browse files
README.md CHANGED
@@ -3,22 +3,27 @@ library_name: transformers
3
  license: apache-2.0
4
  base_model: google/mt5-small
5
  tags:
6
- - generated_from_keras_callback
 
 
 
7
  model-index:
8
- - name: durgaphaniteja985/mt5-small-finetuned-amazon-en-es
9
  results: []
10
  ---
11
 
12
- <!-- This model card has been generated automatically according to the information Keras had access to. You should
13
- probably proofread and complete it, then remove this comment. -->
14
 
15
- # durgaphaniteja985/mt5-small-finetuned-amazon-en-es
16
 
17
  This model is a fine-tuned version of [google/mt5-small](https://huggingface.co/google/mt5-small) on an unknown dataset.
18
  It achieves the following results on the evaluation set:
19
- - Train Loss: 12.6767
20
- - Validation Loss: 6.4884
21
- - Epoch: 0
 
 
22
 
23
  ## Model description
24
 
@@ -37,19 +42,31 @@ More information needed
37
  ### Training hyperparameters
38
 
39
  The following hyperparameters were used during training:
40
- - optimizer: {'name': 'AdamWeightDecay', 'learning_rate': {'module': 'keras.optimizers.schedules', 'class_name': 'PolynomialDecay', 'config': {'initial_learning_rate': 5.6e-05, 'decay_steps': 6160, 'end_learning_rate': 0.0, 'power': 1.0, 'cycle': False, 'name': None}, 'registered_name': None}, 'decay': 0.0, 'beta_1': 0.9, 'beta_2': 0.999, 'epsilon': 1e-08, 'amsgrad': False, 'weight_decay_rate': 0.01}
41
- - training_precision: mixed_float16
 
 
 
 
 
42
 
43
  ### Training results
44
 
45
- | Train Loss | Validation Loss | Epoch |
46
- |:----------:|:---------------:|:-----:|
47
- | 12.6767 | 6.4884 | 0 |
 
 
 
 
 
 
 
48
 
49
 
50
  ### Framework versions
51
 
52
  - Transformers 4.46.2
53
- - TensorFlow 2.17.1
54
  - Datasets 3.1.0
55
  - Tokenizers 0.20.3
 
3
  license: apache-2.0
4
  base_model: google/mt5-small
5
  tags:
6
+ - summarization
7
+ - generated_from_trainer
8
+ metrics:
9
+ - rouge
10
  model-index:
11
+ - name: mt5-small-finetuned-amazon-en-es
12
  results: []
13
  ---
14
 
15
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
16
+ should probably proofread and complete it, then remove this comment. -->
17
 
18
+ # mt5-small-finetuned-amazon-en-es
19
 
20
  This model is a fine-tuned version of [google/mt5-small](https://huggingface.co/google/mt5-small) on an unknown dataset.
21
  It achieves the following results on the evaluation set:
22
+ - Loss: 3.2159
23
+ - Rouge1: 17.3504
24
+ - Rouge2: 8.219
25
+ - Rougel: 16.7598
26
+ - Rougelsum: 16.9027
27
 
28
  ## Model description
29
 
 
42
  ### Training hyperparameters
43
 
44
  The following hyperparameters were used during training:
45
+ - learning_rate: 5.6e-05
46
+ - train_batch_size: 8
47
+ - eval_batch_size: 8
48
+ - seed: 42
49
+ - optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
50
+ - lr_scheduler_type: linear
51
+ - num_epochs: 8
52
 
53
  ### Training results
54
 
55
+ | Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum |
56
+ |:-------------:|:-----:|:-----:|:---------------:|:-------:|:-------:|:-------:|:---------:|
57
+ | 5.8554 | 1.0 | 1541 | 3.4109 | 14.0843 | 7.0483 | 13.7876 | 13.7424 |
58
+ | 3.5936 | 2.0 | 3082 | 3.3110 | 16.9351 | 8.9452 | 16.1951 | 16.2707 |
59
+ | 3.2943 | 3.0 | 4623 | 3.2440 | 18.9749 | 10.2572 | 18.3207 | 18.3447 |
60
+ | 3.1378 | 4.0 | 6164 | 3.2157 | 17.5435 | 9.5501 | 16.976 | 16.9846 |
61
+ | 3.0374 | 5.0 | 7705 | 3.2017 | 17.2499 | 8.6003 | 16.8574 | 16.8485 |
62
+ | 2.9644 | 6.0 | 9246 | 3.1948 | 16.7856 | 7.7093 | 16.3617 | 16.4731 |
63
+ | 2.921 | 7.0 | 10787 | 3.2160 | 18.1708 | 8.8001 | 17.4812 | 17.5949 |
64
+ | 2.8907 | 8.0 | 12328 | 3.2159 | 17.3504 | 8.219 | 16.7598 | 16.9027 |
65
 
66
 
67
  ### Framework versions
68
 
69
  - Transformers 4.46.2
70
+ - Pytorch 2.5.1+cu121
71
  - Datasets 3.1.0
72
  - Tokenizers 0.20.3
generation_config.json CHANGED
@@ -1,5 +1,4 @@
1
  {
2
- "_from_model_config": true,
3
  "decoder_start_token_id": 0,
4
  "eos_token_id": 1,
5
  "pad_token_id": 0,
 
1
  {
 
2
  "decoder_start_token_id": 0,
3
  "eos_token_id": 1,
4
  "pad_token_id": 0,
runs/Dec04_02-45-50_64770b165a7b/events.out.tfevents.1733280360.64770b165a7b.187.1 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e254d0b86f51321fbe61b631dbb4706d9f6bbeff719b1f96bfba055112087f97
3
- size 10395
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f1ac26adbf57ab3b9eed884e8fb81904d800cb1921485717c6008488d6d32a41
3
+ size 11223
runs/Dec04_02-45-50_64770b165a7b/events.out.tfevents.1733286153.64770b165a7b.187.2 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b0dabfc7e8e462fa98f17c9ff7ac58c5eeead3fe7543b4d8143070e0aebaf399
3
+ size 562