Hugging Face's logo

shivraj221
/
mt5-small-finetuned-news-summary-kaggle

Summarization
Transformers
TensorBoard
Safetensors
mt5
text2text-generation
Generated from Trainer
Inference Endpoints
Model card Files Metrics Community
shivraj221 commited on
Commit
449dc9e
•
1 Parent(s): bcfef48

Training complete

Browse files
Files changed (3) hide show
  1. README.md +25 -21
  2. model.safetensors +1 -1
  3. training_args.bin +1 -1
README.md CHANGED
@@ -7,22 +7,22 @@ tags:
7
  metrics:
8
  - rouge
9
  model-index:
10
- - name: mt5-small-finetuned-news-summary-kaggle
11
  results: []
12
  ---
13
 
14
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
15
  should probably proofread and complete it, then remove this comment. -->
16
 
17
- # mt5-small-finetuned-news-summary-kaggle
18
 
19
  This model is a fine-tuned version of [google/mt5-small](https://huggingface.co/google/mt5-small) on the None dataset.
20
  It achieves the following results on the evaluation set:
21
- - Loss: 2.5691
22
- - Rouge1: 29.8633
23
- - Rouge2: 11.698
24
- - Rougel: 26.8739
25
- - Rougelsum: 26.8536
26
 
27
  ## Model description
28
 
@@ -41,26 +41,30 @@ More information needed
41
  ### Training hyperparameters
42
 
43
  The following hyperparameters were used during training:
44
- - learning_rate: 5.6e-05
45
- - train_batch_size: 8
46
- - eval_batch_size: 8
47
  - seed: 42
48
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
49
  - lr_scheduler_type: linear
50
- - num_epochs: 8
51
 
52
  ### Training results
53
 
54
- | Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum |
55
- |:-------------:|:-----:|:----:|:---------------:|:-------:|:-------:|:-------:|:---------:|
56
- | 8.1234 | 1.0 | 440 | 3.3123 | 18.1738 | 5.9811 | 16.7457 | 16.7126 |
57
- | 4.2107 | 2.0 | 880 | 2.8404 | 23.009 | 8.3824 | 20.9074 | 20.8962 |
58
- | 3.738 | 3.0 | 1320 | 2.7354 | 26.5696 | 10.1059 | 23.9321 | 24.0214 |
59
- | 3.4864 | 4.0 | 1760 | 2.6756 | 27.193 | 10.1971 | 24.4763 | 24.4933 |
60
- | 3.3642 | 5.0 | 2200 | 2.6224 | 28.7842 | 11.5323 | 26.317 | 26.3211 |
61
- | 3.269 | 6.0 | 2640 | 2.5883 | 29.6579 | 11.8043 | 26.8824 | 26.8692 |
62
- | 3.212 | 7.0 | 3080 | 2.5677 | 29.7513 | 11.6639 | 26.6042 | 26.64 |
63
- | 3.186 | 8.0 | 3520 | 2.5691 | 29.8633 | 11.698 | 26.8739 | 26.8536 |
 
 
 
 
64
 
65
 
66
  ### Framework versions
 
7
  metrics:
8
  - rouge
9
  model-index:
10
+ - name: mt5-small-finetuned-news-summary-model-2
11
  results: []
12
  ---
13
 
14
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
15
  should probably proofread and complete it, then remove this comment. -->
16
 
17
+ # mt5-small-finetuned-news-summary-model-2
18
 
19
  This model is a fine-tuned version of [google/mt5-small](https://huggingface.co/google/mt5-small) on the None dataset.
20
  It achieves the following results on the evaluation set:
21
+ - Loss: 2.5813
22
+ - Rouge1: 29.4322
23
+ - Rouge2: 11.4361
24
+ - Rougel: 26.3875
25
+ - Rougelsum: 26.297
26
 
27
  ## Model description
28
 
 
41
  ### Training hyperparameters
42
 
43
  The following hyperparameters were used during training:
44
+ - learning_rate: 4e-05
45
+ - train_batch_size: 10
46
+ - eval_batch_size: 10
47
  - seed: 42
48
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
49
  - lr_scheduler_type: linear
50
+ - num_epochs: 12
51
 
52
  ### Training results
53
 
54
+ | Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum |
55
+ |:-------------:|:-------:|:----:|:---------------:|:-------:|:-------:|:-------:|:---------:|
56
+ | 9.2632 | 0.9972 | 351 | 3.7059 | 17.3365 | 5.2307 | 15.438 | 15.3776 |
57
+ | 4.6719 | 1.9943 | 702 | 3.0896 | 19.5787 | 6.8278 | 18.0637 | 18.0255 |
58
+ | 4.1356 | 2.9915 | 1053 | 2.8713 | 22.5668 | 8.2899 | 20.551 | 20.5232 |
59
+ | 3.7852 | 3.9886 | 1404 | 2.7729 | 25.7974 | 9.9158 | 23.2398 | 23.2198 |
60
+ | 3.6194 | 4.9858 | 1755 | 2.7038 | 26.2572 | 10.0034 | 24.0326 | 23.9956 |
61
+ | 3.4864 | 5.9830 | 2106 | 2.6714 | 26.8149 | 9.9056 | 24.2704 | 24.1399 |
62
+ | 3.3965 | 6.9801 | 2457 | 2.6361 | 27.5399 | 10.3609 | 24.8286 | 24.7628 |
63
+ | 3.3422 | 7.9773 | 2808 | 2.6194 | 28.0298 | 10.6938 | 25.1678 | 25.0924 |
64
+ | 3.2879 | 8.9744 | 3159 | 2.5976 | 28.2324 | 10.6412 | 25.2803 | 25.1804 |
65
+ | 3.2391 | 9.9716 | 3510 | 2.5894 | 29.0155 | 11.174 | 25.9995 | 25.8843 |
66
+ | 3.2128 | 10.9688 | 3861 | 2.5854 | 29.3283 | 11.477 | 26.2235 | 26.1278 |
67
+ | 3.2214 | 11.9659 | 4212 | 2.5813 | 29.4322 | 11.4361 | 26.3875 | 26.297 |
68
 
69
 
70
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0c6a51a85ef8a35bd08569b68519e656f820733d333c1219e54e2c5b76508e49
3
  size 1200729512
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8ca8fd76fcc632f4fe26ab7e92addc98f6134cc016d4e316f9260cd1542dc811
3
  size 1200729512
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:29102fba08ecb0d89f128ba27346ffe9cd734e9599318962dbf69cb0c3db039a
3
  size 5304
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b2680773dcdab95b5b3b01bd56a6a2d36df425c74a3a59d0ca0d7af8e59ea38a
3
  size 5304