Hugging Face's logo

RMWeerasinghe
/
long-t5-tglobal-base-finetuned-govReport-4096

Summarization
Transformers
Safetensors
longt5
text2text-generation
Generated from Trainer
Eval Results
Inference Endpoints
Model card Files Community
RMWeerasinghe commited on
Commit
e270ba3
•
1 Parent(s): 2278146

Training complete

Browse files
Files changed (3) hide show
  1. README.md +17 -18
  2. model.safetensors +1 -1
  3. training_args.bin +1 -1
README.md CHANGED
@@ -23,8 +23,7 @@ model-index:
23
  metrics:
24
  - name: Rouge1
25
  type: rouge
26
- value: 0.0463
27
- pipeline_tag: summarization
28
  ---
29
 
30
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
@@ -34,11 +33,11 @@ should probably proofread and complete it, then remove this comment. -->
34
 
35
  This model is a fine-tuned version of [google/long-t5-tglobal-base](https://huggingface.co/google/long-t5-tglobal-base) on the gov_report_summarization_dataset dataset.
36
  It achieves the following results on the evaluation set:
37
- - Loss: 1.3116
38
- - Rouge1: 0.0463
39
- - Rouge2: 0.0231
40
- - Rougel: 0.039
41
- - Rougelsum: 0.0436
42
 
43
  ## Model description
44
 
@@ -71,16 +70,16 @@ The following hyperparameters were used during training:
71
 
72
  | Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum |
73
  |:-------------:|:-----:|:----:|:---------------:|:------:|:------:|:------:|:---------:|
74
- | 14.9489 | 1.0 | 25 | 2.8019 | 0.0416 | 0.0156 | 0.0343 | 0.0383 |
75
- | 3.9751 | 2.0 | 50 | 2.0899 | 0.0396 | 0.0145 | 0.0332 | 0.0367 |
76
- | 3.0361 | 3.0 | 75 | 1.4337 | 0.0395 | 0.0138 | 0.033 | 0.0366 |
77
- | 1.8477 | 4.0 | 100 | 1.3654 | 0.0406 | 0.0157 | 0.0342 | 0.0378 |
78
- | 1.6709 | 5.0 | 125 | 1.3355 | 0.0419 | 0.0171 | 0.036 | 0.0394 |
79
- | 1.5673 | 6.0 | 150 | 1.3229 | 0.0446 | 0.022 | 0.0383 | 0.0423 |
80
- | 1.5567 | 7.0 | 175 | 1.3181 | 0.047 | 0.0233 | 0.0393 | 0.0441 |
81
- | 1.5066 | 8.0 | 200 | 1.3135 | 0.0467 | 0.0233 | 0.0394 | 0.0441 |
82
- | 1.515 | 9.0 | 225 | 1.3117 | 0.0462 | 0.0231 | 0.0389 | 0.0436 |
83
- | 1.4868 | 10.0 | 250 | 1.3116 | 0.0463 | 0.0231 | 0.039 | 0.0436 |
84
 
85
 
86
  ### Framework versions
@@ -88,4 +87,4 @@ The following hyperparameters were used during training:
88
  - Transformers 4.37.0
89
  - Pytorch 2.1.2
90
  - Datasets 2.1.0
91
- - Tokenizers 0.15.1
 
23
  metrics:
24
  - name: Rouge1
25
  type: rouge
26
+ value: 0.0432
 
27
  ---
28
 
29
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 
33
 
34
  This model is a fine-tuned version of [google/long-t5-tglobal-base](https://huggingface.co/google/long-t5-tglobal-base) on the gov_report_summarization_dataset dataset.
35
  It achieves the following results on the evaluation set:
36
+ - Loss: 1.4052
37
+ - Rouge1: 0.0432
38
+ - Rouge2: 0.0217
39
+ - Rougel: 0.0378
40
+ - Rougelsum: 0.0408
41
 
42
  ## Model description
43
 
 
70
 
71
  | Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum |
72
  |:-------------:|:-----:|:----:|:---------------:|:------:|:------:|:------:|:---------:|
73
+ | 15.9484 | 0.99 | 31 | 2.7412 | 0.0382 | 0.0142 | 0.0319 | 0.0354 |
74
+ | 3.0143 | 1.98 | 62 | 1.7096 | 0.0385 | 0.0144 | 0.032 | 0.0355 |
75
+ | 2.1893 | 2.98 | 93 | 1.4976 | 0.0376 | 0.0138 | 0.0313 | 0.0347 |
76
+ | 1.6128 | 4.0 | 125 | 1.4406 | 0.041 | 0.0174 | 0.0354 | 0.0387 |
77
+ | 1.5438 | 4.99 | 156 | 1.4292 | 0.043 | 0.0203 | 0.0368 | 0.0408 |
78
+ | 1.5015 | 5.98 | 187 | 1.4220 | 0.0427 | 0.0205 | 0.0367 | 0.0405 |
79
+ | 1.4723 | 6.98 | 218 | 1.4071 | 0.0431 | 0.0215 | 0.0376 | 0.0408 |
80
+ | 1.4707 | 8.0 | 250 | 1.4089 | 0.0427 | 0.0212 | 0.0373 | 0.0405 |
81
+ | 1.4447 | 8.99 | 281 | 1.4046 | 0.0431 | 0.0216 | 0.0379 | 0.0408 |
82
+ | 1.4884 | 9.92 | 310 | 1.4052 | 0.0432 | 0.0217 | 0.0378 | 0.0408 |
83
 
84
 
85
  ### Framework versions
 
87
  - Transformers 4.37.0
88
  - Pytorch 2.1.2
89
  - Datasets 2.1.0
90
+ - Tokenizers 0.15.1
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:58daa68bbb03c009ee41c3db61abf0662cf019c6d50f8c548f6f89c8c30fdee6
3
  size 990386200
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:186201a64d3dc814eff82915bb9385a1315a260d4ee1d8c080aa921889cd9ed5
3
  size 990386200
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a0b9a09b607c85d28b0c5363b331fd130cabf278c9c08b22386264def78593f7
3
  size 4856
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:263b692ae8319f5d91e5b3b6b9c0253558697297ce7ecb94fba2c7f384343c1a
3
  size 4856