File size: 11,630 Bytes
73e298d
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
---
license: apache-2.0
base_model: t5-base
tags:
- generated_from_trainer
metrics:
- rouge
model-index:
- name: t5-base-finetuned-ehealth
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# t5-base-finetuned-ehealth

This model is a fine-tuned version of [t5-base](https://huggingface.co/t5-base) on an unknown dataset.
It achieves the following results on the evaluation set:
- Loss: 1.3953
- Rouge1: 16.9989
- Rouge2: 4.8395
- Rougel: 13.1702
- Rougelsum: 15.6472
- Gen Len: 19.0

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 2e-05
- train_batch_size: 8
- eval_batch_size: 8
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 100

### Training results

| Training Loss | Epoch | Step | Validation Loss | Rouge1  | Rouge2 | Rougel  | Rougelsum | Gen Len |
|:-------------:|:-----:|:----:|:---------------:|:-------:|:------:|:-------:|:---------:|:-------:|
| No log        | 1.0   | 22   | 4.2413          | 9.137   | 1.2333 | 6.9806  | 8.1957    | 18.6901 |
| No log        | 2.0   | 44   | 3.5352          | 9.5584  | 1.2176 | 7.2081  | 8.5048    | 18.8187 |
| No log        | 3.0   | 66   | 3.3124          | 9.9504  | 1.2105 | 7.4652  | 8.7962    | 18.8187 |
| No log        | 4.0   | 88   | 3.2065          | 10.3375 | 1.1847 | 7.7904  | 9.1801    | 18.8947 |
| No log        | 5.0   | 110  | 3.1208          | 10.777  | 1.326  | 8.1305  | 9.6488    | 18.8947 |
| No log        | 6.0   | 132  | 3.0495          | 11.1502 | 1.4947 | 8.4386  | 9.9076    | 18.924  |
| No log        | 7.0   | 154  | 2.9851          | 11.1759 | 1.5744 | 8.4744  | 9.9534    | 18.924  |
| No log        | 8.0   | 176  | 2.9232          | 10.5745 | 1.5079 | 8.1888  | 9.4731    | 18.8363 |
| No log        | 9.0   | 198  | 2.8663          | 10.3156 | 1.452  | 8.1662  | 9.385     | 18.8947 |
| No log        | 10.0  | 220  | 2.8110          | 10.5445 | 1.6067 | 8.3821  | 9.6755    | 18.8538 |
| No log        | 11.0  | 242  | 2.7625          | 11.0628 | 1.6957 | 8.7832  | 10.1425   | 18.8947 |
| No log        | 12.0  | 264  | 2.7129          | 10.9152 | 1.8386 | 8.7865  | 10.0545   | 18.8538 |
| No log        | 13.0  | 286  | 2.6680          | 10.8689 | 1.9024 | 8.6892  | 9.883     | 18.8889 |
| No log        | 14.0  | 308  | 2.6235          | 10.4118 | 1.9101 | 8.2442  | 9.4505    | 18.8947 |
| No log        | 15.0  | 330  | 2.5810          | 11.2578 | 2.0742 | 8.7641  | 10.2349   | 18.8947 |
| No log        | 16.0  | 352  | 2.5412          | 11.815  | 2.1727 | 9.2403  | 10.6655   | 18.9591 |
| No log        | 17.0  | 374  | 2.5056          | 11.8324 | 2.1849 | 9.2089  | 10.7361   | 18.9649 |
| No log        | 18.0  | 396  | 2.4710          | 11.4611 | 2.1406 | 8.9329  | 10.4319   | 18.8246 |
| No log        | 19.0  | 418  | 2.4365          | 12.0309 | 2.4387 | 9.3966  | 11.0327   | 18.8655 |
| No log        | 20.0  | 440  | 2.4039          | 11.9636 | 2.4332 | 9.3448  | 11.0055   | 18.8363 |
| No log        | 21.0  | 462  | 2.3734          | 12.709  | 2.6945 | 9.8722  | 11.572    | 18.7602 |
| No log        | 22.0  | 484  | 2.3414          | 13.2227 | 2.6249 | 10.1069 | 11.968    | 18.7895 |
| 3.1829        | 23.0  | 506  | 2.3132          | 13.3682 | 2.6082 | 10.1546 | 12.0317   | 18.8246 |
| 3.1829        | 24.0  | 528  | 2.2861          | 14.3195 | 3.0288 | 10.8036 | 12.8973   | 18.8713 |
| 3.1829        | 25.0  | 550  | 2.2592          | 14.1227 | 2.6271 | 10.6826 | 12.7174   | 18.9064 |
| 3.1829        | 26.0  | 572  | 2.2324          | 14.3697 | 2.8314 | 10.9239 | 13.0199   | 18.9064 |
| 3.1829        | 27.0  | 594  | 2.2054          | 14.4512 | 2.9546 | 11.0853 | 13.1193   | 18.9474 |
| 3.1829        | 28.0  | 616  | 2.1810          | 15.12   | 3.3732 | 11.5842 | 13.6805   | 18.9474 |
| 3.1829        | 29.0  | 638  | 2.1563          | 14.8242 | 3.2998 | 11.2467 | 13.3076   | 18.9474 |
| 3.1829        | 30.0  | 660  | 2.1333          | 15.0384 | 3.3988 | 11.4676 | 13.6825   | 18.9123 |
| 3.1829        | 31.0  | 682  | 2.1102          | 14.9877 | 3.3844 | 11.4417 | 13.5657   | 18.9591 |
| 3.1829        | 32.0  | 704  | 2.0884          | 14.9699 | 3.4128 | 11.4893 | 13.6109   | 18.9591 |
| 3.1829        | 33.0  | 726  | 2.0646          | 14.7391 | 3.0552 | 11.2351 | 13.3809   | 18.9591 |
| 3.1829        | 34.0  | 748  | 2.0419          | 14.9203 | 3.1074 | 11.2239 | 13.4966   | 18.9591 |
| 3.1829        | 35.0  | 770  | 2.0203          | 15.1875 | 3.2249 | 11.3843 | 13.8011   | 18.9591 |
| 3.1829        | 36.0  | 792  | 1.9988          | 15.1457 | 3.1865 | 11.5238 | 13.7114   | 18.9591 |
| 3.1829        | 37.0  | 814  | 1.9786          | 15.2334 | 3.3739 | 11.6124 | 13.8956   | 18.9591 |
| 3.1829        | 38.0  | 836  | 1.9580          | 15.7105 | 3.4331 | 11.8577 | 14.2217   | 18.9474 |
| 3.1829        | 39.0  | 858  | 1.9387          | 15.6612 | 3.5588 | 12.0279 | 14.2183   | 18.9474 |
| 3.1829        | 40.0  | 880  | 1.9210          | 15.8692 | 3.5665 | 12.0078 | 14.3505   | 18.9591 |
| 3.1829        | 41.0  | 902  | 1.9041          | 15.9888 | 3.6914 | 12.0342 | 14.3375   | 18.9591 |
| 3.1829        | 42.0  | 924  | 1.8834          | 15.9551 | 3.6863 | 12.0562 | 14.5444   | 18.9591 |
| 3.1829        | 43.0  | 946  | 1.8648          | 15.9107 | 3.9128 | 12.1663 | 14.5029   | 18.9591 |
| 3.1829        | 44.0  | 968  | 1.8468          | 15.9831 | 3.8588 | 12.196  | 14.5114   | 18.9591 |
| 3.1829        | 45.0  | 990  | 1.8290          | 15.9072 | 3.6844 | 12.1007 | 14.5031   | 18.9591 |
| 2.4484        | 46.0  | 1012 | 1.8127          | 15.9918 | 3.792  | 12.2569 | 14.5287   | 18.9591 |
| 2.4484        | 47.0  | 1034 | 1.7959          | 15.9685 | 3.7664 | 12.1033 | 14.473    | 18.9591 |
| 2.4484        | 48.0  | 1056 | 1.7799          | 15.7128 | 3.505  | 11.9947 | 14.216    | 18.9591 |
| 2.4484        | 49.0  | 1078 | 1.7636          | 15.8033 | 3.6874 | 12.1043 | 14.37     | 18.9591 |
| 2.4484        | 50.0  | 1100 | 1.7487          | 15.914  | 3.758  | 12.1635 | 14.4603   | 18.9591 |
| 2.4484        | 51.0  | 1122 | 1.7338          | 15.7088 | 3.7272 | 11.951  | 14.2862   | 18.9591 |
| 2.4484        | 52.0  | 1144 | 1.7202          | 15.7231 | 3.6274 | 12.0492 | 14.3036   | 18.9591 |
| 2.4484        | 53.0  | 1166 | 1.7081          | 15.6734 | 3.5837 | 11.9265 | 14.2674   | 18.9591 |
| 2.4484        | 54.0  | 1188 | 1.6935          | 15.6501 | 3.5574 | 11.8579 | 14.2387   | 18.9591 |
| 2.4484        | 55.0  | 1210 | 1.6793          | 15.8984 | 3.8029 | 12.0981 | 14.3888   | 18.9591 |
| 2.4484        | 56.0  | 1232 | 1.6666          | 15.7263 | 3.6691 | 12.0325 | 14.3152   | 18.9591 |
| 2.4484        | 57.0  | 1254 | 1.6516          | 15.8016 | 3.6151 | 12.0349 | 14.3556   | 18.9591 |
| 2.4484        | 58.0  | 1276 | 1.6385          | 15.8773 | 3.7501 | 12.1887 | 14.456    | 18.9591 |
| 2.4484        | 59.0  | 1298 | 1.6266          | 16.0252 | 3.8027 | 12.3099 | 14.5017   | 18.9591 |
| 2.4484        | 60.0  | 1320 | 1.6151          | 16.29   | 3.9544 | 12.5391 | 14.7691   | 18.9591 |
| 2.4484        | 61.0  | 1342 | 1.6034          | 16.2891 | 4.0512 | 12.5053 | 14.8155   | 18.9591 |
| 2.4484        | 62.0  | 1364 | 1.5925          | 16.1871 | 4.0482 | 12.4821 | 14.6986   | 18.9591 |
| 2.4484        | 63.0  | 1386 | 1.5812          | 16.1774 | 3.9903 | 12.4861 | 14.7798   | 18.9591 |
| 2.4484        | 64.0  | 1408 | 1.5716          | 16.1663 | 3.9399 | 12.4316 | 14.7449   | 18.9591 |
| 2.4484        | 65.0  | 1430 | 1.5623          | 16.4455 | 4.2777 | 12.7206 | 14.9193   | 18.9591 |
| 2.4484        | 66.0  | 1452 | 1.5517          | 16.466  | 4.2148 | 12.7613 | 15.052    | 18.9591 |
| 2.4484        | 67.0  | 1474 | 1.5414          | 16.5696 | 4.193  | 12.6949 | 15.1064   | 18.9591 |
| 2.4484        | 68.0  | 1496 | 1.5347          | 16.7602 | 4.4803 | 12.938  | 15.3339   | 18.9649 |
| 2.1379        | 69.0  | 1518 | 1.5278          | 16.6684 | 4.3943 | 12.9152 | 15.2626   | 18.9649 |
| 2.1379        | 70.0  | 1540 | 1.5193          | 16.7462 | 4.4151 | 12.9251 | 15.3619   | 18.9649 |
| 2.1379        | 71.0  | 1562 | 1.5104          | 16.658  | 4.4187 | 12.8792 | 15.2538   | 18.9591 |
| 2.1379        | 72.0  | 1584 | 1.5026          | 16.8475 | 4.481  | 13.0381 | 15.4041   | 18.9591 |
| 2.1379        | 73.0  | 1606 | 1.4944          | 16.9066 | 4.6433 | 13.1838 | 15.489    | 18.9591 |
| 2.1379        | 74.0  | 1628 | 1.4864          | 16.9434 | 4.6401 | 13.0527 | 15.4966   | 18.9591 |
| 2.1379        | 75.0  | 1650 | 1.4801          | 16.9744 | 4.694  | 13.1585 | 15.5739   | 19.0    |
| 2.1379        | 76.0  | 1672 | 1.4733          | 17.0546 | 4.6971 | 13.0968 | 15.633    | 19.0    |
| 2.1379        | 77.0  | 1694 | 1.4668          | 17.1603 | 4.7771 | 13.2896 | 15.7112   | 19.0    |
| 2.1379        | 78.0  | 1716 | 1.4607          | 17.086  | 4.7411 | 13.2587 | 15.6842   | 19.0    |
| 2.1379        | 79.0  | 1738 | 1.4552          | 17.0322 | 4.7652 | 13.2693 | 15.711    | 19.0    |
| 2.1379        | 80.0  | 1760 | 1.4493          | 17.1045 | 4.8492 | 13.2752 | 15.7876   | 19.0    |
| 2.1379        | 81.0  | 1782 | 1.4445          | 17.0275 | 4.8688 | 13.2621 | 15.7825   | 19.0    |
| 2.1379        | 82.0  | 1804 | 1.4392          | 17.0985 | 4.8148 | 13.2498 | 15.7718   | 19.0    |
| 2.1379        | 83.0  | 1826 | 1.4337          | 17.1395 | 4.8482 | 13.357  | 15.8122   | 19.0    |
| 2.1379        | 84.0  | 1848 | 1.4294          | 17.0411 | 4.8237 | 13.3126 | 15.7736   | 19.0    |
| 2.1379        | 85.0  | 1870 | 1.4254          | 17.1265 | 4.8691 | 13.3033 | 15.81     | 19.0    |
| 2.1379        | 86.0  | 1892 | 1.4212          | 16.9899 | 4.7712 | 13.1785 | 15.6416   | 19.0    |
| 2.1379        | 87.0  | 1914 | 1.4176          | 17.0389 | 4.7936 | 13.219  | 15.7048   | 19.0    |
| 2.1379        | 88.0  | 1936 | 1.4141          | 17.2266 | 4.9339 | 13.3935 | 15.8629   | 19.0    |
| 2.1379        | 89.0  | 1958 | 1.4108          | 17.0176 | 4.8752 | 13.2829 | 15.7145   | 19.0    |
| 2.1379        | 90.0  | 1980 | 1.4084          | 17.154  | 4.9912 | 13.3718 | 15.8255   | 19.0    |
| 1.9718        | 91.0  | 2002 | 1.4061          | 17.0783 | 4.9171 | 13.2617 | 15.7864   | 19.0    |
| 1.9718        | 92.0  | 2024 | 1.4037          | 17.0967 | 4.9393 | 13.2608 | 15.8054   | 19.0    |
| 1.9718        | 93.0  | 2046 | 1.4020          | 17.1524 | 4.995  | 13.332  | 15.8315   | 19.0    |
| 1.9718        | 94.0  | 2068 | 1.4001          | 17.1357 | 4.9699 | 13.3064 | 15.7932   | 19.0    |
| 1.9718        | 95.0  | 2090 | 1.3988          | 17.0758 | 4.8899 | 13.2231 | 15.7124   | 19.0    |
| 1.9718        | 96.0  | 2112 | 1.3976          | 16.9842 | 4.8395 | 13.173  | 15.653    | 19.0    |
| 1.9718        | 97.0  | 2134 | 1.3967          | 17.0425 | 4.8395 | 13.2243 | 15.6976   | 19.0    |
| 1.9718        | 98.0  | 2156 | 1.3960          | 16.9842 | 4.8395 | 13.173  | 15.653    | 19.0    |
| 1.9718        | 99.0  | 2178 | 1.3955          | 16.9842 | 4.8395 | 13.173  | 15.653    | 19.0    |
| 1.9718        | 100.0 | 2200 | 1.3953          | 16.9989 | 4.8395 | 13.1702 | 15.6472   | 19.0    |


### Framework versions

- Transformers 4.31.0
- Pytorch 2.0.1+cu118
- Datasets 2.14.1
- Tokenizers 0.13.3