Seungjun
/

t5-small-finetuned-epoch15-finetuned-epoch30

+---
+license: apache-2.0
+tags:
+- generated_from_trainer
+metrics:
+- rouge
+model-index:
+- name: t5-small-finetuned-epoch15-finetuned-epoch30
+  results: []
+---
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+# t5-small-finetuned-epoch15-finetuned-epoch30
+This model is a fine-tuned version of [Seungjun/t5-small-finetuned-epoch15](https://huggingface.co/Seungjun/t5-small-finetuned-epoch15) on an unknown dataset.
+It achieves the following results on the evaluation set:
+- Loss: 1.4083
+- Rouge1: 31.0064
+- Rouge2: 19.0446
+- Rougel: 27.7086
+- Rougelsum: 29.5158
+- Gen Len: 18.9941
+## Model description
+More information needed
+## Intended uses & limitations
+More information needed
+## Training and evaluation data
+More information needed
+## Training procedure
+### Training hyperparameters
+The following hyperparameters were used during training:
+- learning_rate: 2e-05
+- train_batch_size: 16
+- eval_batch_size: 16
+- seed: 42
+- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
+- lr_scheduler_type: linear
+- num_epochs: 15
+- mixed_precision_training: Native AMP
+### Training results
+| Training Loss | Epoch | Step  | Validation Loss | Rouge1  | Rouge2  | Rougel  | Rougelsum | Gen Len |
+|:-------------:|:-----:|:-----:|:---------------:|:-------:|:-------:|:-------:|:---------:|:-------:|
+| 1.6224        | 1.0   | 765   | 1.4499          | 30.3772 | 18.075  | 26.941  | 28.8424   | 18.9915 |
+| 1.586         | 2.0   | 1530  | 1.4403          | 30.4972 | 18.3407 | 27.1242 | 29.0417   | 18.9908 |
+| 1.5684        | 3.0   | 2295  | 1.4323          | 30.6617 | 18.4827 | 27.2642 | 29.2175   | 18.9921 |
+| 1.5622        | 4.0   | 3060  | 1.4300          | 30.7155 | 18.5604 | 27.3201 | 29.2191   | 18.9941 |
+| 1.5447        | 5.0   | 3825  | 1.4229          | 30.7883 | 18.7051 | 27.379  | 29.2824   | 18.9941 |
+| 1.5382        | 6.0   | 4590  | 1.4199          | 30.7555 | 18.7235 | 27.4249 | 29.2612   | 18.9941 |
+| 1.5303        | 7.0   | 5355  | 1.4187          | 30.7818 | 18.773  | 27.4232 | 29.2896   | 18.9941 |
+| 1.5225        | 8.0   | 6120  | 1.4149          | 30.8854 | 18.8302 | 27.5499 | 29.3993   | 18.9941 |
+| 1.5197        | 9.0   | 6885  | 1.4143          | 30.9201 | 18.863  | 27.5918 | 29.4395   | 18.9941 |
+| 1.5123        | 10.0  | 7650  | 1.4119          | 30.9469 | 18.9403 | 27.6186 | 29.4314   | 18.9941 |
+| 1.5209        | 11.0  | 8415  | 1.4107          | 30.9685 | 18.9431 | 27.6189 | 29.4673   | 18.9941 |
+| 1.5091        | 12.0  | 9180  | 1.4095          | 30.9249 | 18.9679 | 27.6257 | 29.4341   | 18.9941 |
+| 1.4998        | 13.0  | 9945  | 1.4091          | 30.9911 | 19.0416 | 27.695  | 29.4991   | 18.9941 |
+| 1.505         | 14.0  | 10710 | 1.4085          | 30.9942 | 19.0321 | 27.6999 | 29.5025   | 18.9941 |
+| 1.4965        | 15.0  | 11475 | 1.4083          | 31.0064 | 19.0446 | 27.7086 | 29.5158   | 18.9941 |
+### Framework versions
+- Transformers 4.26.1
+- Pytorch 1.13.1+cu116
+- Tokenizers 0.13.2