---
license: apache-2.0
tags:
- generated_from_trainer
metrics:
- rouge
model-index:
- name: t5-small-finetuned-epoch15-finetuned-epoch30
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# t5-small-finetuned-epoch15-finetuned-epoch30

This model is a fine-tuned version of [Seungjun/t5-small-finetuned-epoch15](https://huggingface.co/Seungjun/t5-small-finetuned-epoch15) on an unknown dataset.
It achieves the following results on the evaluation set:
- Loss: 1.4083
- Rouge1: 31.0064
- Rouge2: 19.0446
- Rougel: 27.7086
- Rougelsum: 29.5158
- Gen Len: 18.9941

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 2e-05
- train_batch_size: 16
- eval_batch_size: 16
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 15
- mixed_precision_training: Native AMP

### Training results

| Training Loss | Epoch | Step  | Validation Loss | Rouge1  | Rouge2  | Rougel  | Rougelsum | Gen Len |
|:-------------:|:-----:|:-----:|:---------------:|:-------:|:-------:|:-------:|:---------:|:-------:|
| 1.6224        | 1.0   | 765   | 1.4499          | 30.3772 | 18.075  | 26.941  | 28.8424   | 18.9915 |
| 1.586         | 2.0   | 1530  | 1.4403          | 30.4972 | 18.3407 | 27.1242 | 29.0417   | 18.9908 |
| 1.5684        | 3.0   | 2295  | 1.4323          | 30.6617 | 18.4827 | 27.2642 | 29.2175   | 18.9921 |
| 1.5622        | 4.0   | 3060  | 1.4300          | 30.7155 | 18.5604 | 27.3201 | 29.2191   | 18.9941 |
| 1.5447        | 5.0   | 3825  | 1.4229          | 30.7883 | 18.7051 | 27.379  | 29.2824   | 18.9941 |
| 1.5382        | 6.0   | 4590  | 1.4199          | 30.7555 | 18.7235 | 27.4249 | 29.2612   | 18.9941 |
| 1.5303        | 7.0   | 5355  | 1.4187          | 30.7818 | 18.773  | 27.4232 | 29.2896   | 18.9941 |
| 1.5225        | 8.0   | 6120  | 1.4149          | 30.8854 | 18.8302 | 27.5499 | 29.3993   | 18.9941 |
| 1.5197        | 9.0   | 6885  | 1.4143          | 30.9201 | 18.863  | 27.5918 | 29.4395   | 18.9941 |
| 1.5123        | 10.0  | 7650  | 1.4119          | 30.9469 | 18.9403 | 27.6186 | 29.4314   | 18.9941 |
| 1.5209        | 11.0  | 8415  | 1.4107          | 30.9685 | 18.9431 | 27.6189 | 29.4673   | 18.9941 |
| 1.5091        | 12.0  | 9180  | 1.4095          | 30.9249 | 18.9679 | 27.6257 | 29.4341   | 18.9941 |
| 1.4998        | 13.0  | 9945  | 1.4091          | 30.9911 | 19.0416 | 27.695  | 29.4991   | 18.9941 |
| 1.505         | 14.0  | 10710 | 1.4085          | 30.9942 | 19.0321 | 27.6999 | 29.5025   | 18.9941 |
| 1.4965        | 15.0  | 11475 | 1.4083          | 31.0064 | 19.0446 | 27.7086 | 29.5158   | 18.9941 |


### Framework versions

- Transformers 4.26.1
- Pytorch 1.13.1+cu116
- Tokenizers 0.13.2