flan-t5-base-samsum

This model is a fine-tuned version of google/flan-t5-base on an unknown dataset. It achieves the following results on the evaluation set:

• Loss: 1.8183
• Rouge1: 50.827
• Rouge2: 42.2129
• Rougel: 50.1859
• Rougelsum: 50.0929
• Gen Len: 17.1429

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 5e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 5

Training results

Training Loss	Epoch	Step	Validation Loss	Rouge1	Rouge2	Rougel	Rougelsum	Gen Len
No log	1.0	8	2.0190	43.3655	31.8855	36.5569	36.419	17.4286
No log	2.0	16	1.9072	49.9208	41.8902	48.749	48.3927	18.0
No log	3.0	24	1.8506	50.827	42.2129	50.1859	50.0929	17.1429
No log	4.0	32	1.8289	50.827	42.2129	50.1859	50.0929	17.1429
No log	5.0	40	1.8183	50.827	42.2129	50.1859	50.0929	17.1429

Framework versions

• Transformers 4.33.1
• Pytorch 2.0.1+cu118
• Datasets 2.14.5
• Tokenizers 0.13.3