bart-large-cnn_fine_tuned

This model is a fine-tuned version of facebook/bart-large-cnn on an unknown dataset. It achieves the following results on the evaluation set:

• Loss: 0.3711
• Rouge1: 64.5245
• Rouge2: 53.1381
• Rougel: 47.3234
• Rougelsum: 51.2042

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 5.6e-06
• train_batch_size: 4
• eval_batch_size: 4
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 4

Training results

Training Loss	Epoch	Step	Validation Loss	Rouge1	Rouge2	Rougel	Rougelsum
0.4228	1.0	389	0.3821	57.8993	45.4774	41.9455	44.9012
0.321	2.0	778	0.3641	61.5071	49.6584	45.5774	48.3601
0.2764	3.0	1167	0.3689	63.7295	52.1907	46.827	50.3726
0.2504	4.0	1556	0.3711	64.5245	53.1381	47.3234	51.2042

Framework versions

• Transformers 4.35.2
• Pytorch 2.1.0+cu121
• Tokenizers 0.15.1