Glow-01's picture
End of training
46ee7e3 verified
metadata
base_model: google/pegasus-multi_news
tags:
  - generated_from_trainer
metrics:
  - rouge
model-index:
  - name: finetuned_pegasus_custom
    results: []

finetuned_pegasus_custom

This model is a fine-tuned version of google/pegasus-multi_news on the None dataset. It achieves the following results on the evaluation set:

  • Loss: 1.5792
  • Rouge1: 43.3499
  • Rouge2: 19.473
  • Rougel: 28.3372
  • Rougelsum: 39.6698
  • Gen Len: 167.2593

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 2e-05
  • train_batch_size: 1
  • eval_batch_size: 1
  • seed: 42
  • gradient_accumulation_steps: 2
  • total_train_batch_size: 2
  • optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • lr_scheduler_type: linear
  • num_epochs: 10

Training results

Training Loss Epoch Step Validation Loss Rouge1 Rouge2 Rougel Rougelsum Gen Len
No log 0.98 31 1.6733 45.2908 20.6545 28.8174 41.1913 157.2593
No log 2.0 63 1.6448 45.8258 20.4208 29.3649 41.4304 164.7778
No log 2.98 94 1.6308 45.6111 20.1988 28.7912 41.5061 157.8519
No log 4.0 126 1.6105 45.2388 20.9335 28.8736 41.3696 160.6667
No log 4.98 157 1.6009 44.84 20.5064 29.3276 40.9796 154.0741
No log 6.0 189 1.5903 44.3777 19.987 29.5859 40.7764 163.1111
No log 6.98 220 1.5844 44.3786 20.2566 29.1194 40.9269 160.1111
No log 8.0 252 1.5821 43.3413 19.3 28.3204 39.619 153.6667
No log 8.98 283 1.5796 42.9684 18.9515 27.909 39.166 162.1852
No log 9.84 310 1.5792 43.3499 19.473 28.3372 39.6698 167.2593

Framework versions

  • Transformers 4.37.0
  • Pytorch 2.1.2
  • Datasets 2.1.0
  • Tokenizers 0.15.1