test-model

This model is a fine-tuned version of t5-small on an unknown dataset. It achieves the following results on the evaluation set:

• Train Loss: 1.0322
• Validation Loss: 0.9818
• Train Rouge1: 63.3560
• Train Rouge2: 39.8622
• Train Rougel: 62.5870
• Train Rougelsum: 62.5573
• Epoch: 9

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• optimizer: {'name': 'AdamWeightDecay', 'learning_rate': 2e-05, 'decay': 0.0, 'beta_1': 0.9, 'beta_2': 0.999, 'epsilon': 1e-07, 'amsgrad': False, 'weight_decay_rate': 0.01}
• training_precision: float32

Training results

Train Loss	Validation Loss	Train Rouge1	Train Rouge2	Train Rougel	Train Rougelsum	Epoch
1.2033	1.1011	63.0488	39.8152	62.3015	62.2699	0
1.1660	1.0732	63.6556	40.2704	62.8821	62.8498	1
1.1394	1.0532	63.8815	40.5348	63.1276	63.0965	2
1.1149	1.0386	64.2783	40.8596	63.5115	63.4840	3
1.0969	1.0245	63.6975	40.1645	62.9323	62.8990	4
1.0831	1.0122	63.7146	40.3383	62.9457	62.9173	5
1.0678	1.0044	63.3129	39.9492	62.5462	62.5154	6
1.0551	0.9949	62.5523	39.2999	61.7963	61.7831	7
1.0417	0.9869	63.3126	40.0112	62.5606	62.5360	8
1.0322	0.9818	63.3560	39.8622	62.5870	62.5573	9

Framework versions

• Transformers 4.25.1
• TensorFlow 2.9.2
• Datasets 2.8.0
• Tokenizers 0.13.2