Hugging Face's logo

devagonal
/
t5-flan-heritage

Text2Text Generation
Transformers
TensorBoard
Safetensors
t5
Generated from Trainer
Inference Endpoints
text-generation-inference
Model card Files Metrics Community
1
t5-flan-heritage / README.md
devagonal's picture
devagonal
End of training
99c696e
preview code
|
raw history blame contribute delete
No virus
1.58 kB
metadata
license: apache-2.0
base_model: google/flan-t5-base
tags:
  - generated_from_trainer
metrics:
  - rouge
model-index:
  - name: t5-flan-heritage
    results: []

t5-flan-heritage

This model is a fine-tuned version of google/flan-t5-base on an unknown dataset. It achieves the following results on the evaluation set:

  • Loss: 0.1247
  • Rouge1: 0.8927
  • Rouge2: 0.8753
  • Rougel: 0.8929
  • Rougelsum: 0.8926

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 0.0003
  • train_batch_size: 8
  • eval_batch_size: 4
  • seed: 42
  • optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • lr_scheduler_type: linear
  • num_epochs: 2

Training results

Training Loss Epoch Step Validation Loss Rouge1 Rouge2 Rougel Rougelsum
No log 1.0 145 0.1583 0.8747 0.8544 0.8749 0.8744
No log 2.0 290 0.1247 0.8927 0.8753 0.8929 0.8926

Framework versions

  • Transformers 4.35.2
  • Pytorch 2.1.0+cu118
  • Datasets 2.15.0
  • Tokenizers 0.15.0