mt5-aym-lex-try / README.md
alvations's picture
update model card README.md
d92ebc8
metadata
license: apache-2.0
tags:
  - generated_from_trainer
metrics:
  - bleu
model-index:
  - name: mt5-aym-lex-try
    results: []

mt5-aym-lex-try

This model is a fine-tuned version of alvations/mt5-aym-lex on the None dataset. It achieves the following results on the evaluation set:

  • Loss: 0.2781
  • Chrf: 15.5602
  • Bleu: 0.7538
  • Gen Len: 19.0

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 5e-05
  • train_batch_size: 8
  • eval_batch_size: 8
  • seed: 42
  • optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • lr_scheduler_type: linear
  • lr_scheduler_warmup_steps: 1
  • training_steps: 100

Training results

Training Loss Epoch Step Validation Loss Chrf Bleu Gen Len
0.2183 0.0 20 0.3002 16.5098 0.7277 19.0
0.1911 0.01 40 0.2852 16.9826 0.7635 19.0
0.2366 0.01 60 0.2800 15.7077 0.7476 19.0
0.1941 0.02 80 0.2785 15.5602 0.7538 19.0
0.1991 0.02 100 0.2781 15.5602 0.7538 19.0

Framework versions

  • Transformers 4.29.1
  • Pytorch 2.0.0+cu118
  • Datasets 2.12.0
  • Tokenizers 0.13.3