Edomonndo's picture
add model
316153b
metadata
tags:
  - generated_from_trainer
metrics:
  - bleu
model_index:
  - name: opus-mt-ja-en-finetuned-ja-to-en_test
    results:
      - task:
          name: Sequence-to-sequence Language Modeling
          type: text2text-generation
        metric:
          name: Bleu
          type: bleu
          value: 27.3816

opus-mt-ja-en-finetuned-ja-to-en_test

This model is a fine-tuned version of Edomonndo/opus-mt-ja-en-finetuned-ja-to-en_test on an unkown dataset. It achieves the following results on the evaluation set:

  • Loss: 3.1649
  • Bleu: 27.3816
  • Gen Len: 11.2584

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 5e-05
  • train_batch_size: 16
  • eval_batch_size: 16
  • seed: 42
  • optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • lr_scheduler_type: linear
  • num_epochs: 3
  • mixed_precision_training: Native AMP

Training results

Training Loss Epoch Step Validation Loss Bleu Gen Len
No log 1.0 20 3.2689 24.1516 11.3483
No log 2.0 40 3.1899 26.5309 10.618
No log 3.0 60 3.1649 27.3816 11.2584

Framework versions

  • Transformers 4.9.1
  • Pytorch 1.9.0+cu102
  • Datasets 1.10.2
  • Tokenizers 0.10.3