metadata
language:
- ede
- vi
library_name: transformers
tags:
- bart
- bartpho
- denoising
- ede
- vietnamese
base_model: vinai/bartpho-syllable
datasets:
- NIRVLab/rhade-vietnamese-mt
NIRVLab/BartEde
This model is continued pretraining from vinai/bartpho-syllable
using the Ede side of NIRVLab/rhade-vietnamese-mt
with a denoising/span-masking objective.
Best checkpoint
- checkpoint:
checkpoint-2676
Evaluation
- validation loss: 0.4706411361694336
- test loss: 0.46831414103507996
- validation pseudo-perplexity: 1.6010203362790814
- test pseudo-perplexity: 1.597299101073845
Notes
- only
translation["ede"]was used - best checkpoint selected by validation performance