bhavitvyamalik's picture
Upload README.md with huggingface_hub
5278273 verified
|
raw
history blame
No virus
1.2 kB
metadata
language:
  - eu
  - en
tags:
  - translation
license: cc-by-4.0

Translation model for eu-en OPUS_HPLT v1.0

This repository contains the model weights for translation models trained with Marian for HPLT project. For usage instructions, evaluation scripts, and inference scripts, please refer to the HPLT-MT-Models v1.0 GitHub repository.

  • Source language: eu
  • Target language: en
  • Dataset: All of OPUS including HPLT
  • Model: transformer-base
  • Tokenizer: SentencePiece (Unigram)
  • Cleaning: We use OpusCleaner for cleaning the corpus. Details about rules used can be found in the filter files in Github

To run inference with Marian, refer to the Inference/Decoding/Translation section of our GitHub repository.

Benchmarks

testset BLEU chr-F COMET-22
flores200 24.5 51.1 0.8361
ntrex 21.2 47.4 0.8081