---
language:
- da
- sv
- af
- nn
- fy
- fo
- de
- nb
- nl
- is
- en
- lb
- yi
- gem

tags:
- translation

license: apache-2.0
---

### gem-gem

* source group: Germanic languages
* target group: Germanic languages
*  OPUS readme: [gem-gem](https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/gem-gem/README.md)

*  model: transformer
* source language(s): afr ang_Latn dan deu eng enm_Latn fao frr fry gos got_Goth gsw isl ksh ltz nds nld nno nob nob_Hebr non_Latn pdc sco stq swe swg yid
* target language(s): afr ang_Latn dan deu eng enm_Latn fao frr fry gos got_Goth gsw isl ksh ltz nds nld nno nob nob_Hebr non_Latn pdc sco stq swe swg yid
* model: transformer
* pre-processing: normalization + SentencePiece (spm32k,spm32k)
* a sentence initial language token is required in the form of `>>id<<` (id = valid target language ID)
* download original weights: [opus-2020-07-27.zip](https://object.pouta.csc.fi/Tatoeba-MT-models/gem-gem/opus-2020-07-27.zip)
* test set translations: [opus-2020-07-27.test.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/gem-gem/opus-2020-07-27.test.txt)
* test set scores: [opus-2020-07-27.eval.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/gem-gem/opus-2020-07-27.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| newssyscomb2009-deueng.deu.eng 	| 24.5 	| 0.519 |
| newssyscomb2009-engdeu.eng.deu 	| 18.7 	| 0.495 |
| news-test2008-deueng.deu.eng 	| 22.8 	| 0.509 |
| news-test2008-engdeu.eng.deu 	| 18.6 	| 0.485 |
| newstest2009-deueng.deu.eng 	| 22.2 	| 0.507 |
| newstest2009-engdeu.eng.deu 	| 18.3 	| 0.491 |
| newstest2010-deueng.deu.eng 	| 24.8 	| 0.537 |
| newstest2010-engdeu.eng.deu 	| 19.7 	| 0.499 |
| newstest2011-deueng.deu.eng 	| 22.9 	| 0.516 |
| newstest2011-engdeu.eng.deu 	| 18.3 	| 0.485 |
| newstest2012-deueng.deu.eng 	| 23.9 	| 0.524 |
| newstest2012-engdeu.eng.deu 	| 18.5 	| 0.484 |
| newstest2013-deueng.deu.eng 	| 26.3 	| 0.537 |
| newstest2013-engdeu.eng.deu 	| 21.5 	| 0.506 |
| newstest2014-deen-deueng.deu.eng 	| 25.7 	| 0.535 |
| newstest2015-ende-deueng.deu.eng 	| 27.3 	| 0.542 |
| newstest2015-ende-engdeu.eng.deu 	| 24.2 	| 0.534 |
| newstest2016-ende-deueng.deu.eng 	| 31.8 	| 0.584 |
| newstest2016-ende-engdeu.eng.deu 	| 28.4 	| 0.564 |
| newstest2017-ende-deueng.deu.eng 	| 27.6 	| 0.545 |
| newstest2017-ende-engdeu.eng.deu 	| 22.8 	| 0.527 |
| newstest2018-ende-deueng.deu.eng 	| 34.1 	| 0.593 |
| newstest2018-ende-engdeu.eng.deu 	| 32.7 	| 0.595 |
| newstest2019-deen-deueng.deu.eng 	| 30.6 	| 0.565 |
| newstest2019-ende-engdeu.eng.deu 	| 29.5 	| 0.567 |
| Tatoeba-test.afr-ang.afr.ang 	| 0.0 	| 0.053 |
| Tatoeba-test.afr-dan.afr.dan 	| 57.8 	| 0.907 |
| Tatoeba-test.afr-deu.afr.deu 	| 46.4 	| 0.663 |
| Tatoeba-test.afr-eng.afr.eng 	| 57.4 	| 0.717 |
| Tatoeba-test.afr-enm.afr.enm 	| 11.3 	| 0.285 |
| Tatoeba-test.afr-fry.afr.fry 	| 0.0 	| 0.167 |
| Tatoeba-test.afr-gos.afr.gos 	| 1.5 	| 0.178 |
| Tatoeba-test.afr-isl.afr.isl 	| 29.0 	| 0.760 |
| Tatoeba-test.afr-ltz.afr.ltz 	| 11.2 	| 0.246 |
| Tatoeba-test.afr-nld.afr.nld 	| 53.3 	| 0.708 |
| Tatoeba-test.afr-nor.afr.nor 	| 66.0 	| 0.752 |
| Tatoeba-test.afr-swe.afr.swe 	| 88.0 	| 0.955 |
| Tatoeba-test.afr-yid.afr.yid 	| 59.5 	| 0.443 |
| Tatoeba-test.ang-afr.ang.afr 	| 10.7 	| 0.043 |
| Tatoeba-test.ang-dan.ang.dan 	| 6.3 	| 0.190 |
| Tatoeba-test.ang-deu.ang.deu 	| 1.4 	| 0.212 |
| Tatoeba-test.ang-eng.ang.eng 	| 8.1 	| 0.247 |
| Tatoeba-test.ang-enm.ang.enm 	| 1.7 	| 0.196 |
| Tatoeba-test.ang-fao.ang.fao 	| 10.7 	| 0.105 |
| Tatoeba-test.ang-gos.ang.gos 	| 10.7 	| 0.128 |
| Tatoeba-test.ang-isl.ang.isl 	| 16.0 	| 0.135 |
| Tatoeba-test.ang-ltz.ang.ltz 	| 16.0 	| 0.121 |
| Tatoeba-test.ang-yid.ang.yid 	| 1.5 	| 0.136 |
| Tatoeba-test.dan-afr.dan.afr 	| 22.7 	| 0.655 |
| Tatoeba-test.dan-ang.dan.ang 	| 3.1 	| 0.110 |
| Tatoeba-test.dan-deu.dan.deu 	| 47.4 	| 0.676 |
| Tatoeba-test.dan-eng.dan.eng 	| 54.7 	| 0.704 |
| Tatoeba-test.dan-enm.dan.enm 	| 4.8 	| 0.291 |
| Tatoeba-test.dan-fao.dan.fao 	| 9.7 	| 0.120 |
| Tatoeba-test.dan-gos.dan.gos 	| 3.8 	| 0.240 |
| Tatoeba-test.dan-isl.dan.isl 	| 66.1 	| 0.678 |
| Tatoeba-test.dan-ltz.dan.ltz 	| 78.3 	| 0.563 |
| Tatoeba-test.dan-nds.dan.nds 	| 6.2 	| 0.335 |
| Tatoeba-test.dan-nld.dan.nld 	| 60.0 	| 0.748 |
| Tatoeba-test.dan-nor.dan.nor 	| 68.1 	| 0.812 |
| Tatoeba-test.dan-swe.dan.swe 	| 65.0 	| 0.785 |
| Tatoeba-test.dan-swg.dan.swg 	| 2.6 	| 0.182 |
| Tatoeba-test.dan-yid.dan.yid 	| 9.3 	| 0.226 |
| Tatoeba-test.deu-afr.deu.afr 	| 50.3 	| 0.682 |
| Tatoeba-test.deu-ang.deu.ang 	| 0.5 	| 0.118 |
| Tatoeba-test.deu-dan.deu.dan 	| 49.6 	| 0.679 |
| Tatoeba-test.deu-eng.deu.eng 	| 43.4 	| 0.618 |
| Tatoeba-test.deu-enm.deu.enm 	| 2.2 	| 0.159 |
| Tatoeba-test.deu-frr.deu.frr 	| 0.4 	| 0.156 |
| Tatoeba-test.deu-fry.deu.fry 	| 10.7 	| 0.355 |
| Tatoeba-test.deu-gos.deu.gos 	| 0.7 	| 0.183 |
| Tatoeba-test.deu-got.deu.got 	| 0.3 	| 0.010 |
| Tatoeba-test.deu-gsw.deu.gsw 	| 1.1 	| 0.130 |
| Tatoeba-test.deu-isl.deu.isl 	| 24.3 	| 0.504 |
| Tatoeba-test.deu-ksh.deu.ksh 	| 0.9 	| 0.173 |
| Tatoeba-test.deu-ltz.deu.ltz 	| 15.6 	| 0.304 |
| Tatoeba-test.deu-nds.deu.nds 	| 21.2 	| 0.469 |
| Tatoeba-test.deu-nld.deu.nld 	| 47.1 	| 0.657 |
| Tatoeba-test.deu-nor.deu.nor 	| 43.9 	| 0.646 |
| Tatoeba-test.deu-pdc.deu.pdc 	| 3.0 	| 0.133 |
| Tatoeba-test.deu-sco.deu.sco 	| 12.0 	| 0.296 |
| Tatoeba-test.deu-stq.deu.stq 	| 0.6 	| 0.137 |
| Tatoeba-test.deu-swe.deu.swe 	| 50.6 	| 0.668 |
| Tatoeba-test.deu-swg.deu.swg 	| 0.2 	| 0.137 |
| Tatoeba-test.deu-yid.deu.yid 	| 3.9 	| 0.229 |
| Tatoeba-test.eng-afr.eng.afr 	| 55.2 	| 0.721 |
| Tatoeba-test.eng-ang.eng.ang 	| 4.9 	| 0.118 |
| Tatoeba-test.eng-dan.eng.dan 	| 52.6 	| 0.684 |
| Tatoeba-test.eng-deu.eng.deu 	| 35.4 	| 0.573 |
| Tatoeba-test.eng-enm.eng.enm 	| 1.8 	| 0.223 |
| Tatoeba-test.eng-fao.eng.fao 	| 7.0 	| 0.312 |
| Tatoeba-test.eng-frr.eng.frr 	| 1.2 	| 0.050 |
| Tatoeba-test.eng-fry.eng.fry 	| 15.8 	| 0.381 |
| Tatoeba-test.eng-gos.eng.gos 	| 0.7 	| 0.170 |
| Tatoeba-test.eng-got.eng.got 	| 0.3 	| 0.011 |
| Tatoeba-test.eng-gsw.eng.gsw 	| 0.5 	| 0.126 |
| Tatoeba-test.eng-isl.eng.isl 	| 20.9 	| 0.463 |
| Tatoeba-test.eng-ksh.eng.ksh 	| 1.0 	| 0.141 |
| Tatoeba-test.eng-ltz.eng.ltz 	| 12.8 	| 0.292 |
| Tatoeba-test.eng-nds.eng.nds 	| 18.3 	| 0.428 |
| Tatoeba-test.eng-nld.eng.nld 	| 47.3 	| 0.657 |
| Tatoeba-test.eng-non.eng.non 	| 0.3 	| 0.145 |
| Tatoeba-test.eng-nor.eng.nor 	| 47.2 	| 0.650 |
| Tatoeba-test.eng-pdc.eng.pdc 	| 4.8 	| 0.177 |
| Tatoeba-test.eng-sco.eng.sco 	| 38.1 	| 0.597 |
| Tatoeba-test.eng-stq.eng.stq 	| 2.4 	| 0.288 |
| Tatoeba-test.eng-swe.eng.swe 	| 52.7 	| 0.677 |
| Tatoeba-test.eng-swg.eng.swg 	| 1.1 	| 0.163 |
| Tatoeba-test.eng-yid.eng.yid 	| 4.5 	| 0.223 |
| Tatoeba-test.enm-afr.enm.afr 	| 22.8 	| 0.401 |
| Tatoeba-test.enm-ang.enm.ang 	| 0.4 	| 0.062 |
| Tatoeba-test.enm-dan.enm.dan 	| 51.4 	| 0.782 |
| Tatoeba-test.enm-deu.enm.deu 	| 33.8 	| 0.473 |
| Tatoeba-test.enm-eng.enm.eng 	| 22.4 	| 0.495 |
| Tatoeba-test.enm-fry.enm.fry 	| 16.0 	| 0.173 |
| Tatoeba-test.enm-gos.enm.gos 	| 6.1 	| 0.222 |
| Tatoeba-test.enm-isl.enm.isl 	| 59.5 	| 0.651 |
| Tatoeba-test.enm-ksh.enm.ksh 	| 10.5 	| 0.130 |
| Tatoeba-test.enm-nds.enm.nds 	| 18.1 	| 0.327 |
| Tatoeba-test.enm-nld.enm.nld 	| 38.3 	| 0.546 |
| Tatoeba-test.enm-nor.enm.nor 	| 15.6 	| 0.290 |
| Tatoeba-test.enm-yid.enm.yid 	| 2.3 	| 0.215 |
| Tatoeba-test.fao-ang.fao.ang 	| 2.1 	| 0.035 |
| Tatoeba-test.fao-dan.fao.dan 	| 53.7 	| 0.625 |
| Tatoeba-test.fao-eng.fao.eng 	| 24.7 	| 0.435 |
| Tatoeba-test.fao-gos.fao.gos 	| 12.7 	| 0.116 |
| Tatoeba-test.fao-isl.fao.isl 	| 26.3 	| 0.341 |
| Tatoeba-test.fao-nor.fao.nor 	| 41.9 	| 0.586 |
| Tatoeba-test.fao-swe.fao.swe 	| 0.0 	| 1.000 |
| Tatoeba-test.frr-deu.frr.deu 	| 7.4 	| 0.263 |
| Tatoeba-test.frr-eng.frr.eng 	| 7.0 	| 0.157 |
| Tatoeba-test.frr-fry.frr.fry 	| 4.0 	| 0.112 |
| Tatoeba-test.frr-gos.frr.gos 	| 1.0 	| 0.135 |
| Tatoeba-test.frr-nds.frr.nds 	| 12.4 	| 0.207 |
| Tatoeba-test.frr-nld.frr.nld 	| 10.6 	| 0.227 |
| Tatoeba-test.frr-stq.frr.stq 	| 1.0 	| 0.058 |
| Tatoeba-test.fry-afr.fry.afr 	| 12.7 	| 0.333 |
| Tatoeba-test.fry-deu.fry.deu 	| 30.8 	| 0.555 |
| Tatoeba-test.fry-eng.fry.eng 	| 31.2 	| 0.506 |
| Tatoeba-test.fry-enm.fry.enm 	| 0.0 	| 0.175 |
| Tatoeba-test.fry-frr.fry.frr 	| 1.6 	| 0.091 |
| Tatoeba-test.fry-gos.fry.gos 	| 1.1 	| 0.254 |
| Tatoeba-test.fry-ltz.fry.ltz 	| 30.4 	| 0.526 |
| Tatoeba-test.fry-nds.fry.nds 	| 12.4 	| 0.116 |
| Tatoeba-test.fry-nld.fry.nld 	| 43.4 	| 0.637 |
| Tatoeba-test.fry-nor.fry.nor 	| 47.1 	| 0.607 |
| Tatoeba-test.fry-stq.fry.stq 	| 0.6 	| 0.181 |
| Tatoeba-test.fry-swe.fry.swe 	| 30.2 	| 0.587 |
| Tatoeba-test.fry-yid.fry.yid 	| 3.1 	| 0.173 |
| Tatoeba-test.gos-afr.gos.afr 	| 1.8 	| 0.215 |
| Tatoeba-test.gos-ang.gos.ang 	| 0.0 	| 0.045 |
| Tatoeba-test.gos-dan.gos.dan 	| 4.1 	| 0.236 |
| Tatoeba-test.gos-deu.gos.deu 	| 19.6 	| 0.406 |
| Tatoeba-test.gos-eng.gos.eng 	| 15.1 	| 0.329 |
| Tatoeba-test.gos-enm.gos.enm 	| 5.8 	| 0.271 |
| Tatoeba-test.gos-fao.gos.fao 	| 19.0 	| 0.136 |
| Tatoeba-test.gos-frr.gos.frr 	| 1.3 	| 0.119 |
| Tatoeba-test.gos-fry.gos.fry 	| 17.1 	| 0.388 |
| Tatoeba-test.gos-isl.gos.isl 	| 16.8 	| 0.356 |
| Tatoeba-test.gos-ltz.gos.ltz 	| 3.6 	| 0.174 |
| Tatoeba-test.gos-nds.gos.nds 	| 4.7 	| 0.225 |
| Tatoeba-test.gos-nld.gos.nld 	| 16.3 	| 0.406 |
| Tatoeba-test.gos-stq.gos.stq 	| 0.7 	| 0.154 |
| Tatoeba-test.gos-swe.gos.swe 	| 8.6 	| 0.319 |
| Tatoeba-test.gos-yid.gos.yid 	| 4.4 	| 0.165 |
| Tatoeba-test.got-deu.got.deu 	| 0.2 	| 0.041 |
| Tatoeba-test.got-eng.got.eng 	| 0.2 	| 0.068 |
| Tatoeba-test.got-nor.got.nor 	| 0.6 	| 0.000 |
| Tatoeba-test.gsw-deu.gsw.deu 	| 15.9 	| 0.373 |
| Tatoeba-test.gsw-eng.gsw.eng 	| 14.7 	| 0.320 |
| Tatoeba-test.isl-afr.isl.afr 	| 38.0 	| 0.641 |
| Tatoeba-test.isl-ang.isl.ang 	| 0.0 	| 0.037 |
| Tatoeba-test.isl-dan.isl.dan 	| 67.7 	| 0.836 |
| Tatoeba-test.isl-deu.isl.deu 	| 42.6 	| 0.614 |
| Tatoeba-test.isl-eng.isl.eng 	| 43.5 	| 0.610 |
| Tatoeba-test.isl-enm.isl.enm 	| 12.4 	| 0.123 |
| Tatoeba-test.isl-fao.isl.fao 	| 15.6 	| 0.176 |
| Tatoeba-test.isl-gos.isl.gos 	| 7.1 	| 0.257 |
| Tatoeba-test.isl-nor.isl.nor 	| 53.5 	| 0.690 |
| Tatoeba-test.isl-stq.isl.stq 	| 10.7 	| 0.176 |
| Tatoeba-test.isl-swe.isl.swe 	| 67.7 	| 0.818 |
| Tatoeba-test.ksh-deu.ksh.deu 	| 11.8 	| 0.393 |
| Tatoeba-test.ksh-eng.ksh.eng 	| 4.0 	| 0.239 |
| Tatoeba-test.ksh-enm.ksh.enm 	| 9.5 	| 0.085 |
| Tatoeba-test.ltz-afr.ltz.afr 	| 36.5 	| 0.529 |
| Tatoeba-test.ltz-ang.ltz.ang 	| 0.0 	| 0.043 |
| Tatoeba-test.ltz-dan.ltz.dan 	| 80.6 	| 0.722 |
| Tatoeba-test.ltz-deu.ltz.deu 	| 40.1 	| 0.581 |
| Tatoeba-test.ltz-eng.ltz.eng 	| 36.1 	| 0.511 |
| Tatoeba-test.ltz-fry.ltz.fry 	| 16.5 	| 0.524 |
| Tatoeba-test.ltz-gos.ltz.gos 	| 0.7 	| 0.118 |
| Tatoeba-test.ltz-nld.ltz.nld 	| 40.4 	| 0.535 |
| Tatoeba-test.ltz-nor.ltz.nor 	| 19.1 	| 0.582 |
| Tatoeba-test.ltz-stq.ltz.stq 	| 2.4 	| 0.093 |
| Tatoeba-test.ltz-swe.ltz.swe 	| 25.9 	| 0.430 |
| Tatoeba-test.ltz-yid.ltz.yid 	| 1.5 	| 0.160 |
| Tatoeba-test.multi.multi 	| 42.7 	| 0.614 |
| Tatoeba-test.nds-dan.nds.dan 	| 23.0 	| 0.465 |
| Tatoeba-test.nds-deu.nds.deu 	| 39.8 	| 0.610 |
| Tatoeba-test.nds-eng.nds.eng 	| 32.0 	| 0.520 |
| Tatoeba-test.nds-enm.nds.enm 	| 3.9 	| 0.156 |
| Tatoeba-test.nds-frr.nds.frr 	| 10.7 	| 0.127 |
| Tatoeba-test.nds-fry.nds.fry 	| 10.7 	| 0.231 |
| Tatoeba-test.nds-gos.nds.gos 	| 0.8 	| 0.157 |
| Tatoeba-test.nds-nld.nds.nld 	| 44.1 	| 0.634 |
| Tatoeba-test.nds-nor.nds.nor 	| 47.1 	| 0.665 |
| Tatoeba-test.nds-swg.nds.swg 	| 0.5 	| 0.166 |
| Tatoeba-test.nds-yid.nds.yid 	| 12.7 	| 0.337 |
| Tatoeba-test.nld-afr.nld.afr 	| 58.4 	| 0.748 |
| Tatoeba-test.nld-dan.nld.dan 	| 61.3 	| 0.753 |
| Tatoeba-test.nld-deu.nld.deu 	| 48.2 	| 0.670 |
| Tatoeba-test.nld-eng.nld.eng 	| 52.8 	| 0.690 |
| Tatoeba-test.nld-enm.nld.enm 	| 5.7 	| 0.178 |
| Tatoeba-test.nld-frr.nld.frr 	| 0.9 	| 0.159 |
| Tatoeba-test.nld-fry.nld.fry 	| 23.0 	| 0.467 |
| Tatoeba-test.nld-gos.nld.gos 	| 1.0 	| 0.165 |
| Tatoeba-test.nld-ltz.nld.ltz 	| 14.4 	| 0.310 |
| Tatoeba-test.nld-nds.nld.nds 	| 24.1 	| 0.485 |
| Tatoeba-test.nld-nor.nld.nor 	| 53.6 	| 0.705 |
| Tatoeba-test.nld-sco.nld.sco 	| 15.0 	| 0.415 |
| Tatoeba-test.nld-stq.nld.stq 	| 0.5 	| 0.183 |
| Tatoeba-test.nld-swe.nld.swe 	| 73.6 	| 0.842 |
| Tatoeba-test.nld-swg.nld.swg 	| 4.2 	| 0.191 |
| Tatoeba-test.nld-yid.nld.yid 	| 9.4 	| 0.299 |
| Tatoeba-test.non-eng.non.eng 	| 27.7 	| 0.501 |
| Tatoeba-test.nor-afr.nor.afr 	| 48.2 	| 0.687 |
| Tatoeba-test.nor-dan.nor.dan 	| 69.5 	| 0.820 |
| Tatoeba-test.nor-deu.nor.deu 	| 41.1 	| 0.634 |
| Tatoeba-test.nor-eng.nor.eng 	| 49.4 	| 0.660 |
| Tatoeba-test.nor-enm.nor.enm 	| 6.8 	| 0.230 |
| Tatoeba-test.nor-fao.nor.fao 	| 6.9 	| 0.395 |
| Tatoeba-test.nor-fry.nor.fry 	| 9.2 	| 0.323 |
| Tatoeba-test.nor-got.nor.got 	| 1.5 	| 0.000 |
| Tatoeba-test.nor-isl.nor.isl 	| 34.5 	| 0.555 |
| Tatoeba-test.nor-ltz.nor.ltz 	| 22.1 	| 0.447 |
| Tatoeba-test.nor-nds.nor.nds 	| 34.3 	| 0.565 |
| Tatoeba-test.nor-nld.nor.nld 	| 50.5 	| 0.676 |
| Tatoeba-test.nor-nor.nor.nor 	| 57.6 	| 0.764 |
| Tatoeba-test.nor-swe.nor.swe 	| 68.9 	| 0.813 |
| Tatoeba-test.nor-yid.nor.yid 	| 65.0 	| 0.627 |
| Tatoeba-test.pdc-deu.pdc.deu 	| 43.5 	| 0.559 |
| Tatoeba-test.pdc-eng.pdc.eng 	| 26.1 	| 0.471 |
| Tatoeba-test.sco-deu.sco.deu 	| 7.1 	| 0.295 |
| Tatoeba-test.sco-eng.sco.eng 	| 34.4 	| 0.551 |
| Tatoeba-test.sco-nld.sco.nld 	| 9.9 	| 0.438 |
| Tatoeba-test.stq-deu.stq.deu 	| 8.6 	| 0.385 |
| Tatoeba-test.stq-eng.stq.eng 	| 21.8 	| 0.431 |
| Tatoeba-test.stq-frr.stq.frr 	| 2.1 	| 0.111 |
| Tatoeba-test.stq-fry.stq.fry 	| 7.6 	| 0.267 |
| Tatoeba-test.stq-gos.stq.gos 	| 0.7 	| 0.198 |
| Tatoeba-test.stq-isl.stq.isl 	| 16.0 	| 0.121 |
| Tatoeba-test.stq-ltz.stq.ltz 	| 3.8 	| 0.150 |
| Tatoeba-test.stq-nld.stq.nld 	| 14.6 	| 0.375 |
| Tatoeba-test.stq-yid.stq.yid 	| 2.4 	| 0.096 |
| Tatoeba-test.swe-afr.swe.afr 	| 51.8 	| 0.802 |
| Tatoeba-test.swe-dan.swe.dan 	| 64.9 	| 0.784 |
| Tatoeba-test.swe-deu.swe.deu 	| 47.0 	| 0.657 |
| Tatoeba-test.swe-eng.swe.eng 	| 55.8 	| 0.700 |
| Tatoeba-test.swe-fao.swe.fao 	| 0.0 	| 0.060 |
| Tatoeba-test.swe-fry.swe.fry 	| 14.1 	| 0.449 |
| Tatoeba-test.swe-gos.swe.gos 	| 7.5 	| 0.291 |
| Tatoeba-test.swe-isl.swe.isl 	| 70.7 	| 0.812 |
| Tatoeba-test.swe-ltz.swe.ltz 	| 15.9 	| 0.553 |
| Tatoeba-test.swe-nld.swe.nld 	| 78.7 	| 0.854 |
| Tatoeba-test.swe-nor.swe.nor 	| 67.1 	| 0.799 |
| Tatoeba-test.swe-yid.swe.yid 	| 14.7 	| 0.156 |
| Tatoeba-test.swg-dan.swg.dan 	| 7.7 	| 0.341 |
| Tatoeba-test.swg-deu.swg.deu 	| 8.0 	| 0.334 |
| Tatoeba-test.swg-eng.swg.eng 	| 12.4 	| 0.305 |
| Tatoeba-test.swg-nds.swg.nds 	| 1.1 	| 0.209 |
| Tatoeba-test.swg-nld.swg.nld 	| 4.9 	| 0.244 |
| Tatoeba-test.swg-yid.swg.yid 	| 3.4 	| 0.194 |
| Tatoeba-test.yid-afr.yid.afr 	| 23.6 	| 0.552 |
| Tatoeba-test.yid-ang.yid.ang 	| 0.1 	| 0.066 |
| Tatoeba-test.yid-dan.yid.dan 	| 17.5 	| 0.392 |
| Tatoeba-test.yid-deu.yid.deu 	| 21.0 	| 0.423 |
| Tatoeba-test.yid-eng.yid.eng 	| 17.4 	| 0.368 |
| Tatoeba-test.yid-enm.yid.enm 	| 0.6 	| 0.143 |
| Tatoeba-test.yid-fry.yid.fry 	| 5.3 	| 0.169 |
| Tatoeba-test.yid-gos.yid.gos 	| 1.2 	| 0.149 |
| Tatoeba-test.yid-ltz.yid.ltz 	| 3.5 	| 0.256 |
| Tatoeba-test.yid-nds.yid.nds 	| 14.4 	| 0.487 |
| Tatoeba-test.yid-nld.yid.nld 	| 26.1 	| 0.423 |
| Tatoeba-test.yid-nor.yid.nor 	| 47.1 	| 0.583 |
| Tatoeba-test.yid-stq.yid.stq 	| 1.5 	| 0.092 |
| Tatoeba-test.yid-swe.yid.swe 	| 35.9 	| 0.518 |
| Tatoeba-test.yid-swg.yid.swg 	| 1.0 	| 0.124 |

### System Info:
- hf_name: gem-gem

- source_languages: gem

- target_languages: gem

- opus_readme_url: https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/gem-gem/README.md

- original_repo: Tatoeba-Challenge

- tags: ['translation']

- languages: ['da', 'sv', 'af', 'nn', 'fy', 'fo', 'de', 'nb', 'nl', 'is', 'en', 'lb', 'yi', 'gem']

- src_constituents: {'ksh', 'enm_Latn', 'got_Goth', 'stq', 'dan', 'swe', 'afr', 'pdc', 'gos', 'nno', 'fry', 'gsw', 'fao', 'deu', 'swg', 'sco', 'nob', 'nld', 'isl', 'eng', 'ltz', 'nob_Hebr', 'ang_Latn', 'frr', 'non_Latn', 'yid', 'nds'}

- tgt_constituents: {'ksh', 'enm_Latn', 'got_Goth', 'stq', 'dan', 'swe', 'afr', 'pdc', 'gos', 'nno', 'fry', 'gsw', 'fao', 'deu', 'swg', 'sco', 'nob', 'nld', 'isl', 'eng', 'ltz', 'nob_Hebr', 'ang_Latn', 'frr', 'non_Latn', 'yid', 'nds'}

- src_multilingual: True

- tgt_multilingual: True

- prepro:  normalization + SentencePiece (spm32k,spm32k)

- url_model: https://object.pouta.csc.fi/Tatoeba-MT-models/gem-gem/opus-2020-07-27.zip

- url_test_set: https://object.pouta.csc.fi/Tatoeba-MT-models/gem-gem/opus-2020-07-27.test.txt

- src_alpha3: gem

- tgt_alpha3: gem

- short_pair: gem-gem

- chrF2_score: 0.614

- bleu: 42.7

- brevity_penalty: 0.993

- ref_len: 73459.0

- src_name: Germanic languages

- tgt_name: Germanic languages

- train_date: 2020-07-27

- src_alpha2: gem

- tgt_alpha2: gem

- prefer_old: False

- long_pair: gem-gem

- helsinki_git_sha: 480fcbe0ee1bf4774bcbe6226ad9f58e63f6c535

- transformers_git_sha: 2207e5d8cb224e954a7cba69fa4ac2309e9ff30b

- port_machine: brutasse

- port_time: 2020-08-21-14:41


---
tags:
- translation
license: apache-2.0
---

### opus-mt-af-fr

* source languages: af
* target languages: fr
*  OPUS readme: [af-fr](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/af-fr/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-08.zip](https://object.pouta.csc.fi/OPUS-MT-models/af-fr/opus-2020-01-08.zip)
* test set translations: [opus-2020-01-08.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/af-fr/opus-2020-01-08.test.txt)
* test set scores: [opus-2020-01-08.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/af-fr/opus-2020-01-08.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| JW300.af.fr 	| 35.3 	| 0.543 |


---
language:
- ar
- he

tags:
- translation

license: apache-2.0
---

### ara-heb

* source group: Arabic
* target group: Hebrew
*  OPUS readme: [ara-heb](https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/ara-heb/README.md)

*  model: transformer
* source language(s): apc apc_Latn ara arq arz
* target language(s): heb
* model: transformer
* pre-processing: normalization + SentencePiece (spm32k,spm32k)
* download original weights: [opus-2020-07-03.zip](https://object.pouta.csc.fi/Tatoeba-MT-models/ara-heb/opus-2020-07-03.zip)
* test set translations: [opus-2020-07-03.test.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/ara-heb/opus-2020-07-03.test.txt)
* test set scores: [opus-2020-07-03.eval.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/ara-heb/opus-2020-07-03.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| Tatoeba-test.ara.heb 	| 40.4 	| 0.605 |

### System Info:
- hf_name: ara-heb

- source_languages: ara

- target_languages: heb

- opus_readme_url: https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/ara-heb/README.md

- original_repo: Tatoeba-Challenge

- tags: ['translation']

- languages: ['ar', 'he']

- src_constituents: {'apc', 'ara', 'arq_Latn', 'arq', 'afb', 'ara_Latn', 'apc_Latn', 'arz'}

- tgt_constituents: {'heb'}

- src_multilingual: False

- tgt_multilingual: False

- prepro:  normalization + SentencePiece (spm32k,spm32k)

- url_model: https://object.pouta.csc.fi/Tatoeba-MT-models/ara-heb/opus-2020-07-03.zip

- url_test_set: https://object.pouta.csc.fi/Tatoeba-MT-models/ara-heb/opus-2020-07-03.test.txt

- src_alpha3: ara

- tgt_alpha3: heb

- short_pair: ar-he

- chrF2_score: 0.605

- bleu: 40.4

- brevity_penalty: 1.0

- ref_len: 6801.0

- src_name: Arabic

- tgt_name: Hebrew

- train_date: 2020-07-03

- src_alpha2: ar

- tgt_alpha2: he

- prefer_old: False

- long_pair: ara-heb

- helsinki_git_sha: 480fcbe0ee1bf4774bcbe6226ad9f58e63f6c535

- transformers_git_sha: 2207e5d8cb224e954a7cba69fa4ac2309e9ff30b

- port_machine: brutasse

- port_time: 2020-08-21-14:41


---
language:
- eo
- io
- art
- en

tags:
- translation

license: apache-2.0
---

### art-eng

* source group: Artificial languages
* target group: English
*  OPUS readme: [art-eng](https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/art-eng/README.md)

*  model: transformer
* source language(s): afh_Latn avk_Latn dws_Latn epo ido ido_Latn ile_Latn ina_Latn jbo jbo_Cyrl jbo_Latn ldn_Latn lfn_Cyrl lfn_Latn nov_Latn qya qya_Latn sjn_Latn tlh_Latn tzl tzl_Latn vol_Latn
* target language(s): eng
* model: transformer
* pre-processing: normalization + SentencePiece (spm32k,spm32k)
* download original weights: [opus2m-2020-07-31.zip](https://object.pouta.csc.fi/Tatoeba-MT-models/art-eng/opus2m-2020-07-31.zip)
* test set translations: [opus2m-2020-07-31.test.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/art-eng/opus2m-2020-07-31.test.txt)
* test set scores: [opus2m-2020-07-31.eval.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/art-eng/opus2m-2020-07-31.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| Tatoeba-test.afh-eng.afh.eng 	| 1.2 	| 0.099 |
| Tatoeba-test.avk-eng.avk.eng 	| 0.4 	| 0.105 |
| Tatoeba-test.dws-eng.dws.eng 	| 1.6 	| 0.076 |
| Tatoeba-test.epo-eng.epo.eng 	| 34.6 	| 0.530 |
| Tatoeba-test.ido-eng.ido.eng 	| 12.7 	| 0.310 |
| Tatoeba-test.ile-eng.ile.eng 	| 4.6 	| 0.218 |
| Tatoeba-test.ina-eng.ina.eng 	| 5.8 	| 0.254 |
| Tatoeba-test.jbo-eng.jbo.eng 	| 0.2 	| 0.115 |
| Tatoeba-test.ldn-eng.ldn.eng 	| 0.7 	| 0.083 |
| Tatoeba-test.lfn-eng.lfn.eng 	| 1.8 	| 0.172 |
| Tatoeba-test.multi.eng 	| 11.6 	| 0.287 |
| Tatoeba-test.nov-eng.nov.eng 	| 5.1 	| 0.215 |
| Tatoeba-test.qya-eng.qya.eng 	| 0.7 	| 0.113 |
| Tatoeba-test.sjn-eng.sjn.eng 	| 0.9 	| 0.090 |
| Tatoeba-test.tlh-eng.tlh.eng 	| 0.2 	| 0.124 |
| Tatoeba-test.tzl-eng.tzl.eng 	| 1.4 	| 0.109 |
| Tatoeba-test.vol-eng.vol.eng 	| 0.5 	| 0.115 |

### System Info:
- hf_name: art-eng

- source_languages: art

- target_languages: eng

- opus_readme_url: https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/art-eng/README.md

- original_repo: Tatoeba-Challenge

- tags: ['translation']

- languages: ['eo', 'io', 'art', 'en']

- src_constituents: {'sjn_Latn', 'tzl', 'vol_Latn', 'qya', 'tlh_Latn', 'ile_Latn', 'ido_Latn', 'tzl_Latn', 'jbo_Cyrl', 'jbo', 'lfn_Latn', 'nov_Latn', 'dws_Latn', 'ldn_Latn', 'avk_Latn', 'lfn_Cyrl', 'ina_Latn', 'jbo_Latn', 'epo', 'afh_Latn', 'qya_Latn', 'ido'}

- tgt_constituents: {'eng'}

- src_multilingual: True

- tgt_multilingual: False

- prepro:  normalization + SentencePiece (spm32k,spm32k)

- url_model: https://object.pouta.csc.fi/Tatoeba-MT-models/art-eng/opus2m-2020-07-31.zip

- url_test_set: https://object.pouta.csc.fi/Tatoeba-MT-models/art-eng/opus2m-2020-07-31.test.txt

- src_alpha3: art

- tgt_alpha3: eng

- short_pair: art-en

- chrF2_score: 0.287

- bleu: 11.6

- brevity_penalty: 1.0

- ref_len: 73037.0

- src_name: Artificial languages

- tgt_name: English

- train_date: 2020-07-31

- src_alpha2: art

- tgt_alpha2: en

- prefer_old: False

- long_pair: art-eng

- helsinki_git_sha: 480fcbe0ee1bf4774bcbe6226ad9f58e63f6c535

- transformers_git_sha: 2207e5d8cb224e954a7cba69fa4ac2309e9ff30b

- port_machine: brutasse

- port_time: 2020-08-21-14:41


---
tags:
- translation
license: apache-2.0
---

### opus-mt-en-run

* source languages: en
* target languages: run
*  OPUS readme: [en-run](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/en-run/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-20.zip](https://object.pouta.csc.fi/OPUS-MT-models/en-run/opus-2020-01-20.zip)
* test set translations: [opus-2020-01-20.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/en-run/opus-2020-01-20.test.txt)
* test set scores: [opus-2020-01-20.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/en-run/opus-2020-01-20.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| JW300.en.run 	| 34.2 	| 0.591 |


---
tags:
- translation
license: apache-2.0
---

### opus-mt-en_el_es_fi-en_el_es_fi

* source languages: en,el,es,fi
* target languages: en,el,es,fi
*  OPUS readme: [en+el+es+fi-en+el+es+fi](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/en+el+es+fi-en+el+es+fi/README.md)

*  dataset: opus
* model: transformer
* pre-processing: normalization + SentencePiece
* a sentence initial language token is required in the form of `>>id<<` (id = valid target language ID)
* download original weights: [opus-2020-03-02.zip](https://object.pouta.csc.fi/OPUS-MT-models/en+el+es+fi-en+el+es+fi/opus-2020-03-02.zip)
* test set translations: [opus-2020-03-02.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/en+el+es+fi-en+el+es+fi/opus-2020-03-02.test.txt)
* test set scores: [opus-2020-03-02.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/en+el+es+fi-en+el+es+fi/opus-2020-03-02.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| newsdev2015-enfi.en.fi 	| 16.0 	| 0.498 |
| newssyscomb2009.en.es 	| 29.9 	| 0.570 |
| newssyscomb2009.es.en 	| 29.7 	| 0.569 |
| news-test2008.en.es 	| 27.3 	| 0.549 |
| news-test2008.es.en 	| 27.3 	| 0.548 |
| newstest2009.en.es 	| 28.4 	| 0.564 |
| newstest2009.es.en 	| 28.4 	| 0.564 |
| newstest2010.en.es 	| 34.0 	| 0.599 |
| newstest2010.es.en 	| 34.0 	| 0.599 |
| newstest2011.en.es 	| 35.1 	| 0.600 |
| newstest2012.en.es 	| 35.4 	| 0.602 |
| newstest2013.en.es 	| 31.9 	| 0.576 |
| newstest2015-enfi.en.fi 	| 17.8 	| 0.509 |
| newstest2016-enfi.en.fi 	| 19.0 	| 0.521 |
| newstest2017-enfi.en.fi 	| 21.2 	| 0.539 |
| newstest2018-enfi.en.fi 	| 13.9 	| 0.478 |
| newstest2019-enfi.en.fi 	| 18.8 	| 0.503 |
| newstestB2016-enfi.en.fi 	| 14.9 	| 0.491 |
| newstestB2017-enfi.en.fi 	| 16.9 	| 0.503 |
| simplification.en.en 	| 63.0 	| 0.798 |
| Tatoeba.en.fi 	| 56.7 	| 0.719 |


---
tags:
- translation
license: apache-2.0
---

### opus-mt-en-iso

* source languages: en
* target languages: iso
*  OPUS readme: [en-iso](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/en-iso/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-08.zip](https://object.pouta.csc.fi/OPUS-MT-models/en-iso/opus-2020-01-08.zip)
* test set translations: [opus-2020-01-08.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/en-iso/opus-2020-01-08.test.txt)
* test set scores: [opus-2020-01-08.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/en-iso/opus-2020-01-08.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| JW300.en.iso 	| 35.7 	| 0.523 |


---
tags:
- translation
license: apache-2.0
---

### opus-mt-ln-fr

* source languages: ln
* target languages: fr
*  OPUS readme: [ln-fr](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/ln-fr/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-09.zip](https://object.pouta.csc.fi/OPUS-MT-models/ln-fr/opus-2020-01-09.zip)
* test set translations: [opus-2020-01-09.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/ln-fr/opus-2020-01-09.test.txt)
* test set scores: [opus-2020-01-09.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/ln-fr/opus-2020-01-09.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| JW300.ln.fr 	| 28.4 	| 0.456 |


---
tags:
- translation
license: apache-2.0
---

### opus-mt-sv-umb

* source languages: sv
* target languages: umb
*  OPUS readme: [sv-umb](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/sv-umb/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-16.zip](https://object.pouta.csc.fi/OPUS-MT-models/sv-umb/opus-2020-01-16.zip)
* test set translations: [opus-2020-01-16.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/sv-umb/opus-2020-01-16.test.txt)
* test set scores: [opus-2020-01-16.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/sv-umb/opus-2020-01-16.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| JW300.sv.umb 	| 20.4 	| 0.431 |


---
language:
- ca
- uk

tags:
- translation

license: apache-2.0
---

### cat-ukr

* source group: Catalan
* target group: Ukrainian
*  OPUS readme: [cat-ukr](https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/cat-ukr/README.md)

*  model: transformer-align
* source language(s): cat
* target language(s): ukr
* model: transformer-align
* pre-processing: normalization + SentencePiece (spm4k,spm4k)
* download original weights: [opus-2020-06-16.zip](https://object.pouta.csc.fi/Tatoeba-MT-models/cat-ukr/opus-2020-06-16.zip)
* test set translations: [opus-2020-06-16.test.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/cat-ukr/opus-2020-06-16.test.txt)
* test set scores: [opus-2020-06-16.eval.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/cat-ukr/opus-2020-06-16.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| Tatoeba-test.cat.ukr 	| 28.6 	| 0.503 |

### System Info:
- hf_name: cat-ukr

- source_languages: cat

- target_languages: ukr

- opus_readme_url: https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/cat-ukr/README.md

- original_repo: Tatoeba-Challenge

- tags: ['translation']

- languages: ['ca', 'uk']

- src_constituents: {'cat'}

- tgt_constituents: {'ukr'}

- src_multilingual: False

- tgt_multilingual: False

- prepro:  normalization + SentencePiece (spm4k,spm4k)

- url_model: https://object.pouta.csc.fi/Tatoeba-MT-models/cat-ukr/opus-2020-06-16.zip

- url_test_set: https://object.pouta.csc.fi/Tatoeba-MT-models/cat-ukr/opus-2020-06-16.test.txt

- src_alpha3: cat

- tgt_alpha3: ukr

- short_pair: ca-uk

- chrF2_score: 0.503

- bleu: 28.6

- brevity_penalty: 0.9670000000000001

- ref_len: 2438.0

- src_name: Catalan

- tgt_name: Ukrainian

- train_date: 2020-06-16

- src_alpha2: ca

- tgt_alpha2: uk

- prefer_old: False

- long_pair: cat-ukr

- helsinki_git_sha: 480fcbe0ee1bf4774bcbe6226ad9f58e63f6c535

- transformers_git_sha: 2207e5d8cb224e954a7cba69fa4ac2309e9ff30b

- port_machine: brutasse

- port_time: 2020-08-21-14:41


---
tags:
- translation
license: apache-2.0
---

### opus-mt-lg-fr

* source languages: lg
* target languages: fr
*  OPUS readme: [lg-fr](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/lg-fr/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-09.zip](https://object.pouta.csc.fi/OPUS-MT-models/lg-fr/opus-2020-01-09.zip)
* test set translations: [opus-2020-01-09.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/lg-fr/opus-2020-01-09.test.txt)
* test set scores: [opus-2020-01-09.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/lg-fr/opus-2020-01-09.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| JW300.lg.fr 	| 23.7 	| 0.406 |


---
tags:
- translation
license: apache-2.0
---

### opus-mt-fi-mos

* source languages: fi
* target languages: mos
*  OPUS readme: [fi-mos](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/fi-mos/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-24.zip](https://object.pouta.csc.fi/OPUS-MT-models/fi-mos/opus-2020-01-24.zip)
* test set translations: [opus-2020-01-24.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/fi-mos/opus-2020-01-24.test.txt)
* test set scores: [opus-2020-01-24.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/fi-mos/opus-2020-01-24.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| JW300.fi.mos 	| 21.4 	| 0.366 |


---
language:
- ru
- sv

tags:
- translation

license: apache-2.0
---

### rus-swe

* source group: Russian
* target group: Swedish
*  OPUS readme: [rus-swe](https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/rus-swe/README.md)

*  model: transformer-align
* source language(s): rus
* target language(s): swe
* model: transformer-align
* pre-processing: normalization + SentencePiece (spm32k,spm32k)
* download original weights: [opus-2020-06-17.zip](https://object.pouta.csc.fi/Tatoeba-MT-models/rus-swe/opus-2020-06-17.zip)
* test set translations: [opus-2020-06-17.test.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/rus-swe/opus-2020-06-17.test.txt)
* test set scores: [opus-2020-06-17.eval.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/rus-swe/opus-2020-06-17.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| Tatoeba-test.rus.swe 	| 51.9 	| 0.677 |

### System Info:
- hf_name: rus-swe

- source_languages: rus

- target_languages: swe

- opus_readme_url: https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/rus-swe/README.md

- original_repo: Tatoeba-Challenge

- tags: ['translation']

- languages: ['ru', 'sv']

- src_constituents: {'rus'}

- tgt_constituents: {'swe'}

- src_multilingual: False

- tgt_multilingual: False

- prepro:  normalization + SentencePiece (spm32k,spm32k)

- url_model: https://object.pouta.csc.fi/Tatoeba-MT-models/rus-swe/opus-2020-06-17.zip

- url_test_set: https://object.pouta.csc.fi/Tatoeba-MT-models/rus-swe/opus-2020-06-17.test.txt

- src_alpha3: rus

- tgt_alpha3: swe

- short_pair: ru-sv

- chrF2_score: 0.677

- bleu: 51.9

- brevity_penalty: 0.968

- ref_len: 8449.0

- src_name: Russian

- tgt_name: Swedish

- train_date: 2020-06-17

- src_alpha2: ru

- tgt_alpha2: sv

- prefer_old: False

- long_pair: rus-swe

- helsinki_git_sha: 480fcbe0ee1bf4774bcbe6226ad9f58e63f6c535

- transformers_git_sha: 2207e5d8cb224e954a7cba69fa4ac2309e9ff30b

- port_machine: brutasse

- port_time: 2020-08-21-14:41


---
tags:
- translation
license: apache-2.0
---

### opus-mt-tiv-en

* source languages: tiv
* target languages: en
*  OPUS readme: [tiv-en](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/tiv-en/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-16.zip](https://object.pouta.csc.fi/OPUS-MT-models/tiv-en/opus-2020-01-16.zip)
* test set translations: [opus-2020-01-16.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/tiv-en/opus-2020-01-16.test.txt)
* test set scores: [opus-2020-01-16.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/tiv-en/opus-2020-01-16.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| JW300.tiv.en 	| 31.5 	| 0.473 |


---
tags:
- translation
license: apache-2.0
---

### opus-mt-fi-hu

* source languages: fi
* target languages: hu
*  OPUS readme: [fi-hu](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/fi-hu/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-08.zip](https://object.pouta.csc.fi/OPUS-MT-models/fi-hu/opus-2020-01-08.zip)
* test set translations: [opus-2020-01-08.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/fi-hu/opus-2020-01-08.test.txt)
* test set scores: [opus-2020-01-08.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/fi-hu/opus-2020-01-08.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| Tatoeba.fi.hu 	| 50.4 	| 0.705 |


---
tags:
- translation
license: apache-2.0
---

### opus-mt-es-ve

* source languages: es
* target languages: ve
*  OPUS readme: [es-ve](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/es-ve/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-16.zip](https://object.pouta.csc.fi/OPUS-MT-models/es-ve/opus-2020-01-16.zip)
* test set translations: [opus-2020-01-16.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/es-ve/opus-2020-01-16.test.txt)
* test set scores: [opus-2020-01-16.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/es-ve/opus-2020-01-16.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| JW300.es.ve 	| 21.7 	| 0.440 |


---
language:
- ru
- lv

tags:
- translation

license: apache-2.0
---

### rus-lav

* source group: Russian
* target group: Latvian
*  OPUS readme: [rus-lav](https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/rus-lav/README.md)

*  model: transformer-align
* source language(s): rus
* target language(s): lav
* model: transformer-align
* pre-processing: normalization + SentencePiece (spm32k,spm32k)
* download original weights: [opus-2020-06-17.zip](https://object.pouta.csc.fi/Tatoeba-MT-models/rus-lav/opus-2020-06-17.zip)
* test set translations: [opus-2020-06-17.test.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/rus-lav/opus-2020-06-17.test.txt)
* test set scores: [opus-2020-06-17.eval.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/rus-lav/opus-2020-06-17.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| Tatoeba-test.rus.lav 	| 50.0 	| 0.696 |

### System Info:
- hf_name: rus-lav

- source_languages: rus

- target_languages: lav

- opus_readme_url: https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/rus-lav/README.md

- original_repo: Tatoeba-Challenge

- tags: ['translation']

- languages: ['ru', 'lv']

- src_constituents: {'rus'}

- tgt_constituents: {'lav'}

- src_multilingual: False

- tgt_multilingual: False

- prepro:  normalization + SentencePiece (spm32k,spm32k)

- url_model: https://object.pouta.csc.fi/Tatoeba-MT-models/rus-lav/opus-2020-06-17.zip

- url_test_set: https://object.pouta.csc.fi/Tatoeba-MT-models/rus-lav/opus-2020-06-17.test.txt

- src_alpha3: rus

- tgt_alpha3: lav

- short_pair: ru-lv

- chrF2_score: 0.696

- bleu: 50.0

- brevity_penalty: 0.968

- ref_len: 1518.0

- src_name: Russian

- tgt_name: Latvian

- train_date: 2020-06-17

- src_alpha2: ru

- tgt_alpha2: lv

- prefer_old: False

- long_pair: rus-lav

- helsinki_git_sha: 480fcbe0ee1bf4774bcbe6226ad9f58e63f6c535

- transformers_git_sha: 2207e5d8cb224e954a7cba69fa4ac2309e9ff30b

- port_machine: brutasse

- port_time: 2020-08-21-14:41


---
tags:
- translation
license: apache-2.0
---

### opus-mt-sv-is

* source languages: sv
* target languages: is
*  OPUS readme: [sv-is](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/sv-is/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-16.zip](https://object.pouta.csc.fi/OPUS-MT-models/sv-is/opus-2020-01-16.zip)
* test set translations: [opus-2020-01-16.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/sv-is/opus-2020-01-16.test.txt)
* test set scores: [opus-2020-01-16.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/sv-is/opus-2020-01-16.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| JW300.sv.is 	| 27.1 	| 0.471 |


---
tags:
- translation
license: apache-2.0
---

### opus-mt-ar-en

* source languages: ar
* target languages: en
*  OPUS readme: [ar-en](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/ar-en/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2019-12-18.zip](https://object.pouta.csc.fi/OPUS-MT-models/ar-en/opus-2019-12-18.zip)
* test set translations: [opus-2019-12-18.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/ar-en/opus-2019-12-18.test.txt)
* test set scores: [opus-2019-12-18.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/ar-en/opus-2019-12-18.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| Tatoeba.ar.en 	| 49.4 	| 0.661 |


---
tags:
- translation
license: apache-2.0
---

### opus-mt-fi-gaa

* source languages: fi
* target languages: gaa
*  OPUS readme: [fi-gaa](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/fi-gaa/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-08.zip](https://object.pouta.csc.fi/OPUS-MT-models/fi-gaa/opus-2020-01-08.zip)
* test set translations: [opus-2020-01-08.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/fi-gaa/opus-2020-01-08.test.txt)
* test set scores: [opus-2020-01-08.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/fi-gaa/opus-2020-01-08.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| JW300.fi.gaa 	| 30.5 	| 0.514 |


---
tags:
- translation
license: apache-2.0
---

### opus-mt-mh-es

* source languages: mh
* target languages: es
*  OPUS readme: [mh-es](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/mh-es/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-16.zip](https://object.pouta.csc.fi/OPUS-MT-models/mh-es/opus-2020-01-16.zip)
* test set translations: [opus-2020-01-16.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/mh-es/opus-2020-01-16.test.txt)
* test set scores: [opus-2020-01-16.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/mh-es/opus-2020-01-16.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| JW300.mh.es 	| 23.6 	| 0.407 |


---
tags:
- translation
license: apache-2.0
---

### opus-mt-en-tw

* source languages: en
* target languages: tw
*  OPUS readme: [en-tw](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/en-tw/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-08.zip](https://object.pouta.csc.fi/OPUS-MT-models/en-tw/opus-2020-01-08.zip)
* test set translations: [opus-2020-01-08.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/en-tw/opus-2020-01-08.test.txt)
* test set scores: [opus-2020-01-08.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/en-tw/opus-2020-01-08.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| JW300.en.tw 	| 38.2 	| 0.577 |


---
tags:
- translation
license: apache-2.0
---

### opus-mt-yap-fr

* source languages: yap
* target languages: fr
*  OPUS readme: [yap-fr](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/yap-fr/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-16.zip](https://object.pouta.csc.fi/OPUS-MT-models/yap-fr/opus-2020-01-16.zip)
* test set translations: [opus-2020-01-16.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/yap-fr/opus-2020-01-16.test.txt)
* test set scores: [opus-2020-01-16.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/yap-fr/opus-2020-01-16.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| JW300.yap.fr 	| 22.2 	| 0.381 |


---
tags:
- translation
license: apache-2.0
---

### opus-mt-toi-es

* source languages: toi
* target languages: es
*  OPUS readme: [toi-es](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/toi-es/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-16.zip](https://object.pouta.csc.fi/OPUS-MT-models/toi-es/opus-2020-01-16.zip)
* test set translations: [opus-2020-01-16.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/toi-es/opus-2020-01-16.test.txt)
* test set scores: [opus-2020-01-16.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/toi-es/opus-2020-01-16.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| JW300.toi.es 	| 24.6 	| 0.416 |


---
tags:
- translation
license: apache-2.0
---

### opus-mt-es-tvl

* source languages: es
* target languages: tvl
*  OPUS readme: [es-tvl](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/es-tvl/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-16.zip](https://object.pouta.csc.fi/OPUS-MT-models/es-tvl/opus-2020-01-16.zip)
* test set translations: [opus-2020-01-16.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/es-tvl/opus-2020-01-16.test.txt)
* test set scores: [opus-2020-01-16.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/es-tvl/opus-2020-01-16.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| JW300.es.tvl 	| 28.3 	| 0.464 |


---
tags:
- translation
license: apache-2.0
---

### opus-mt-fi-ty

* source languages: fi
* target languages: ty
*  OPUS readme: [fi-ty](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/fi-ty/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-24.zip](https://object.pouta.csc.fi/OPUS-MT-models/fi-ty/opus-2020-01-24.zip)
* test set translations: [opus-2020-01-24.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/fi-ty/opus-2020-01-24.test.txt)
* test set scores: [opus-2020-01-24.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/fi-ty/opus-2020-01-24.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| JW300.fi.ty 	| 39.7 	| 0.565 |


---
tags:
- translation
license: apache-2.0
---

### opus-mt-en-eo

* source languages: en
* target languages: eo
*  OPUS readme: [en-eo](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/en-eo/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2019-12-18.zip](https://object.pouta.csc.fi/OPUS-MT-models/en-eo/opus-2019-12-18.zip)
* test set translations: [opus-2019-12-18.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/en-eo/opus-2019-12-18.test.txt)
* test set scores: [opus-2019-12-18.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/en-eo/opus-2019-12-18.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| Tatoeba.en.eo 	| 49.5 	| 0.682 |


---
tags:
- translation
license: apache-2.0
---

### opus-mt-fi-ha

* source languages: fi
* target languages: ha
*  OPUS readme: [fi-ha](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/fi-ha/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-24.zip](https://object.pouta.csc.fi/OPUS-MT-models/fi-ha/opus-2020-01-24.zip)
* test set translations: [opus-2020-01-24.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/fi-ha/opus-2020-01-24.test.txt)
* test set scores: [opus-2020-01-24.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/fi-ha/opus-2020-01-24.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| JW300.fi.ha 	| 24.2 	| 0.461 |


---
language:
- be
- ru
- uk
- zle

tags:
- translation

license: apache-2.0
---

### zle-zle

* source group: East Slavic languages
* target group: East Slavic languages
*  OPUS readme: [zle-zle](https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/zle-zle/README.md)

*  model: transformer
* source language(s): bel bel_Latn orv_Cyrl rus ukr
* target language(s): bel bel_Latn orv_Cyrl rus ukr
* model: transformer
* pre-processing: normalization + SentencePiece (spm32k,spm32k)
* a sentence initial language token is required in the form of `>>id<<` (id = valid target language ID)
* download original weights: [opus-2020-07-27.zip](https://object.pouta.csc.fi/Tatoeba-MT-models/zle-zle/opus-2020-07-27.zip)
* test set translations: [opus-2020-07-27.test.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/zle-zle/opus-2020-07-27.test.txt)
* test set scores: [opus-2020-07-27.eval.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/zle-zle/opus-2020-07-27.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| Tatoeba-test.bel-rus.bel.rus 	| 57.1 	| 0.758 |
| Tatoeba-test.bel-ukr.bel.ukr 	| 55.5 	| 0.751 |
| Tatoeba-test.multi.multi 	| 58.0 	| 0.742 |
| Tatoeba-test.orv-rus.orv.rus 	| 5.8 	| 0.226 |
| Tatoeba-test.orv-ukr.orv.ukr 	| 2.5 	| 0.161 |
| Tatoeba-test.rus-bel.rus.bel 	| 50.5 	| 0.714 |
| Tatoeba-test.rus-orv.rus.orv 	| 0.3 	| 0.129 |
| Tatoeba-test.rus-ukr.rus.ukr 	| 63.9 	| 0.794 |
| Tatoeba-test.ukr-bel.ukr.bel 	| 51.3 	| 0.719 |
| Tatoeba-test.ukr-orv.ukr.orv 	| 0.3 	| 0.106 |
| Tatoeba-test.ukr-rus.ukr.rus 	| 68.7 	| 0.825 |

### System Info:
- hf_name: zle-zle

- source_languages: zle

- target_languages: zle

- opus_readme_url: https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/zle-zle/README.md

- original_repo: Tatoeba-Challenge

- tags: ['translation']

- languages: ['be', 'ru', 'uk', 'zle']

- src_constituents: {'bel', 'orv_Cyrl', 'bel_Latn', 'rus', 'ukr', 'rue'}

- tgt_constituents: {'bel', 'orv_Cyrl', 'bel_Latn', 'rus', 'ukr', 'rue'}

- src_multilingual: True

- tgt_multilingual: True

- prepro:  normalization + SentencePiece (spm32k,spm32k)

- url_model: https://object.pouta.csc.fi/Tatoeba-MT-models/zle-zle/opus-2020-07-27.zip

- url_test_set: https://object.pouta.csc.fi/Tatoeba-MT-models/zle-zle/opus-2020-07-27.test.txt

- src_alpha3: zle

- tgt_alpha3: zle

- short_pair: zle-zle

- chrF2_score: 0.742

- bleu: 58.0

- brevity_penalty: 1.0

- ref_len: 62731.0

- src_name: East Slavic languages

- tgt_name: East Slavic languages

- train_date: 2020-07-27

- src_alpha2: zle

- tgt_alpha2: zle

- prefer_old: False

- long_pair: zle-zle

- helsinki_git_sha: 480fcbe0ee1bf4774bcbe6226ad9f58e63f6c535

- transformers_git_sha: 2207e5d8cb224e954a7cba69fa4ac2309e9ff30b

- port_machine: brutasse

- port_time: 2020-08-21-14:41


---
language:
- ja
- it

tags:
- translation

license: apache-2.0
---

### jpn-ita

* source group: Japanese
* target group: Italian
*  OPUS readme: [jpn-ita](https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/jpn-ita/README.md)

*  model: transformer-align
* source language(s): jpn jpn_Hani jpn_Hira jpn_Kana jpn_Latn jpn_Yiii
* target language(s): ita
* model: transformer-align
* pre-processing: normalization + SentencePiece (spm32k,spm32k)
* download original weights: [opus-2020-06-17.zip](https://object.pouta.csc.fi/Tatoeba-MT-models/jpn-ita/opus-2020-06-17.zip)
* test set translations: [opus-2020-06-17.test.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/jpn-ita/opus-2020-06-17.test.txt)
* test set scores: [opus-2020-06-17.eval.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/jpn-ita/opus-2020-06-17.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| Tatoeba-test.jpn.ita 	| 22.8 	| 0.460 |

### System Info:
- hf_name: jpn-ita

- source_languages: jpn

- target_languages: ita

- opus_readme_url: https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/jpn-ita/README.md

- original_repo: Tatoeba-Challenge

- tags: ['translation']

- languages: ['ja', 'it']

- src_constituents: {'jpn_Hang', 'jpn', 'jpn_Yiii', 'jpn_Kana', 'jpn_Hani', 'jpn_Bopo', 'jpn_Latn', 'jpn_Hira'}

- tgt_constituents: {'ita'}

- src_multilingual: False

- tgt_multilingual: False

- prepro:  normalization + SentencePiece (spm32k,spm32k)

- url_model: https://object.pouta.csc.fi/Tatoeba-MT-models/jpn-ita/opus-2020-06-17.zip

- url_test_set: https://object.pouta.csc.fi/Tatoeba-MT-models/jpn-ita/opus-2020-06-17.test.txt

- src_alpha3: jpn

- tgt_alpha3: ita

- short_pair: ja-it

- chrF2_score: 0.46

- bleu: 22.8

- brevity_penalty: 0.9540000000000001

- ref_len: 21500.0

- src_name: Japanese

- tgt_name: Italian

- train_date: 2020-06-17

- src_alpha2: ja

- tgt_alpha2: it

- prefer_old: False

- long_pair: jpn-ita

- helsinki_git_sha: 480fcbe0ee1bf4774bcbe6226ad9f58e63f6c535

- transformers_git_sha: 2207e5d8cb224e954a7cba69fa4ac2309e9ff30b

- port_machine: brutasse

- port_time: 2020-08-21-14:41


---
language:
- lo
- th
- taw
- en

tags:
- translation

license: apache-2.0
---

### taw-eng

* source group: Tai
* target group: English
*  OPUS readme: [taw-eng](https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/taw-eng/README.md)

*  model: transformer
* source language(s): lao tha
* target language(s): eng
* model: transformer
* pre-processing: normalization + SentencePiece (spm32k,spm32k)
* download original weights: [opus-2020-06-28.zip](https://object.pouta.csc.fi/Tatoeba-MT-models/taw-eng/opus-2020-06-28.zip)
* test set translations: [opus-2020-06-28.test.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/taw-eng/opus-2020-06-28.test.txt)
* test set scores: [opus-2020-06-28.eval.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/taw-eng/opus-2020-06-28.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| Tatoeba-test.lao-eng.lao.eng 	| 1.1 	| 0.133 |
| Tatoeba-test.multi.eng 	| 38.9 	| 0.572 |
| Tatoeba-test.tha-eng.tha.eng 	| 40.6 	| 0.588 |

### System Info:
- hf_name: taw-eng

- source_languages: taw

- target_languages: eng

- opus_readme_url: https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/taw-eng/README.md

- original_repo: Tatoeba-Challenge

- tags: ['translation']

- languages: ['lo', 'th', 'taw', 'en']

- src_constituents: {'lao', 'tha'}

- tgt_constituents: {'eng'}

- src_multilingual: True

- tgt_multilingual: False

- prepro:  normalization + SentencePiece (spm32k,spm32k)

- url_model: https://object.pouta.csc.fi/Tatoeba-MT-models/taw-eng/opus-2020-06-28.zip

- url_test_set: https://object.pouta.csc.fi/Tatoeba-MT-models/taw-eng/opus-2020-06-28.test.txt

- src_alpha3: taw

- tgt_alpha3: eng

- short_pair: taw-en

- chrF2_score: 0.5720000000000001

- bleu: 38.9

- brevity_penalty: 1.0

- ref_len: 7630.0

- src_name: Tai

- tgt_name: English

- train_date: 2020-06-28

- src_alpha2: taw

- tgt_alpha2: en

- prefer_old: False

- long_pair: taw-eng

- helsinki_git_sha: 480fcbe0ee1bf4774bcbe6226ad9f58e63f6c535

- transformers_git_sha: 2207e5d8cb224e954a7cba69fa4ac2309e9ff30b

- port_machine: brutasse

- port_time: 2020-08-21-14:41


---
tags:
- translation
license: apache-2.0
---

### opus-mt-en-cs

* source languages: en
* target languages: cs
*  OPUS readme: [en-cs](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/en-cs/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2019-12-18.zip](https://object.pouta.csc.fi/OPUS-MT-models/en-cs/opus-2019-12-18.zip)
* test set translations: [opus-2019-12-18.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/en-cs/opus-2019-12-18.test.txt)
* test set scores: [opus-2019-12-18.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/en-cs/opus-2019-12-18.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| newssyscomb2009.en.cs 	| 22.8 	| 0.507 |
| news-test2008.en.cs 	| 20.7 	| 0.485 |
| newstest2009.en.cs 	| 21.8 	| 0.500 |
| newstest2010.en.cs 	| 22.1 	| 0.505 |
| newstest2011.en.cs 	| 23.2 	| 0.507 |
| newstest2012.en.cs 	| 20.8 	| 0.482 |
| newstest2013.en.cs 	| 24.7 	| 0.514 |
| newstest2015-encs.en.cs 	| 24.9 	| 0.527 |
| newstest2016-encs.en.cs 	| 26.7 	| 0.540 |
| newstest2017-encs.en.cs 	| 22.7 	| 0.503 |
| newstest2018-encs.en.cs 	| 22.9 	| 0.504 |
| newstest2019-encs.en.cs 	| 24.9 	| 0.518 |
| Tatoeba.en.cs 	| 46.1 	| 0.647 |


---
tags:
- translation
license: apache-2.0
---

### opus-mt-en-ss

* source languages: en
* target languages: ss
*  OPUS readme: [en-ss](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/en-ss/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-08.zip](https://object.pouta.csc.fi/OPUS-MT-models/en-ss/opus-2020-01-08.zip)
* test set translations: [opus-2020-01-08.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/en-ss/opus-2020-01-08.test.txt)
* test set scores: [opus-2020-01-08.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/en-ss/opus-2020-01-08.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| JW300.en.ss 	| 25.7 	| 0.541 |


---
tags:
- translation
license: apache-2.0
---

### opus-mt-es-mt

* source languages: es
* target languages: mt
*  OPUS readme: [es-mt](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/es-mt/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-16.zip](https://object.pouta.csc.fi/OPUS-MT-models/es-mt/opus-2020-01-16.zip)
* test set translations: [opus-2020-01-16.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/es-mt/opus-2020-01-16.test.txt)
* test set scores: [opus-2020-01-16.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/es-mt/opus-2020-01-16.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| JW300.es.mt 	| 28.1 	| 0.460 |


---
tags:
- translation
license: apache-2.0
---

### opus-mt-lue-es

* source languages: lue
* target languages: es
*  OPUS readme: [lue-es](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/lue-es/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-16.zip](https://object.pouta.csc.fi/OPUS-MT-models/lue-es/opus-2020-01-16.zip)
* test set translations: [opus-2020-01-16.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/lue-es/opus-2020-01-16.test.txt)
* test set scores: [opus-2020-01-16.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/lue-es/opus-2020-01-16.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| JW300.lue.es 	| 22.8 	| 0.399 |


---
tags:
- translation
license: apache-2.0
---

### opus-mt-efi-de

* source languages: efi
* target languages: de
*  OPUS readme: [efi-de](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/efi-de/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-20.zip](https://object.pouta.csc.fi/OPUS-MT-models/efi-de/opus-2020-01-20.zip)
* test set translations: [opus-2020-01-20.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/efi-de/opus-2020-01-20.test.txt)
* test set scores: [opus-2020-01-20.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/efi-de/opus-2020-01-20.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| JW300.efi.de 	| 21.0 	| 0.401 |


---
tags:
- translation
license: apache-2.0
---

### opus-mt-de-hu

* source languages: de
* target languages: hu
*  OPUS readme: [de-hu](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/de-hu/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-20.zip](https://object.pouta.csc.fi/OPUS-MT-models/de-hu/opus-2020-01-20.zip)
* test set translations: [opus-2020-01-20.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/de-hu/opus-2020-01-20.test.txt)
* test set scores: [opus-2020-01-20.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/de-hu/opus-2020-01-20.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| Tatoeba.de.hu 	| 34.3 	| 0.588 |


---
tags:
- translation
license: apache-2.0
---

### opus-mt-guw-sv

* source languages: guw
* target languages: sv
*  OPUS readme: [guw-sv](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/guw-sv/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-09.zip](https://object.pouta.csc.fi/OPUS-MT-models/guw-sv/opus-2020-01-09.zip)
* test set translations: [opus-2020-01-09.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/guw-sv/opus-2020-01-09.test.txt)
* test set scores: [opus-2020-01-09.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/guw-sv/opus-2020-01-09.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| JW300.guw.sv 	| 31.2 	| 0.498 |


---
tags:
- translation
license: apache-2.0
---

### opus-mt-fi-fj

* source languages: fi
* target languages: fj
*  OPUS readme: [fi-fj](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/fi-fj/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-20.zip](https://object.pouta.csc.fi/OPUS-MT-models/fi-fj/opus-2020-01-20.zip)
* test set translations: [opus-2020-01-20.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/fi-fj/opus-2020-01-20.test.txt)
* test set scores: [opus-2020-01-20.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/fi-fj/opus-2020-01-20.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| JW300.fi.fj 	| 26.6 	| 0.500 |


---
tags:
- translation
license: apache-2.0
---

### opus-mt-sg-es

* source languages: sg
* target languages: es
*  OPUS readme: [sg-es](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/sg-es/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-16.zip](https://object.pouta.csc.fi/OPUS-MT-models/sg-es/opus-2020-01-16.zip)
* test set translations: [opus-2020-01-16.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/sg-es/opus-2020-01-16.test.txt)
* test set scores: [opus-2020-01-16.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/sg-es/opus-2020-01-16.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| JW300.sg.es 	| 21.3 	| 0.385 |


---
tags:
- translation
license: apache-2.0
---

### opus-mt-fi-fse

* source languages: fi
* target languages: fse
*  OPUS readme: [fi-fse](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/fi-fse/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-08.zip](https://object.pouta.csc.fi/OPUS-MT-models/fi-fse/opus-2020-01-08.zip)
* test set translations: [opus-2020-01-08.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/fi-fse/opus-2020-01-08.test.txt)
* test set scores: [opus-2020-01-08.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/fi-fse/opus-2020-01-08.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| JW300.fi.fse 	| 81.9 	| 0.882 |


---
tags:
- translation
license: apache-2.0
---

### opus-mt-sv-ilo

* source languages: sv
* target languages: ilo
*  OPUS readme: [sv-ilo](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/sv-ilo/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-16.zip](https://object.pouta.csc.fi/OPUS-MT-models/sv-ilo/opus-2020-01-16.zip)
* test set translations: [opus-2020-01-16.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/sv-ilo/opus-2020-01-16.test.txt)
* test set scores: [opus-2020-01-16.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/sv-ilo/opus-2020-01-16.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| JW300.sv.ilo 	| 34.8 	| 0.578 |


---
language:
- is
- eo

tags:
- translation

license: apache-2.0
---

### isl-epo

* source group: Icelandic
* target group: Esperanto
*  OPUS readme: [isl-epo](https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/isl-epo/README.md)

*  model: transformer-align
* source language(s): isl
* target language(s): epo
* model: transformer-align
* pre-processing: normalization + SentencePiece (spm4k,spm4k)
* download original weights: [opus-2020-06-16.zip](https://object.pouta.csc.fi/Tatoeba-MT-models/isl-epo/opus-2020-06-16.zip)
* test set translations: [opus-2020-06-16.test.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/isl-epo/opus-2020-06-16.test.txt)
* test set scores: [opus-2020-06-16.eval.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/isl-epo/opus-2020-06-16.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| Tatoeba-test.isl.epo 	| 11.8 	| 0.314 |

### System Info:
- hf_name: isl-epo

- source_languages: isl

- target_languages: epo

- opus_readme_url: https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/isl-epo/README.md

- original_repo: Tatoeba-Challenge

- tags: ['translation']

- languages: ['is', 'eo']

- src_constituents: {'isl'}

- tgt_constituents: {'epo'}

- src_multilingual: False

- tgt_multilingual: False

- prepro:  normalization + SentencePiece (spm4k,spm4k)

- url_model: https://object.pouta.csc.fi/Tatoeba-MT-models/isl-epo/opus-2020-06-16.zip

- url_test_set: https://object.pouta.csc.fi/Tatoeba-MT-models/isl-epo/opus-2020-06-16.test.txt

- src_alpha3: isl

- tgt_alpha3: epo

- short_pair: is-eo

- chrF2_score: 0.314

- bleu: 11.8

- brevity_penalty: 1.0

- ref_len: 1528.0

- src_name: Icelandic

- tgt_name: Esperanto

- train_date: 2020-06-16

- src_alpha2: is

- tgt_alpha2: eo

- prefer_old: False

- long_pair: isl-epo

- helsinki_git_sha: 480fcbe0ee1bf4774bcbe6226ad9f58e63f6c535

- transformers_git_sha: 2207e5d8cb224e954a7cba69fa4ac2309e9ff30b

- port_machine: brutasse

- port_time: 2020-08-21-14:41


---
tags:
- translation
license: apache-2.0
---

### opus-mt-es-csn

* source languages: es
* target languages: csn
*  OPUS readme: [es-csn](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/es-csn/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-16.zip](https://object.pouta.csc.fi/OPUS-MT-models/es-csn/opus-2020-01-16.zip)
* test set translations: [opus-2020-01-16.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/es-csn/opus-2020-01-16.test.txt)
* test set scores: [opus-2020-01-16.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/es-csn/opus-2020-01-16.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| JW300.es.csn 	| 87.8 	| 0.901 |


---
tags:
- translation
license: apache-2.0
---

### opus-mt-yo-en

* source languages: yo
* target languages: en
*  OPUS readme: [yo-en](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/yo-en/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-16.zip](https://object.pouta.csc.fi/OPUS-MT-models/yo-en/opus-2020-01-16.zip)
* test set translations: [opus-2020-01-16.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/yo-en/opus-2020-01-16.test.txt)
* test set scores: [opus-2020-01-16.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/yo-en/opus-2020-01-16.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| JW300.yo.en 	| 33.8 	| 0.496 |


---
tags:
- translation
license: apache-2.0
---

### opus-mt-fi-sg

* source languages: fi
* target languages: sg
*  OPUS readme: [fi-sg](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/fi-sg/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-24.zip](https://object.pouta.csc.fi/OPUS-MT-models/fi-sg/opus-2020-01-24.zip)
* test set translations: [opus-2020-01-24.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/fi-sg/opus-2020-01-24.test.txt)
* test set scores: [opus-2020-01-24.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/fi-sg/opus-2020-01-24.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| JW300.fi.sg 	| 29.3 	| 0.480 |


---
tags:
- translation
license: apache-2.0
---

### opus-mt-sv-es

* source languages: sv
* target languages: es
*  OPUS readme: [sv-es](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/sv-es/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-24.zip](https://object.pouta.csc.fi/OPUS-MT-models/sv-es/opus-2020-01-24.zip)
* test set translations: [opus-2020-01-24.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/sv-es/opus-2020-01-24.test.txt)
* test set scores: [opus-2020-01-24.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/sv-es/opus-2020-01-24.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| Tatoeba.sv.es 	| 52.1 	| 0.683 |


---
tags:
- translation
license: apache-2.0
---

### opus-mt-nl-es

* source languages: nl
* target languages: es
*  OPUS readme: [nl-es](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/nl-es/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-16.zip](https://object.pouta.csc.fi/OPUS-MT-models/nl-es/opus-2020-01-16.zip)
* test set translations: [opus-2020-01-16.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/nl-es/opus-2020-01-16.test.txt)
* test set scores: [opus-2020-01-16.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/nl-es/opus-2020-01-16.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| Tatoeba.nl.es 	| 51.6 	| 0.698 |


---
tags:
- translation
license: apache-2.0
---

### opus-mt-tiv-fr

* source languages: tiv
* target languages: fr
*  OPUS readme: [tiv-fr](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/tiv-fr/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-16.zip](https://object.pouta.csc.fi/OPUS-MT-models/tiv-fr/opus-2020-01-16.zip)
* test set translations: [opus-2020-01-16.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/tiv-fr/opus-2020-01-16.test.txt)
* test set scores: [opus-2020-01-16.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/tiv-fr/opus-2020-01-16.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| JW300.tiv.fr 	| 22.3 	| 0.389 |


---
language:
- pl
- ar

tags:
- translation

license: apache-2.0
---

### pol-ara

* source group: Polish
* target group: Arabic
*  OPUS readme: [pol-ara](https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/pol-ara/README.md)

*  model: transformer
* source language(s): pol
* target language(s): ara arz
* model: transformer
* pre-processing: normalization + SentencePiece (spm32k,spm32k)
* a sentence initial language token is required in the form of `>>id<<` (id = valid target language ID)
* download original weights: [opus-2020-07-03.zip](https://object.pouta.csc.fi/Tatoeba-MT-models/pol-ara/opus-2020-07-03.zip)
* test set translations: [opus-2020-07-03.test.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/pol-ara/opus-2020-07-03.test.txt)
* test set scores: [opus-2020-07-03.eval.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/pol-ara/opus-2020-07-03.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| Tatoeba-test.pol.ara 	| 20.4 	| 0.491 |

### System Info:
- hf_name: pol-ara

- source_languages: pol

- target_languages: ara

- opus_readme_url: https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/pol-ara/README.md

- original_repo: Tatoeba-Challenge

- tags: ['translation']

- languages: ['pl', 'ar']

- src_constituents: {'pol'}

- tgt_constituents: {'apc', 'ara', 'arq_Latn', 'arq', 'afb', 'ara_Latn', 'apc_Latn', 'arz'}

- src_multilingual: False

- tgt_multilingual: False

- prepro:  normalization + SentencePiece (spm32k,spm32k)

- url_model: https://object.pouta.csc.fi/Tatoeba-MT-models/pol-ara/opus-2020-07-03.zip

- url_test_set: https://object.pouta.csc.fi/Tatoeba-MT-models/pol-ara/opus-2020-07-03.test.txt

- src_alpha3: pol

- tgt_alpha3: ara

- short_pair: pl-ar

- chrF2_score: 0.491

- bleu: 20.4

- brevity_penalty: 0.9590000000000001

- ref_len: 1028.0

- src_name: Polish

- tgt_name: Arabic

- train_date: 2020-07-03

- src_alpha2: pl

- tgt_alpha2: ar

- prefer_old: False

- long_pair: pol-ara

- helsinki_git_sha: 480fcbe0ee1bf4774bcbe6226ad9f58e63f6c535

- transformers_git_sha: 2207e5d8cb224e954a7cba69fa4ac2309e9ff30b

- port_machine: brutasse

- port_time: 2020-08-21-14:41


---
tags:
- translation
license: apache-2.0
---

### opus-mt-sg-fi

* source languages: sg
* target languages: fi
*  OPUS readme: [sg-fi](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/sg-fi/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-24.zip](https://object.pouta.csc.fi/OPUS-MT-models/sg-fi/opus-2020-01-24.zip)
* test set translations: [opus-2020-01-24.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/sg-fi/opus-2020-01-24.test.txt)
* test set scores: [opus-2020-01-24.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/sg-fi/opus-2020-01-24.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| JW300.sg.fi 	| 22.7 	| 0.438 |


---
language:
- de
- vi

tags:
- translation

license: apache-2.0
---

### deu-vie

* source group: German
* target group: Vietnamese
*  OPUS readme: [deu-vie](https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/deu-vie/README.md)

*  model: transformer-align
* source language(s): deu
* target language(s): vie
* model: transformer-align
* pre-processing: normalization + SentencePiece (spm32k,spm32k)
* download original weights: [opus-2020-06-17.zip](https://object.pouta.csc.fi/Tatoeba-MT-models/deu-vie/opus-2020-06-17.zip)
* test set translations: [opus-2020-06-17.test.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/deu-vie/opus-2020-06-17.test.txt)
* test set scores: [opus-2020-06-17.eval.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/deu-vie/opus-2020-06-17.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| Tatoeba-test.deu.vie 	| 25.0 	| 0.443 |

### System Info:
- hf_name: deu-vie

- source_languages: deu

- target_languages: vie

- opus_readme_url: https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/deu-vie/README.md

- original_repo: Tatoeba-Challenge

- tags: ['translation']

- languages: ['de', 'vi']

- src_constituents: {'deu'}

- tgt_constituents: {'vie', 'vie_Hani'}

- src_multilingual: False

- tgt_multilingual: False

- prepro:  normalization + SentencePiece (spm32k,spm32k)

- url_model: https://object.pouta.csc.fi/Tatoeba-MT-models/deu-vie/opus-2020-06-17.zip

- url_test_set: https://object.pouta.csc.fi/Tatoeba-MT-models/deu-vie/opus-2020-06-17.test.txt

- src_alpha3: deu

- tgt_alpha3: vie

- short_pair: de-vi

- chrF2_score: 0.44299999999999995

- bleu: 25.0

- brevity_penalty: 1.0

- ref_len: 3768.0

- src_name: German

- tgt_name: Vietnamese

- train_date: 2020-06-17

- src_alpha2: de

- tgt_alpha2: vi

- prefer_old: False

- long_pair: deu-vie

- helsinki_git_sha: 480fcbe0ee1bf4774bcbe6226ad9f58e63f6c535

- transformers_git_sha: 2207e5d8cb224e954a7cba69fa4ac2309e9ff30b

- port_machine: brutasse

- port_time: 2020-08-21-14:41


---
tags:
- translation
license: apache-2.0
---

### opus-mt-en-he

* source languages: en
* target languages: he
*  OPUS readme: [en-he](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/en-he/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2019-12-18.zip](https://object.pouta.csc.fi/OPUS-MT-models/en-he/opus-2019-12-18.zip)
* test set translations: [opus-2019-12-18.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/en-he/opus-2019-12-18.test.txt)
* test set scores: [opus-2019-12-18.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/en-he/opus-2019-12-18.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| Tatoeba.en.he 	| 40.1 	| 0.609 |


---
language:
- bn
- or
- gu
- mr
- ur
- hi
- as
- si
- inc
- en

tags:
- translation

license: apache-2.0
---

### inc-eng

* source group: Indic languages
* target group: English
*  OPUS readme: [inc-eng](https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/inc-eng/README.md)

*  model: transformer
* source language(s): asm awa ben bho gom guj hif_Latn hin mai mar npi ori pan_Guru pnb rom san_Deva sin snd_Arab urd
* target language(s): eng
* model: transformer
* pre-processing: normalization + SentencePiece (spm32k,spm32k)
* download original weights: [opus2m-2020-08-01.zip](https://object.pouta.csc.fi/Tatoeba-MT-models/inc-eng/opus2m-2020-08-01.zip)
* test set translations: [opus2m-2020-08-01.test.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/inc-eng/opus2m-2020-08-01.test.txt)
* test set scores: [opus2m-2020-08-01.eval.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/inc-eng/opus2m-2020-08-01.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| newsdev2014-hineng.hin.eng 	| 8.9 	| 0.341 |
| newsdev2019-engu-gujeng.guj.eng 	| 8.7 	| 0.321 |
| newstest2014-hien-hineng.hin.eng 	| 13.1 	| 0.396 |
| newstest2019-guen-gujeng.guj.eng 	| 6.5 	| 0.290 |
| Tatoeba-test.asm-eng.asm.eng 	| 18.1 	| 0.363 |
| Tatoeba-test.awa-eng.awa.eng 	| 6.2 	| 0.222 |
| Tatoeba-test.ben-eng.ben.eng 	| 44.7 	| 0.595 |
| Tatoeba-test.bho-eng.bho.eng 	| 29.4 	| 0.458 |
| Tatoeba-test.guj-eng.guj.eng 	| 19.3 	| 0.383 |
| Tatoeba-test.hif-eng.hif.eng 	| 3.7 	| 0.220 |
| Tatoeba-test.hin-eng.hin.eng 	| 38.6 	| 0.564 |
| Tatoeba-test.kok-eng.kok.eng 	| 6.6 	| 0.287 |
| Tatoeba-test.lah-eng.lah.eng 	| 16.0 	| 0.272 |
| Tatoeba-test.mai-eng.mai.eng 	| 75.6 	| 0.796 |
| Tatoeba-test.mar-eng.mar.eng 	| 25.9 	| 0.497 |
| Tatoeba-test.multi.eng 	| 29.0 	| 0.502 |
| Tatoeba-test.nep-eng.nep.eng 	| 4.5 	| 0.198 |
| Tatoeba-test.ori-eng.ori.eng 	| 5.0 	| 0.226 |
| Tatoeba-test.pan-eng.pan.eng 	| 17.4 	| 0.375 |
| Tatoeba-test.rom-eng.rom.eng 	| 1.7 	| 0.174 |
| Tatoeba-test.san-eng.san.eng 	| 5.0 	| 0.173 |
| Tatoeba-test.sin-eng.sin.eng 	| 31.2 	| 0.511 |
| Tatoeba-test.snd-eng.snd.eng 	| 45.7 	| 0.670 |
| Tatoeba-test.urd-eng.urd.eng 	| 25.6 	| 0.456 |

### System Info:
- hf_name: inc-eng

- source_languages: inc

- target_languages: eng

- opus_readme_url: https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/inc-eng/README.md

- original_repo: Tatoeba-Challenge

- tags: ['translation']

- languages: ['bn', 'or', 'gu', 'mr', 'ur', 'hi', 'as', 'si', 'inc', 'en']

- src_constituents: {'pnb', 'gom', 'ben', 'hif_Latn', 'ori', 'guj', 'pan_Guru', 'snd_Arab', 'npi', 'mar', 'urd', 'bho', 'hin', 'san_Deva', 'asm', 'rom', 'mai', 'awa', 'sin'}

- tgt_constituents: {'eng'}

- src_multilingual: True

- tgt_multilingual: False

- prepro:  normalization + SentencePiece (spm32k,spm32k)

- url_model: https://object.pouta.csc.fi/Tatoeba-MT-models/inc-eng/opus2m-2020-08-01.zip

- url_test_set: https://object.pouta.csc.fi/Tatoeba-MT-models/inc-eng/opus2m-2020-08-01.test.txt

- src_alpha3: inc

- tgt_alpha3: eng

- short_pair: inc-en

- chrF2_score: 0.502

- bleu: 29.0

- brevity_penalty: 1.0

- ref_len: 64706.0

- src_name: Indic languages

- tgt_name: English

- train_date: 2020-08-01

- src_alpha2: inc

- tgt_alpha2: en

- prefer_old: False

- long_pair: inc-eng

- helsinki_git_sha: 480fcbe0ee1bf4774bcbe6226ad9f58e63f6c535

- transformers_git_sha: 2207e5d8cb224e954a7cba69fa4ac2309e9ff30b

- port_machine: brutasse

- port_time: 2020-08-21-14:41


---
tags:
- translation
license: apache-2.0
---

### opus-mt-nso-en

* source languages: nso
* target languages: en
*  OPUS readme: [nso-en](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/nso-en/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-16.zip](https://object.pouta.csc.fi/OPUS-MT-models/nso-en/opus-2020-01-16.zip)
* test set translations: [opus-2020-01-16.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/nso-en/opus-2020-01-16.test.txt)
* test set scores: [opus-2020-01-16.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/nso-en/opus-2020-01-16.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| JW300.nso.en 	| 48.6 	| 0.634 |


---
language:
- pl
- uk

tags:
- translation

license: apache-2.0
---

### pol-ukr

* source group: Polish
* target group: Ukrainian
*  OPUS readme: [pol-ukr](https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/pol-ukr/README.md)

*  model: transformer-align
* source language(s): pol
* target language(s): ukr
* model: transformer-align
* pre-processing: normalization + SentencePiece (spm32k,spm32k)
* download original weights: [opus-2020-06-17.zip](https://object.pouta.csc.fi/Tatoeba-MT-models/pol-ukr/opus-2020-06-17.zip)
* test set translations: [opus-2020-06-17.test.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/pol-ukr/opus-2020-06-17.test.txt)
* test set scores: [opus-2020-06-17.eval.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/pol-ukr/opus-2020-06-17.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| Tatoeba-test.pol.ukr 	| 47.1 	| 0.665 |

### System Info:
- hf_name: pol-ukr

- source_languages: pol

- target_languages: ukr

- opus_readme_url: https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/pol-ukr/README.md

- original_repo: Tatoeba-Challenge

- tags: ['translation']

- languages: ['pl', 'uk']

- src_constituents: {'pol'}

- tgt_constituents: {'ukr'}

- src_multilingual: False

- tgt_multilingual: False

- prepro:  normalization + SentencePiece (spm32k,spm32k)

- url_model: https://object.pouta.csc.fi/Tatoeba-MT-models/pol-ukr/opus-2020-06-17.zip

- url_test_set: https://object.pouta.csc.fi/Tatoeba-MT-models/pol-ukr/opus-2020-06-17.test.txt

- src_alpha3: pol

- tgt_alpha3: ukr

- short_pair: pl-uk

- chrF2_score: 0.665

- bleu: 47.1

- brevity_penalty: 0.992

- ref_len: 13434.0

- src_name: Polish

- tgt_name: Ukrainian

- train_date: 2020-06-17

- src_alpha2: pl

- tgt_alpha2: uk

- prefer_old: False

- long_pair: pol-ukr

- helsinki_git_sha: 480fcbe0ee1bf4774bcbe6226ad9f58e63f6c535

- transformers_git_sha: 2207e5d8cb224e954a7cba69fa4ac2309e9ff30b

- port_machine: brutasse

- port_time: 2020-08-21-14:41


---
tags:
- translation
license: apache-2.0
---

### opus-mt-fi-tn

* source languages: fi
* target languages: tn
*  OPUS readme: [fi-tn](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/fi-tn/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-08.zip](https://object.pouta.csc.fi/OPUS-MT-models/fi-tn/opus-2020-01-08.zip)
* test set translations: [opus-2020-01-08.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/fi-tn/opus-2020-01-08.test.txt)
* test set scores: [opus-2020-01-08.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/fi-tn/opus-2020-01-08.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| JW300.fi.tn 	| 34.5 	| 0.555 |


---
language:
- bg
- es

tags:
- translation

license: apache-2.0
---

### bul-spa

* source group: Bulgarian
* target group: Spanish
*  OPUS readme: [bul-spa](https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/bul-spa/README.md)

*  model: transformer
* source language(s): bul
* target language(s): spa
* model: transformer
* pre-processing: normalization + SentencePiece (spm32k,spm32k)
* download original weights: [opus-2020-07-03.zip](https://object.pouta.csc.fi/Tatoeba-MT-models/bul-spa/opus-2020-07-03.zip)
* test set translations: [opus-2020-07-03.test.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/bul-spa/opus-2020-07-03.test.txt)
* test set scores: [opus-2020-07-03.eval.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/bul-spa/opus-2020-07-03.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| Tatoeba-test.bul.spa 	| 49.1 	| 0.661 |

### System Info:
- hf_name: bul-spa

- source_languages: bul

- target_languages: spa

- opus_readme_url: https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/bul-spa/README.md

- original_repo: Tatoeba-Challenge

- tags: ['translation']

- languages: ['bg', 'es']

- src_constituents: {'bul', 'bul_Latn'}

- tgt_constituents: {'spa'}

- src_multilingual: False

- tgt_multilingual: False

- prepro:  normalization + SentencePiece (spm32k,spm32k)

- url_model: https://object.pouta.csc.fi/Tatoeba-MT-models/bul-spa/opus-2020-07-03.zip

- url_test_set: https://object.pouta.csc.fi/Tatoeba-MT-models/bul-spa/opus-2020-07-03.test.txt

- src_alpha3: bul

- tgt_alpha3: spa

- short_pair: bg-es

- chrF2_score: 0.6609999999999999

- bleu: 49.1

- brevity_penalty: 0.992

- ref_len: 1783.0

- src_name: Bulgarian

- tgt_name: Spanish

- train_date: 2020-07-03

- src_alpha2: bg

- tgt_alpha2: es

- prefer_old: False

- long_pair: bul-spa

- helsinki_git_sha: 480fcbe0ee1bf4774bcbe6226ad9f58e63f6c535

- transformers_git_sha: 2207e5d8cb224e954a7cba69fa4ac2309e9ff30b

- port_machine: brutasse

- port_time: 2020-08-21-14:41


---
tags:
- translation
license: apache-2.0
---

### opus-mt-en-kg

* source languages: en
* target languages: kg
*  OPUS readme: [en-kg](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/en-kg/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-08.zip](https://object.pouta.csc.fi/OPUS-MT-models/en-kg/opus-2020-01-08.zip)
* test set translations: [opus-2020-01-08.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/en-kg/opus-2020-01-08.test.txt)
* test set scores: [opus-2020-01-08.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/en-kg/opus-2020-01-08.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| JW300.en.kg 	| 39.6 	| 0.613 |


---
language:
- ru
- no

tags:
- translation

license: apache-2.0
---

### rus-nor

* source group: Russian
* target group: Norwegian
*  OPUS readme: [rus-nor](https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/rus-nor/README.md)

*  model: transformer-align
* source language(s): rus
* target language(s): nno nob
* model: transformer-align
* pre-processing: normalization + SentencePiece (spm4k,spm4k)
* a sentence initial language token is required in the form of `>>id<<` (id = valid target language ID)
* download original weights: [opus-2020-06-17.zip](https://object.pouta.csc.fi/Tatoeba-MT-models/rus-nor/opus-2020-06-17.zip)
* test set translations: [opus-2020-06-17.test.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/rus-nor/opus-2020-06-17.test.txt)
* test set scores: [opus-2020-06-17.eval.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/rus-nor/opus-2020-06-17.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| Tatoeba-test.rus.nor 	| 20.3 	| 0.418 |

### System Info:
- hf_name: rus-nor

- source_languages: rus

- target_languages: nor

- opus_readme_url: https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/rus-nor/README.md

- original_repo: Tatoeba-Challenge

- tags: ['translation']

- languages: ['ru', 'no']

- src_constituents: {'rus'}

- tgt_constituents: {'nob', 'nno'}

- src_multilingual: False

- tgt_multilingual: False

- prepro:  normalization + SentencePiece (spm4k,spm4k)

- url_model: https://object.pouta.csc.fi/Tatoeba-MT-models/rus-nor/opus-2020-06-17.zip

- url_test_set: https://object.pouta.csc.fi/Tatoeba-MT-models/rus-nor/opus-2020-06-17.test.txt

- src_alpha3: rus

- tgt_alpha3: nor

- short_pair: ru-no

- chrF2_score: 0.418

- bleu: 20.3

- brevity_penalty: 0.946

- ref_len: 11686.0

- src_name: Russian

- tgt_name: Norwegian

- train_date: 2020-06-17

- src_alpha2: ru

- tgt_alpha2: no

- prefer_old: False

- long_pair: rus-nor

- helsinki_git_sha: 480fcbe0ee1bf4774bcbe6226ad9f58e63f6c535

- transformers_git_sha: 2207e5d8cb224e954a7cba69fa4ac2309e9ff30b

- port_machine: brutasse

- port_time: 2020-08-21-14:41


---
language:
- en
- fj
- mi
- ty
- to
- na
- sm
- mh
- pqe

tags:
- translation

license: apache-2.0
---

### eng-pqe

* source group: English
* target group: Eastern Malayo-Polynesian languages
*  OPUS readme: [eng-pqe](https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/eng-pqe/README.md)

*  model: transformer
* source language(s): eng
* target language(s): fij gil haw lkt mah mri nau niu rap smo tah ton tvl
* model: transformer
* pre-processing: normalization + SentencePiece (spm32k,spm32k)
* a sentence initial language token is required in the form of `>>id<<` (id = valid target language ID)
* download original weights: [opus2m-2020-08-01.zip](https://object.pouta.csc.fi/Tatoeba-MT-models/eng-pqe/opus2m-2020-08-01.zip)
* test set translations: [opus2m-2020-08-01.test.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/eng-pqe/opus2m-2020-08-01.test.txt)
* test set scores: [opus2m-2020-08-01.eval.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/eng-pqe/opus2m-2020-08-01.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| Tatoeba-test.eng-fij.eng.fij 	| 22.1 	| 0.396 |
| Tatoeba-test.eng-gil.eng.gil 	| 41.9 	| 0.673 |
| Tatoeba-test.eng-haw.eng.haw 	| 0.6 	| 0.114 |
| Tatoeba-test.eng-lkt.eng.lkt 	| 0.5 	| 0.075 |
| Tatoeba-test.eng-mah.eng.mah 	| 9.7 	| 0.386 |
| Tatoeba-test.eng-mri.eng.mri 	| 7.7 	| 0.301 |
| Tatoeba-test.eng.multi 	| 11.3 	| 0.306 |
| Tatoeba-test.eng-nau.eng.nau 	| 0.5 	| 0.071 |
| Tatoeba-test.eng-niu.eng.niu 	| 42.5 	| 0.560 |
| Tatoeba-test.eng-rap.eng.rap 	| 3.3 	| 0.122 |
| Tatoeba-test.eng-smo.eng.smo 	| 27.0 	| 0.462 |
| Tatoeba-test.eng-tah.eng.tah 	| 11.3 	| 0.307 |
| Tatoeba-test.eng-ton.eng.ton 	| 27.0 	| 0.528 |
| Tatoeba-test.eng-tvl.eng.tvl 	| 29.3 	| 0.513 |

### System Info:
- hf_name: eng-pqe

- source_languages: eng

- target_languages: pqe

- opus_readme_url: https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/eng-pqe/README.md

- original_repo: Tatoeba-Challenge

- tags: ['translation']

- languages: ['en', 'fj', 'mi', 'ty', 'to', 'na', 'sm', 'mh', 'pqe']

- src_constituents: {'eng'}

- tgt_constituents: {'haw', 'gil', 'rap', 'fij', 'tvl', 'mri', 'tah', 'niu', 'ton', 'nau', 'smo', 'mah'}

- src_multilingual: False

- tgt_multilingual: True

- prepro:  normalization + SentencePiece (spm32k,spm32k)

- url_model: https://object.pouta.csc.fi/Tatoeba-MT-models/eng-pqe/opus2m-2020-08-01.zip

- url_test_set: https://object.pouta.csc.fi/Tatoeba-MT-models/eng-pqe/opus2m-2020-08-01.test.txt

- src_alpha3: eng

- tgt_alpha3: pqe

- short_pair: en-pqe

- chrF2_score: 0.306

- bleu: 11.3

- brevity_penalty: 1.0

- ref_len: 5786.0

- src_name: English

- tgt_name: Eastern Malayo-Polynesian languages

- train_date: 2020-08-01

- src_alpha2: en

- tgt_alpha2: pqe

- prefer_old: False

- long_pair: eng-pqe

- helsinki_git_sha: 480fcbe0ee1bf4774bcbe6226ad9f58e63f6c535

- transformers_git_sha: 2207e5d8cb224e954a7cba69fa4ac2309e9ff30b

- port_machine: brutasse

- port_time: 2020-08-21-14:41


---
language:
- de
- ms

tags:
- translation

license: apache-2.0
---

### deu-msa

* source group: German
* target group: Malay (macrolanguage)
*  OPUS readme: [deu-msa](https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/deu-msa/README.md)

*  model: transformer-align
* source language(s): deu
* target language(s): ind zsm_Latn
* model: transformer-align
* pre-processing: normalization + SentencePiece (spm32k,spm32k)
* a sentence initial language token is required in the form of `>>id<<` (id = valid target language ID)
* download original weights: [opus-2020-06-17.zip](https://object.pouta.csc.fi/Tatoeba-MT-models/deu-msa/opus-2020-06-17.zip)
* test set translations: [opus-2020-06-17.test.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/deu-msa/opus-2020-06-17.test.txt)
* test set scores: [opus-2020-06-17.eval.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/deu-msa/opus-2020-06-17.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| Tatoeba-test.deu.msa 	| 34.0 	| 0.607 |

### System Info:
- hf_name: deu-msa

- source_languages: deu

- target_languages: msa

- opus_readme_url: https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/deu-msa/README.md

- original_repo: Tatoeba-Challenge

- tags: ['translation']

- languages: ['de', 'ms']

- src_constituents: {'deu'}

- tgt_constituents: {'zsm_Latn', 'ind', 'max_Latn', 'zlm_Latn', 'min'}

- src_multilingual: False

- tgt_multilingual: False

- prepro:  normalization + SentencePiece (spm32k,spm32k)

- url_model: https://object.pouta.csc.fi/Tatoeba-MT-models/deu-msa/opus-2020-06-17.zip

- url_test_set: https://object.pouta.csc.fi/Tatoeba-MT-models/deu-msa/opus-2020-06-17.test.txt

- src_alpha3: deu

- tgt_alpha3: msa

- short_pair: de-ms

- chrF2_score: 0.607

- bleu: 34.0

- brevity_penalty: 0.9540000000000001

- ref_len: 3729.0

- src_name: German

- tgt_name: Malay (macrolanguage)

- train_date: 2020-06-17

- src_alpha2: de

- tgt_alpha2: ms

- prefer_old: False

- long_pair: deu-msa

- helsinki_git_sha: 480fcbe0ee1bf4774bcbe6226ad9f58e63f6c535

- transformers_git_sha: 2207e5d8cb224e954a7cba69fa4ac2309e9ff30b

- port_machine: brutasse

- port_time: 2020-08-21-14:41


---
tags:
- translation
license: apache-2.0
---

### opus-mt-de-ase

* source languages: de
* target languages: ase
*  OPUS readme: [de-ase](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/de-ase/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-20.zip](https://object.pouta.csc.fi/OPUS-MT-models/de-ase/opus-2020-01-20.zip)
* test set translations: [opus-2020-01-20.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/de-ase/opus-2020-01-20.test.txt)
* test set scores: [opus-2020-01-20.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/de-ase/opus-2020-01-20.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| JW300.de.ase 	| 30.4 	| 0.483 |


---
tags:
- translation
license: apache-2.0
---

### opus-mt-de-et

* source languages: de
* target languages: et
*  OPUS readme: [de-et](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/de-et/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-20.zip](https://object.pouta.csc.fi/OPUS-MT-models/de-et/opus-2020-01-20.zip)
* test set translations: [opus-2020-01-20.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/de-et/opus-2020-01-20.test.txt)
* test set scores: [opus-2020-01-20.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/de-et/opus-2020-01-20.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| JW300.de.et 	| 20.2 	| 0.465 |


---
tags:
- translation
license: apache-2.0
---

### opus-mt-bi-sv

* source languages: bi
* target languages: sv
*  OPUS readme: [bi-sv](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/bi-sv/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-20.zip](https://object.pouta.csc.fi/OPUS-MT-models/bi-sv/opus-2020-01-20.zip)
* test set translations: [opus-2020-01-20.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/bi-sv/opus-2020-01-20.test.txt)
* test set scores: [opus-2020-01-20.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/bi-sv/opus-2020-01-20.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| JW300.bi.sv 	| 22.7 	| 0.403 |


---
language:
- fr
- tl

tags:
- translation

license: apache-2.0
---

### fra-tgl

* source group: French
* target group: Tagalog
*  OPUS readme: [fra-tgl](https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/fra-tgl/README.md)

*  model: transformer-align
* source language(s): fra
* target language(s): tgl_Latn
* model: transformer-align
* pre-processing: normalization + SentencePiece (spm32k,spm32k)
* download original weights: [opus-2020-06-17.zip](https://object.pouta.csc.fi/Tatoeba-MT-models/fra-tgl/opus-2020-06-17.zip)
* test set translations: [opus-2020-06-17.test.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/fra-tgl/opus-2020-06-17.test.txt)
* test set scores: [opus-2020-06-17.eval.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/fra-tgl/opus-2020-06-17.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| Tatoeba-test.fra.tgl 	| 24.1 	| 0.536 |

### System Info:
- hf_name: fra-tgl

- source_languages: fra

- target_languages: tgl

- opus_readme_url: https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/fra-tgl/README.md

- original_repo: Tatoeba-Challenge

- tags: ['translation']

- languages: ['fr', 'tl']

- src_constituents: {'fra'}

- tgt_constituents: {'tgl_Latn'}

- src_multilingual: False

- tgt_multilingual: False

- prepro:  normalization + SentencePiece (spm32k,spm32k)

- url_model: https://object.pouta.csc.fi/Tatoeba-MT-models/fra-tgl/opus-2020-06-17.zip

- url_test_set: https://object.pouta.csc.fi/Tatoeba-MT-models/fra-tgl/opus-2020-06-17.test.txt

- src_alpha3: fra

- tgt_alpha3: tgl

- short_pair: fr-tl

- chrF2_score: 0.536

- bleu: 24.1

- brevity_penalty: 1.0

- ref_len: 5778.0

- src_name: French

- tgt_name: Tagalog

- train_date: 2020-06-17

- src_alpha2: fr

- tgt_alpha2: tl

- prefer_old: False

- long_pair: fra-tgl

- helsinki_git_sha: 480fcbe0ee1bf4774bcbe6226ad9f58e63f6c535

- transformers_git_sha: 2207e5d8cb224e954a7cba69fa4ac2309e9ff30b

- port_machine: brutasse

- port_time: 2020-08-21-14:41