--- language: gmw tags: - translation license: apache-2.0 --- ### gmw-gmw * source group: West Germanic languages * target group: West Germanic languages * OPUS readme: [gmw-gmw](https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/gmw-gmw/README.md) * model: transformer * source language(s): afr ang_Latn deu eng enm_Latn frr fry gos gsw ksh ltz nds nld pdc sco stq swg yid * target language(s): afr ang_Latn deu eng enm_Latn frr fry gos gsw ksh ltz nds nld pdc sco stq swg yid * model: transformer * pre-processing: normalization + SentencePiece (spm32k,spm32k) * a sentence initial language token is required in the form of `>>id<<` (id = valid target language ID) * download original weights: [opus-2020-07-27.zip](https://object.pouta.csc.fi/Tatoeba-MT-models/gmw-gmw/opus-2020-07-27.zip) * test set translations: [opus-2020-07-27.test.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/gmw-gmw/opus-2020-07-27.test.txt) * test set scores: [opus-2020-07-27.eval.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/gmw-gmw/opus-2020-07-27.eval.txt) ## Benchmarks | testset | BLEU | chr-F | |-----------------------|-------|-------| | newssyscomb2009-deueng.deu.eng | 25.3 | 0.527 | | newssyscomb2009-engdeu.eng.deu | 19.0 | 0.502 | | news-test2008-deueng.deu.eng | 23.7 | 0.515 | | news-test2008-engdeu.eng.deu | 19.2 | 0.491 | | newstest2009-deueng.deu.eng | 23.1 | 0.514 | | newstest2009-engdeu.eng.deu | 18.6 | 0.495 | | newstest2010-deueng.deu.eng | 25.8 | 0.545 | | newstest2010-engdeu.eng.deu | 20.3 | 0.505 | | newstest2011-deueng.deu.eng | 23.7 | 0.523 | | newstest2011-engdeu.eng.deu | 18.9 | 0.490 | | newstest2012-deueng.deu.eng | 24.4 | 0.529 | | newstest2012-engdeu.eng.deu | 19.2 | 0.489 | | newstest2013-deueng.deu.eng | 27.2 | 0.545 | | newstest2013-engdeu.eng.deu | 22.4 | 0.514 | | newstest2014-deen-deueng.deu.eng | 27.0 | 0.546 | | newstest2015-ende-deueng.deu.eng | 28.4 | 0.552 | | newstest2015-ende-engdeu.eng.deu | 25.3 | 0.541 | | newstest2016-ende-deueng.deu.eng | 33.2 | 0.595 | | newstest2016-ende-engdeu.eng.deu | 29.8 | 0.578 | | newstest2017-ende-deueng.deu.eng | 29.0 | 0.557 | | newstest2017-ende-engdeu.eng.deu | 23.9 | 0.534 | | newstest2018-ende-deueng.deu.eng | 35.9 | 0.607 | | newstest2018-ende-engdeu.eng.deu | 34.8 | 0.609 | | newstest2019-deen-deueng.deu.eng | 32.1 | 0.579 | | newstest2019-ende-engdeu.eng.deu | 31.0 | 0.579 | | Tatoeba-test.afr-ang.afr.ang | 0.0 | 0.065 | | Tatoeba-test.afr-deu.afr.deu | 46.8 | 0.668 | | Tatoeba-test.afr-eng.afr.eng | 58.5 | 0.728 | | Tatoeba-test.afr-enm.afr.enm | 13.4 | 0.357 | | Tatoeba-test.afr-fry.afr.fry | 5.3 | 0.026 | | Tatoeba-test.afr-gos.afr.gos | 3.5 | 0.228 | | Tatoeba-test.afr-ltz.afr.ltz | 1.6 | 0.131 | | Tatoeba-test.afr-nld.afr.nld | 55.4 | 0.715 | | Tatoeba-test.afr-yid.afr.yid | 3.4 | 0.008 | | Tatoeba-test.ang-afr.ang.afr | 3.1 | 0.096 | | Tatoeba-test.ang-deu.ang.deu | 2.6 | 0.188 | | Tatoeba-test.ang-eng.ang.eng | 5.4 | 0.211 | | Tatoeba-test.ang-enm.ang.enm | 1.7 | 0.197 | | Tatoeba-test.ang-gos.ang.gos | 6.6 | 0.186 | | Tatoeba-test.ang-ltz.ang.ltz | 5.3 | 0.072 | | Tatoeba-test.ang-yid.ang.yid | 0.9 | 0.131 | | Tatoeba-test.deu-afr.deu.afr | 52.7 | 0.699 | | Tatoeba-test.deu-ang.deu.ang | 0.8 | 0.133 | | Tatoeba-test.deu-eng.deu.eng | 43.5 | 0.621 | | Tatoeba-test.deu-enm.deu.enm | 6.9 | 0.245 | | Tatoeba-test.deu-frr.deu.frr | 0.8 | 0.200 | | Tatoeba-test.deu-fry.deu.fry | 15.1 | 0.367 | | Tatoeba-test.deu-gos.deu.gos | 2.2 | 0.279 | | Tatoeba-test.deu-gsw.deu.gsw | 1.0 | 0.176 | | Tatoeba-test.deu-ksh.deu.ksh | 0.6 | 0.208 | | Tatoeba-test.deu-ltz.deu.ltz | 12.1 | 0.274 | | Tatoeba-test.deu-nds.deu.nds | 18.8 | 0.446 | | Tatoeba-test.deu-nld.deu.nld | 48.6 | 0.669 | | Tatoeba-test.deu-pdc.deu.pdc | 4.6 | 0.198 | | Tatoeba-test.deu-sco.deu.sco | 12.0 | 0.340 | | Tatoeba-test.deu-stq.deu.stq | 3.2 | 0.240 | | Tatoeba-test.deu-swg.deu.swg | 0.5 | 0.179 | | Tatoeba-test.deu-yid.deu.yid | 1.7 | 0.160 | | Tatoeba-test.eng-afr.eng.afr | 55.8 | 0.730 | | Tatoeba-test.eng-ang.eng.ang | 5.7 | 0.157 | | Tatoeba-test.eng-deu.eng.deu | 36.7 | 0.584 | | Tatoeba-test.eng-enm.eng.enm | 2.0 | 0.272 | | Tatoeba-test.eng-frr.eng.frr | 6.1 | 0.246 | | Tatoeba-test.eng-fry.eng.fry | 15.3 | 0.378 | | Tatoeba-test.eng-gos.eng.gos | 1.2 | 0.242 | | Tatoeba-test.eng-gsw.eng.gsw | 0.9 | 0.164 | | Tatoeba-test.eng-ksh.eng.ksh | 0.9 | 0.170 | | Tatoeba-test.eng-ltz.eng.ltz | 13.7 | 0.263 | | Tatoeba-test.eng-nds.eng.nds | 17.1 | 0.410 | | Tatoeba-test.eng-nld.eng.nld | 49.6 | 0.673 | | Tatoeba-test.eng-pdc.eng.pdc | 5.1 | 0.218 | | Tatoeba-test.eng-sco.eng.sco | 34.8 | 0.587 | | Tatoeba-test.eng-stq.eng.stq | 2.1 | 0.322 | | Tatoeba-test.eng-swg.eng.swg | 1.7 | 0.192 | | Tatoeba-test.eng-yid.eng.yid | 1.7 | 0.173 | | Tatoeba-test.enm-afr.enm.afr | 13.4 | 0.397 | | Tatoeba-test.enm-ang.enm.ang | 0.7 | 0.063 | | Tatoeba-test.enm-deu.enm.deu | 41.5 | 0.514 | | Tatoeba-test.enm-eng.enm.eng | 21.3 | 0.483 | | Tatoeba-test.enm-fry.enm.fry | 0.0 | 0.058 | | Tatoeba-test.enm-gos.enm.gos | 10.7 | 0.354 | | Tatoeba-test.enm-ksh.enm.ksh | 7.0 | 0.161 | | Tatoeba-test.enm-nds.enm.nds | 18.6 | 0.316 | | Tatoeba-test.enm-nld.enm.nld | 38.3 | 0.524 | | Tatoeba-test.enm-yid.enm.yid | 0.7 | 0.128 | | Tatoeba-test.frr-deu.frr.deu | 4.1 | 0.219 | | Tatoeba-test.frr-eng.frr.eng | 14.1 | 0.186 | | Tatoeba-test.frr-fry.frr.fry | 3.1 | 0.129 | | Tatoeba-test.frr-gos.frr.gos | 3.6 | 0.226 | | Tatoeba-test.frr-nds.frr.nds | 12.4 | 0.145 | | Tatoeba-test.frr-nld.frr.nld | 9.8 | 0.209 | | Tatoeba-test.frr-stq.frr.stq | 2.8 | 0.142 | | Tatoeba-test.fry-afr.fry.afr | 0.0 | 1.000 | | Tatoeba-test.fry-deu.fry.deu | 30.1 | 0.535 | | Tatoeba-test.fry-eng.fry.eng | 28.0 | 0.486 | | Tatoeba-test.fry-enm.fry.enm | 16.0 | 0.262 | | Tatoeba-test.fry-frr.fry.frr | 5.5 | 0.160 | | Tatoeba-test.fry-gos.fry.gos | 1.6 | 0.307 | | Tatoeba-test.fry-ltz.fry.ltz | 30.4 | 0.438 | | Tatoeba-test.fry-nds.fry.nds | 8.1 | 0.083 | | Tatoeba-test.fry-nld.fry.nld | 41.4 | 0.616 | | Tatoeba-test.fry-stq.fry.stq | 1.6 | 0.217 | | Tatoeba-test.fry-yid.fry.yid | 1.6 | 0.159 | | Tatoeba-test.gos-afr.gos.afr | 6.3 | 0.318 | | Tatoeba-test.gos-ang.gos.ang | 6.2 | 0.058 | | Tatoeba-test.gos-deu.gos.deu | 11.7 | 0.363 | | Tatoeba-test.gos-eng.gos.eng | 14.9 | 0.322 | | Tatoeba-test.gos-enm.gos.enm | 9.1 | 0.398 | | Tatoeba-test.gos-frr.gos.frr | 3.3 | 0.117 | | Tatoeba-test.gos-fry.gos.fry | 13.1 | 0.387 | | Tatoeba-test.gos-ltz.gos.ltz | 3.1 | 0.154 | | Tatoeba-test.gos-nds.gos.nds | 2.4 | 0.206 | | Tatoeba-test.gos-nld.gos.nld | 13.9 | 0.395 | | Tatoeba-test.gos-stq.gos.stq | 2.1 | 0.209 | | Tatoeba-test.gos-yid.gos.yid | 1.7 | 0.147 | | Tatoeba-test.gsw-deu.gsw.deu | 10.5 | 0.350 | | Tatoeba-test.gsw-eng.gsw.eng | 10.7 | 0.299 | | Tatoeba-test.ksh-deu.ksh.deu | 12.0 | 0.373 | | Tatoeba-test.ksh-eng.ksh.eng | 3.2 | 0.225 | | Tatoeba-test.ksh-enm.ksh.enm | 13.4 | 0.308 | | Tatoeba-test.ltz-afr.ltz.afr | 37.4 | 0.525 | | Tatoeba-test.ltz-ang.ltz.ang | 2.8 | 0.036 | | Tatoeba-test.ltz-deu.ltz.deu | 40.3 | 0.596 | | Tatoeba-test.ltz-eng.ltz.eng | 31.7 | 0.490 | | Tatoeba-test.ltz-fry.ltz.fry | 36.3 | 0.658 | | Tatoeba-test.ltz-gos.ltz.gos | 2.9 | 0.209 | | Tatoeba-test.ltz-nld.ltz.nld | 38.8 | 0.530 | | Tatoeba-test.ltz-stq.ltz.stq | 5.8 | 0.165 | | Tatoeba-test.ltz-yid.ltz.yid | 1.0 | 0.159 | | Tatoeba-test.multi.multi | 36.4 | 0.568 | | Tatoeba-test.nds-deu.nds.deu | 35.0 | 0.573 | | Tatoeba-test.nds-eng.nds.eng | 29.6 | 0.495 | | Tatoeba-test.nds-enm.nds.enm | 3.7 | 0.194 | | Tatoeba-test.nds-frr.nds.frr | 6.6 | 0.133 | | Tatoeba-test.nds-fry.nds.fry | 4.2 | 0.087 | | Tatoeba-test.nds-gos.nds.gos | 2.0 | 0.243 | | Tatoeba-test.nds-nld.nds.nld | 41.4 | 0.618 | | Tatoeba-test.nds-swg.nds.swg | 0.6 | 0.178 | | Tatoeba-test.nds-yid.nds.yid | 8.3 | 0.238 | | Tatoeba-test.nld-afr.nld.afr | 59.4 | 0.759 | | Tatoeba-test.nld-deu.nld.deu | 49.9 | 0.685 | | Tatoeba-test.nld-eng.nld.eng | 54.1 | 0.699 | | Tatoeba-test.nld-enm.nld.enm | 5.0 | 0.250 | | Tatoeba-test.nld-frr.nld.frr | 2.4 | 0.224 | | Tatoeba-test.nld-fry.nld.fry | 19.4 | 0.446 | | Tatoeba-test.nld-gos.nld.gos | 2.5 | 0.273 | | Tatoeba-test.nld-ltz.nld.ltz | 13.8 | 0.292 | | Tatoeba-test.nld-nds.nld.nds | 21.3 | 0.457 | | Tatoeba-test.nld-sco.nld.sco | 14.7 | 0.423 | | Tatoeba-test.nld-stq.nld.stq | 1.9 | 0.257 | | Tatoeba-test.nld-swg.nld.swg | 4.2 | 0.162 | | Tatoeba-test.nld-yid.nld.yid | 2.6 | 0.186 | | Tatoeba-test.pdc-deu.pdc.deu | 39.7 | 0.529 | | Tatoeba-test.pdc-eng.pdc.eng | 25.0 | 0.427 | | Tatoeba-test.sco-deu.sco.deu | 28.4 | 0.428 | | Tatoeba-test.sco-eng.sco.eng | 41.8 | 0.595 | | Tatoeba-test.sco-nld.sco.nld | 36.4 | 0.565 | | Tatoeba-test.stq-deu.stq.deu | 7.7 | 0.328 | | Tatoeba-test.stq-eng.stq.eng | 21.1 | 0.428 | | Tatoeba-test.stq-frr.stq.frr | 2.0 | 0.118 | | Tatoeba-test.stq-fry.stq.fry | 6.3 | 0.255 | | Tatoeba-test.stq-gos.stq.gos | 1.4 | 0.244 | | Tatoeba-test.stq-ltz.stq.ltz | 4.4 | 0.204 | | Tatoeba-test.stq-nld.stq.nld | 10.7 | 0.371 | | Tatoeba-test.stq-yid.stq.yid | 1.4 | 0.105 | | Tatoeba-test.swg-deu.swg.deu | 9.5 | 0.343 | | Tatoeba-test.swg-eng.swg.eng | 15.1 | 0.306 | | Tatoeba-test.swg-nds.swg.nds | 0.7 | 0.196 | | Tatoeba-test.swg-nld.swg.nld | 11.6 | 0.308 | | Tatoeba-test.swg-yid.swg.yid | 0.9 | 0.186 | | Tatoeba-test.yid-afr.yid.afr | 100.0 | 1.000 | | Tatoeba-test.yid-ang.yid.ang | 0.6 | 0.079 | | Tatoeba-test.yid-deu.yid.deu | 16.7 | 0.372 | | Tatoeba-test.yid-eng.yid.eng | 15.8 | 0.344 | | Tatoeba-test.yid-enm.yid.enm | 1.3 | 0.166 | | Tatoeba-test.yid-fry.yid.fry | 5.6 | 0.157 | | Tatoeba-test.yid-gos.yid.gos | 2.2 | 0.160 | | Tatoeba-test.yid-ltz.yid.ltz | 2.1 | 0.238 | | Tatoeba-test.yid-nds.yid.nds | 14.4 | 0.365 | | Tatoeba-test.yid-nld.yid.nld | 20.9 | 0.397 | | Tatoeba-test.yid-stq.yid.stq | 3.7 | 0.165 | | Tatoeba-test.yid-swg.yid.swg | 1.8 | 0.156 | ### System Info: - hf_name: gmw-gmw - source_languages: gmw - target_languages: gmw - opus_readme_url: https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/gmw-gmw/README.md - original_repo: Tatoeba-Challenge - tags: ['translation'] - prepro: normalization + SentencePiece (spm32k,spm32k) - url_model: https://object.pouta.csc.fi/Tatoeba-MT-models/gmw-gmw/opus-2020-07-27.zip - url_test_set: https://object.pouta.csc.fi/Tatoeba-MT-models/gmw-gmw/opus-2020-07-27.test.txt - src_alpha3: gmw - tgt_alpha3: gmw - short_pair: gmw-gmw - chrF2_score: 0.568 - bleu: 36.4 - brevity_penalty: 1.0 - ref_len: 72534.0 - src_name: West Germanic languages - tgt_name: West Germanic languages - train_date: 2020-07-27 - src_alpha2: gmw - tgt_alpha2: gmw - prefer_old: False - long_pair: gmw-gmw - helsinki_git_sha: 480fcbe0ee1bf4774bcbe6226ad9f58e63f6c535 - transformers_git_sha: 46e9f53347bbe9e989f0335f98465f30886d8173 - port_machine: brutasse - port_time: 2020-08-18-01:48