Hugging Face's logo

Helsinki-NLP
/
opus-mt-gmw-gmw

Translation
Transformers
PyTorch
TensorFlow
8 languages
marian
text2text-generation
Inference Endpoints
Model card Files Community
2
Edit model card

gmw-gmw

  • source group: West Germanic languages

  • target group: West Germanic languages

  • OPUS readme: gmw-gmw

  • model: transformer

  • source language(s): afr ang_Latn deu eng enm_Latn frr fry gos gsw ksh ltz nds nld pdc sco stq swg yid

  • target language(s): afr ang_Latn deu eng enm_Latn frr fry gos gsw ksh ltz nds nld pdc sco stq swg yid

  • model: transformer

  • pre-processing: normalization + SentencePiece (spm32k,spm32k)

  • a sentence initial language token is required in the form of >>id<< (id = valid target language ID)

  • download original weights: opus-2020-07-27.zip

  • test set translations: opus-2020-07-27.test.txt

  • test set scores: opus-2020-07-27.eval.txt

Benchmarks

testset BLEU chr-F
newssyscomb2009-deueng.deu.eng 25.3 0.527
newssyscomb2009-engdeu.eng.deu 19.0 0.502
news-test2008-deueng.deu.eng 23.7 0.515
news-test2008-engdeu.eng.deu 19.2 0.491
newstest2009-deueng.deu.eng 23.1 0.514
newstest2009-engdeu.eng.deu 18.6 0.495
newstest2010-deueng.deu.eng 25.8 0.545
newstest2010-engdeu.eng.deu 20.3 0.505
newstest2011-deueng.deu.eng 23.7 0.523
newstest2011-engdeu.eng.deu 18.9 0.490
newstest2012-deueng.deu.eng 24.4 0.529
newstest2012-engdeu.eng.deu 19.2 0.489
newstest2013-deueng.deu.eng 27.2 0.545
newstest2013-engdeu.eng.deu 22.4 0.514
newstest2014-deen-deueng.deu.eng 27.0 0.546
newstest2015-ende-deueng.deu.eng 28.4 0.552
newstest2015-ende-engdeu.eng.deu 25.3 0.541
newstest2016-ende-deueng.deu.eng 33.2 0.595
newstest2016-ende-engdeu.eng.deu 29.8 0.578
newstest2017-ende-deueng.deu.eng 29.0 0.557
newstest2017-ende-engdeu.eng.deu 23.9 0.534
newstest2018-ende-deueng.deu.eng 35.9 0.607
newstest2018-ende-engdeu.eng.deu 34.8 0.609
newstest2019-deen-deueng.deu.eng 32.1 0.579
newstest2019-ende-engdeu.eng.deu 31.0 0.579
Tatoeba-test.afr-ang.afr.ang 0.0 0.065
Tatoeba-test.afr-deu.afr.deu 46.8 0.668
Tatoeba-test.afr-eng.afr.eng 58.5 0.728
Tatoeba-test.afr-enm.afr.enm 13.4 0.357
Tatoeba-test.afr-fry.afr.fry 5.3 0.026
Tatoeba-test.afr-gos.afr.gos 3.5 0.228
Tatoeba-test.afr-ltz.afr.ltz 1.6 0.131
Tatoeba-test.afr-nld.afr.nld 55.4 0.715
Tatoeba-test.afr-yid.afr.yid 3.4 0.008
Tatoeba-test.ang-afr.ang.afr 3.1 0.096
Tatoeba-test.ang-deu.ang.deu 2.6 0.188
Tatoeba-test.ang-eng.ang.eng 5.4 0.211
Tatoeba-test.ang-enm.ang.enm 1.7 0.197
Tatoeba-test.ang-gos.ang.gos 6.6 0.186
Tatoeba-test.ang-ltz.ang.ltz 5.3 0.072
Tatoeba-test.ang-yid.ang.yid 0.9 0.131
Tatoeba-test.deu-afr.deu.afr 52.7 0.699
Tatoeba-test.deu-ang.deu.ang 0.8 0.133
Tatoeba-test.deu-eng.deu.eng 43.5 0.621
Tatoeba-test.deu-enm.deu.enm 6.9 0.245
Tatoeba-test.deu-frr.deu.frr 0.8 0.200
Tatoeba-test.deu-fry.deu.fry 15.1 0.367
Tatoeba-test.deu-gos.deu.gos 2.2 0.279
Tatoeba-test.deu-gsw.deu.gsw 1.0 0.176
Tatoeba-test.deu-ksh.deu.ksh 0.6 0.208
Tatoeba-test.deu-ltz.deu.ltz 12.1 0.274
Tatoeba-test.deu-nds.deu.nds 18.8 0.446
Tatoeba-test.deu-nld.deu.nld 48.6 0.669
Tatoeba-test.deu-pdc.deu.pdc 4.6 0.198
Tatoeba-test.deu-sco.deu.sco 12.0 0.340
Tatoeba-test.deu-stq.deu.stq 3.2 0.240
Tatoeba-test.deu-swg.deu.swg 0.5 0.179
Tatoeba-test.deu-yid.deu.yid 1.7 0.160
Tatoeba-test.eng-afr.eng.afr 55.8 0.730
Tatoeba-test.eng-ang.eng.ang 5.7 0.157
Tatoeba-test.eng-deu.eng.deu 36.7 0.584
Tatoeba-test.eng-enm.eng.enm 2.0 0.272
Tatoeba-test.eng-frr.eng.frr 6.1 0.246
Tatoeba-test.eng-fry.eng.fry 15.3 0.378
Tatoeba-test.eng-gos.eng.gos 1.2 0.242
Tatoeba-test.eng-gsw.eng.gsw 0.9 0.164
Tatoeba-test.eng-ksh.eng.ksh 0.9 0.170
Tatoeba-test.eng-ltz.eng.ltz 13.7 0.263
Tatoeba-test.eng-nds.eng.nds 17.1 0.410
Tatoeba-test.eng-nld.eng.nld 49.6 0.673
Tatoeba-test.eng-pdc.eng.pdc 5.1 0.218
Tatoeba-test.eng-sco.eng.sco 34.8 0.587
Tatoeba-test.eng-stq.eng.stq 2.1 0.322
Tatoeba-test.eng-swg.eng.swg 1.7 0.192
Tatoeba-test.eng-yid.eng.yid 1.7 0.173
Tatoeba-test.enm-afr.enm.afr 13.4 0.397
Tatoeba-test.enm-ang.enm.ang 0.7 0.063
Tatoeba-test.enm-deu.enm.deu 41.5 0.514
Tatoeba-test.enm-eng.enm.eng 21.3 0.483
Tatoeba-test.enm-fry.enm.fry 0.0 0.058
Tatoeba-test.enm-gos.enm.gos 10.7 0.354
Tatoeba-test.enm-ksh.enm.ksh 7.0 0.161
Tatoeba-test.enm-nds.enm.nds 18.6 0.316
Tatoeba-test.enm-nld.enm.nld 38.3 0.524
Tatoeba-test.enm-yid.enm.yid 0.7 0.128
Tatoeba-test.frr-deu.frr.deu 4.1 0.219
Tatoeba-test.frr-eng.frr.eng 14.1 0.186
Tatoeba-test.frr-fry.frr.fry 3.1 0.129
Tatoeba-test.frr-gos.frr.gos 3.6 0.226
Tatoeba-test.frr-nds.frr.nds 12.4 0.145
Tatoeba-test.frr-nld.frr.nld 9.8 0.209
Tatoeba-test.frr-stq.frr.stq 2.8 0.142
Tatoeba-test.fry-afr.fry.afr 0.0 1.000
Tatoeba-test.fry-deu.fry.deu 30.1 0.535
Tatoeba-test.fry-eng.fry.eng 28.0 0.486
Tatoeba-test.fry-enm.fry.enm 16.0 0.262
Tatoeba-test.fry-frr.fry.frr 5.5 0.160
Tatoeba-test.fry-gos.fry.gos 1.6 0.307
Tatoeba-test.fry-ltz.fry.ltz 30.4 0.438
Tatoeba-test.fry-nds.fry.nds 8.1 0.083
Tatoeba-test.fry-nld.fry.nld 41.4 0.616
Tatoeba-test.fry-stq.fry.stq 1.6 0.217
Tatoeba-test.fry-yid.fry.yid 1.6 0.159
Tatoeba-test.gos-afr.gos.afr 6.3 0.318
Tatoeba-test.gos-ang.gos.ang 6.2 0.058
Tatoeba-test.gos-deu.gos.deu 11.7 0.363
Tatoeba-test.gos-eng.gos.eng 14.9 0.322
Tatoeba-test.gos-enm.gos.enm 9.1 0.398
Tatoeba-test.gos-frr.gos.frr 3.3 0.117
Tatoeba-test.gos-fry.gos.fry 13.1 0.387
Tatoeba-test.gos-ltz.gos.ltz 3.1 0.154
Tatoeba-test.gos-nds.gos.nds 2.4 0.206
Tatoeba-test.gos-nld.gos.nld 13.9 0.395
Tatoeba-test.gos-stq.gos.stq 2.1 0.209
Tatoeba-test.gos-yid.gos.yid 1.7 0.147
Tatoeba-test.gsw-deu.gsw.deu 10.5 0.350
Tatoeba-test.gsw-eng.gsw.eng 10.7 0.299
Tatoeba-test.ksh-deu.ksh.deu 12.0 0.373
Tatoeba-test.ksh-eng.ksh.eng 3.2 0.225
Tatoeba-test.ksh-enm.ksh.enm 13.4 0.308
Tatoeba-test.ltz-afr.ltz.afr 37.4 0.525
Tatoeba-test.ltz-ang.ltz.ang 2.8 0.036
Tatoeba-test.ltz-deu.ltz.deu 40.3 0.596
Tatoeba-test.ltz-eng.ltz.eng 31.7 0.490
Tatoeba-test.ltz-fry.ltz.fry 36.3 0.658
Tatoeba-test.ltz-gos.ltz.gos 2.9 0.209
Tatoeba-test.ltz-nld.ltz.nld 38.8 0.530
Tatoeba-test.ltz-stq.ltz.stq 5.8 0.165
Tatoeba-test.ltz-yid.ltz.yid 1.0 0.159
Tatoeba-test.multi.multi 36.4 0.568
Tatoeba-test.nds-deu.nds.deu 35.0 0.573
Tatoeba-test.nds-eng.nds.eng 29.6 0.495
Tatoeba-test.nds-enm.nds.enm 3.7 0.194
Tatoeba-test.nds-frr.nds.frr 6.6 0.133
Tatoeba-test.nds-fry.nds.fry 4.2 0.087
Tatoeba-test.nds-gos.nds.gos 2.0 0.243
Tatoeba-test.nds-nld.nds.nld 41.4 0.618
Tatoeba-test.nds-swg.nds.swg 0.6 0.178
Tatoeba-test.nds-yid.nds.yid 8.3 0.238
Tatoeba-test.nld-afr.nld.afr 59.4 0.759
Tatoeba-test.nld-deu.nld.deu 49.9 0.685
Tatoeba-test.nld-eng.nld.eng 54.1 0.699
Tatoeba-test.nld-enm.nld.enm 5.0 0.250
Tatoeba-test.nld-frr.nld.frr 2.4 0.224
Tatoeba-test.nld-fry.nld.fry 19.4 0.446
Tatoeba-test.nld-gos.nld.gos 2.5 0.273
Tatoeba-test.nld-ltz.nld.ltz 13.8 0.292
Tatoeba-test.nld-nds.nld.nds 21.3 0.457
Tatoeba-test.nld-sco.nld.sco 14.7 0.423
Tatoeba-test.nld-stq.nld.stq 1.9 0.257
Tatoeba-test.nld-swg.nld.swg 4.2 0.162
Tatoeba-test.nld-yid.nld.yid 2.6 0.186
Tatoeba-test.pdc-deu.pdc.deu 39.7 0.529
Tatoeba-test.pdc-eng.pdc.eng 25.0 0.427
Tatoeba-test.sco-deu.sco.deu 28.4 0.428
Tatoeba-test.sco-eng.sco.eng 41.8 0.595
Tatoeba-test.sco-nld.sco.nld 36.4 0.565
Tatoeba-test.stq-deu.stq.deu 7.7 0.328
Tatoeba-test.stq-eng.stq.eng 21.1 0.428
Tatoeba-test.stq-frr.stq.frr 2.0 0.118
Tatoeba-test.stq-fry.stq.fry 6.3 0.255
Tatoeba-test.stq-gos.stq.gos 1.4 0.244
Tatoeba-test.stq-ltz.stq.ltz 4.4 0.204
Tatoeba-test.stq-nld.stq.nld 10.7 0.371
Tatoeba-test.stq-yid.stq.yid 1.4 0.105
Tatoeba-test.swg-deu.swg.deu 9.5 0.343
Tatoeba-test.swg-eng.swg.eng 15.1 0.306
Tatoeba-test.swg-nds.swg.nds 0.7 0.196
Tatoeba-test.swg-nld.swg.nld 11.6 0.308
Tatoeba-test.swg-yid.swg.yid 0.9 0.186
Tatoeba-test.yid-afr.yid.afr 100.0 1.000
Tatoeba-test.yid-ang.yid.ang 0.6 0.079
Tatoeba-test.yid-deu.yid.deu 16.7 0.372
Tatoeba-test.yid-eng.yid.eng 15.8 0.344
Tatoeba-test.yid-enm.yid.enm 1.3 0.166
Tatoeba-test.yid-fry.yid.fry 5.6 0.157
Tatoeba-test.yid-gos.yid.gos 2.2 0.160
Tatoeba-test.yid-ltz.yid.ltz 2.1 0.238
Tatoeba-test.yid-nds.yid.nds 14.4 0.365
Tatoeba-test.yid-nld.yid.nld 20.9 0.397
Tatoeba-test.yid-stq.yid.stq 3.7 0.165
Tatoeba-test.yid-swg.yid.swg 1.8 0.156

System Info:

  • hf_name: gmw-gmw

  • source_languages: gmw

  • target_languages: gmw

  • opus_readme_url: https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/gmw-gmw/README.md

  • original_repo: Tatoeba-Challenge

  • tags: ['translation']

  • languages: ['nl', 'en', 'lb', 'af', 'de', 'fy', 'yi', 'gmw']

  • src_constituents: {'ksh', 'nld', 'eng', 'enm_Latn', 'ltz', 'stq', 'afr', 'pdc', 'deu', 'gos', 'ang_Latn', 'fry', 'gsw', 'frr', 'nds', 'yid', 'swg', 'sco'}

  • tgt_constituents: {'ksh', 'nld', 'eng', 'enm_Latn', 'ltz', 'stq', 'afr', 'pdc', 'deu', 'gos', 'ang_Latn', 'fry', 'gsw', 'frr', 'nds', 'yid', 'swg', 'sco'}

  • src_multilingual: True

  • tgt_multilingual: True

  • prepro: normalization + SentencePiece (spm32k,spm32k)

  • url_model: https://object.pouta.csc.fi/Tatoeba-MT-models/gmw-gmw/opus-2020-07-27.zip

  • url_test_set: https://object.pouta.csc.fi/Tatoeba-MT-models/gmw-gmw/opus-2020-07-27.test.txt

  • src_alpha3: gmw

  • tgt_alpha3: gmw

  • short_pair: gmw-gmw

  • chrF2_score: 0.568

  • bleu: 36.4

  • brevity_penalty: 1.0

  • ref_len: 72534.0

  • src_name: West Germanic languages

  • tgt_name: West Germanic languages

  • train_date: 2020-07-27

  • src_alpha2: gmw

  • tgt_alpha2: gmw

  • prefer_old: False

  • long_pair: gmw-gmw

  • helsinki_git_sha: 480fcbe0ee1bf4774bcbe6226ad9f58e63f6c535

  • transformers_git_sha: 2207e5d8cb224e954a7cba69fa4ac2309e9ff30b

  • port_machine: brutasse

  • port_time: 2020-08-21-14:41

Downloads last month
2,560
Translation
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Spaces using Helsinki-NLP/opus-mt-gmw-gmw 2