Hugging Face's logo

Helsinki-NLP
/
opus-mt-gmw-gmw

Translation
Transformers
PyTorch
TensorFlow
8 languages
marian
text2text-generation
Inference Endpoints
Model card Files Community
2
opus-mt-gmw-gmw / README.md
system's picture
system HF staff
Update README.md
566688a
preview code
|
raw history blame contribute delete
No virus
11.7 kB
metadata
language:
  - nl
  - en
  - lb
  - af
  - de
  - fy
  - yi
  - gmw
tags:
  - translation
license: apache-2.0

gmw-gmw

  • source group: West Germanic languages

  • target group: West Germanic languages

  • OPUS readme: gmw-gmw

  • model: transformer

  • source language(s): afr ang_Latn deu eng enm_Latn frr fry gos gsw ksh ltz nds nld pdc sco stq swg yid

  • target language(s): afr ang_Latn deu eng enm_Latn frr fry gos gsw ksh ltz nds nld pdc sco stq swg yid

  • model: transformer

  • pre-processing: normalization + SentencePiece (spm32k,spm32k)

  • a sentence initial language token is required in the form of >>id<< (id = valid target language ID)

  • download original weights: opus-2020-07-27.zip

  • test set translations: opus-2020-07-27.test.txt

  • test set scores: opus-2020-07-27.eval.txt

Benchmarks

testset BLEU chr-F
newssyscomb2009-deueng.deu.eng 25.3 0.527
newssyscomb2009-engdeu.eng.deu 19.0 0.502
news-test2008-deueng.deu.eng 23.7 0.515
news-test2008-engdeu.eng.deu 19.2 0.491
newstest2009-deueng.deu.eng 23.1 0.514
newstest2009-engdeu.eng.deu 18.6 0.495
newstest2010-deueng.deu.eng 25.8 0.545
newstest2010-engdeu.eng.deu 20.3 0.505
newstest2011-deueng.deu.eng 23.7 0.523
newstest2011-engdeu.eng.deu 18.9 0.490
newstest2012-deueng.deu.eng 24.4 0.529
newstest2012-engdeu.eng.deu 19.2 0.489
newstest2013-deueng.deu.eng 27.2 0.545
newstest2013-engdeu.eng.deu 22.4 0.514
newstest2014-deen-deueng.deu.eng 27.0 0.546
newstest2015-ende-deueng.deu.eng 28.4 0.552
newstest2015-ende-engdeu.eng.deu 25.3 0.541
newstest2016-ende-deueng.deu.eng 33.2 0.595
newstest2016-ende-engdeu.eng.deu 29.8 0.578
newstest2017-ende-deueng.deu.eng 29.0 0.557
newstest2017-ende-engdeu.eng.deu 23.9 0.534
newstest2018-ende-deueng.deu.eng 35.9 0.607
newstest2018-ende-engdeu.eng.deu 34.8 0.609
newstest2019-deen-deueng.deu.eng 32.1 0.579
newstest2019-ende-engdeu.eng.deu 31.0 0.579
Tatoeba-test.afr-ang.afr.ang 0.0 0.065
Tatoeba-test.afr-deu.afr.deu 46.8 0.668
Tatoeba-test.afr-eng.afr.eng 58.5 0.728
Tatoeba-test.afr-enm.afr.enm 13.4 0.357
Tatoeba-test.afr-fry.afr.fry 5.3 0.026
Tatoeba-test.afr-gos.afr.gos 3.5 0.228
Tatoeba-test.afr-ltz.afr.ltz 1.6 0.131
Tatoeba-test.afr-nld.afr.nld 55.4 0.715
Tatoeba-test.afr-yid.afr.yid 3.4 0.008
Tatoeba-test.ang-afr.ang.afr 3.1 0.096
Tatoeba-test.ang-deu.ang.deu 2.6 0.188
Tatoeba-test.ang-eng.ang.eng 5.4 0.211
Tatoeba-test.ang-enm.ang.enm 1.7 0.197
Tatoeba-test.ang-gos.ang.gos 6.6 0.186
Tatoeba-test.ang-ltz.ang.ltz 5.3 0.072
Tatoeba-test.ang-yid.ang.yid 0.9 0.131
Tatoeba-test.deu-afr.deu.afr 52.7 0.699
Tatoeba-test.deu-ang.deu.ang 0.8 0.133
Tatoeba-test.deu-eng.deu.eng 43.5 0.621
Tatoeba-test.deu-enm.deu.enm 6.9 0.245
Tatoeba-test.deu-frr.deu.frr 0.8 0.200
Tatoeba-test.deu-fry.deu.fry 15.1 0.367
Tatoeba-test.deu-gos.deu.gos 2.2 0.279
Tatoeba-test.deu-gsw.deu.gsw 1.0 0.176
Tatoeba-test.deu-ksh.deu.ksh 0.6 0.208
Tatoeba-test.deu-ltz.deu.ltz 12.1 0.274
Tatoeba-test.deu-nds.deu.nds 18.8 0.446
Tatoeba-test.deu-nld.deu.nld 48.6 0.669
Tatoeba-test.deu-pdc.deu.pdc 4.6 0.198
Tatoeba-test.deu-sco.deu.sco 12.0 0.340
Tatoeba-test.deu-stq.deu.stq 3.2 0.240
Tatoeba-test.deu-swg.deu.swg 0.5 0.179
Tatoeba-test.deu-yid.deu.yid 1.7 0.160
Tatoeba-test.eng-afr.eng.afr 55.8 0.730
Tatoeba-test.eng-ang.eng.ang 5.7 0.157
Tatoeba-test.eng-deu.eng.deu 36.7 0.584
Tatoeba-test.eng-enm.eng.enm 2.0 0.272
Tatoeba-test.eng-frr.eng.frr 6.1 0.246
Tatoeba-test.eng-fry.eng.fry 15.3 0.378
Tatoeba-test.eng-gos.eng.gos 1.2 0.242
Tatoeba-test.eng-gsw.eng.gsw 0.9 0.164
Tatoeba-test.eng-ksh.eng.ksh 0.9 0.170
Tatoeba-test.eng-ltz.eng.ltz 13.7 0.263
Tatoeba-test.eng-nds.eng.nds 17.1 0.410
Tatoeba-test.eng-nld.eng.nld 49.6 0.673
Tatoeba-test.eng-pdc.eng.pdc 5.1 0.218
Tatoeba-test.eng-sco.eng.sco 34.8 0.587
Tatoeba-test.eng-stq.eng.stq 2.1 0.322
Tatoeba-test.eng-swg.eng.swg 1.7 0.192
Tatoeba-test.eng-yid.eng.yid 1.7 0.173
Tatoeba-test.enm-afr.enm.afr 13.4 0.397
Tatoeba-test.enm-ang.enm.ang 0.7 0.063
Tatoeba-test.enm-deu.enm.deu 41.5 0.514
Tatoeba-test.enm-eng.enm.eng 21.3 0.483
Tatoeba-test.enm-fry.enm.fry 0.0 0.058
Tatoeba-test.enm-gos.enm.gos 10.7 0.354
Tatoeba-test.enm-ksh.enm.ksh 7.0 0.161
Tatoeba-test.enm-nds.enm.nds 18.6 0.316
Tatoeba-test.enm-nld.enm.nld 38.3 0.524
Tatoeba-test.enm-yid.enm.yid 0.7 0.128
Tatoeba-test.frr-deu.frr.deu 4.1 0.219
Tatoeba-test.frr-eng.frr.eng 14.1 0.186
Tatoeba-test.frr-fry.frr.fry 3.1 0.129
Tatoeba-test.frr-gos.frr.gos 3.6 0.226
Tatoeba-test.frr-nds.frr.nds 12.4 0.145
Tatoeba-test.frr-nld.frr.nld 9.8 0.209
Tatoeba-test.frr-stq.frr.stq 2.8 0.142
Tatoeba-test.fry-afr.fry.afr 0.0 1.000
Tatoeba-test.fry-deu.fry.deu 30.1 0.535
Tatoeba-test.fry-eng.fry.eng 28.0 0.486
Tatoeba-test.fry-enm.fry.enm 16.0 0.262
Tatoeba-test.fry-frr.fry.frr 5.5 0.160
Tatoeba-test.fry-gos.fry.gos 1.6 0.307
Tatoeba-test.fry-ltz.fry.ltz 30.4 0.438
Tatoeba-test.fry-nds.fry.nds 8.1 0.083
Tatoeba-test.fry-nld.fry.nld 41.4 0.616
Tatoeba-test.fry-stq.fry.stq 1.6 0.217
Tatoeba-test.fry-yid.fry.yid 1.6 0.159
Tatoeba-test.gos-afr.gos.afr 6.3 0.318
Tatoeba-test.gos-ang.gos.ang 6.2 0.058
Tatoeba-test.gos-deu.gos.deu 11.7 0.363
Tatoeba-test.gos-eng.gos.eng 14.9 0.322
Tatoeba-test.gos-enm.gos.enm 9.1 0.398
Tatoeba-test.gos-frr.gos.frr 3.3 0.117
Tatoeba-test.gos-fry.gos.fry 13.1 0.387
Tatoeba-test.gos-ltz.gos.ltz 3.1 0.154
Tatoeba-test.gos-nds.gos.nds 2.4 0.206
Tatoeba-test.gos-nld.gos.nld 13.9 0.395
Tatoeba-test.gos-stq.gos.stq 2.1 0.209
Tatoeba-test.gos-yid.gos.yid 1.7 0.147
Tatoeba-test.gsw-deu.gsw.deu 10.5 0.350
Tatoeba-test.gsw-eng.gsw.eng 10.7 0.299
Tatoeba-test.ksh-deu.ksh.deu 12.0 0.373
Tatoeba-test.ksh-eng.ksh.eng 3.2 0.225
Tatoeba-test.ksh-enm.ksh.enm 13.4 0.308
Tatoeba-test.ltz-afr.ltz.afr 37.4 0.525
Tatoeba-test.ltz-ang.ltz.ang 2.8 0.036
Tatoeba-test.ltz-deu.ltz.deu 40.3 0.596
Tatoeba-test.ltz-eng.ltz.eng 31.7 0.490
Tatoeba-test.ltz-fry.ltz.fry 36.3 0.658
Tatoeba-test.ltz-gos.ltz.gos 2.9 0.209
Tatoeba-test.ltz-nld.ltz.nld 38.8 0.530
Tatoeba-test.ltz-stq.ltz.stq 5.8 0.165
Tatoeba-test.ltz-yid.ltz.yid 1.0 0.159
Tatoeba-test.multi.multi 36.4 0.568
Tatoeba-test.nds-deu.nds.deu 35.0 0.573
Tatoeba-test.nds-eng.nds.eng 29.6 0.495
Tatoeba-test.nds-enm.nds.enm 3.7 0.194
Tatoeba-test.nds-frr.nds.frr 6.6 0.133
Tatoeba-test.nds-fry.nds.fry 4.2 0.087
Tatoeba-test.nds-gos.nds.gos 2.0 0.243
Tatoeba-test.nds-nld.nds.nld 41.4 0.618
Tatoeba-test.nds-swg.nds.swg 0.6 0.178
Tatoeba-test.nds-yid.nds.yid 8.3 0.238
Tatoeba-test.nld-afr.nld.afr 59.4 0.759
Tatoeba-test.nld-deu.nld.deu 49.9 0.685
Tatoeba-test.nld-eng.nld.eng 54.1 0.699
Tatoeba-test.nld-enm.nld.enm 5.0 0.250
Tatoeba-test.nld-frr.nld.frr 2.4 0.224
Tatoeba-test.nld-fry.nld.fry 19.4 0.446
Tatoeba-test.nld-gos.nld.gos 2.5 0.273
Tatoeba-test.nld-ltz.nld.ltz 13.8 0.292
Tatoeba-test.nld-nds.nld.nds 21.3 0.457
Tatoeba-test.nld-sco.nld.sco 14.7 0.423
Tatoeba-test.nld-stq.nld.stq 1.9 0.257
Tatoeba-test.nld-swg.nld.swg 4.2 0.162
Tatoeba-test.nld-yid.nld.yid 2.6 0.186
Tatoeba-test.pdc-deu.pdc.deu 39.7 0.529
Tatoeba-test.pdc-eng.pdc.eng 25.0 0.427
Tatoeba-test.sco-deu.sco.deu 28.4 0.428
Tatoeba-test.sco-eng.sco.eng 41.8 0.595
Tatoeba-test.sco-nld.sco.nld 36.4 0.565
Tatoeba-test.stq-deu.stq.deu 7.7 0.328
Tatoeba-test.stq-eng.stq.eng 21.1 0.428
Tatoeba-test.stq-frr.stq.frr 2.0 0.118
Tatoeba-test.stq-fry.stq.fry 6.3 0.255
Tatoeba-test.stq-gos.stq.gos 1.4 0.244
Tatoeba-test.stq-ltz.stq.ltz 4.4 0.204
Tatoeba-test.stq-nld.stq.nld 10.7 0.371
Tatoeba-test.stq-yid.stq.yid 1.4 0.105
Tatoeba-test.swg-deu.swg.deu 9.5 0.343
Tatoeba-test.swg-eng.swg.eng 15.1 0.306
Tatoeba-test.swg-nds.swg.nds 0.7 0.196
Tatoeba-test.swg-nld.swg.nld 11.6 0.308
Tatoeba-test.swg-yid.swg.yid 0.9 0.186
Tatoeba-test.yid-afr.yid.afr 100.0 1.000
Tatoeba-test.yid-ang.yid.ang 0.6 0.079
Tatoeba-test.yid-deu.yid.deu 16.7 0.372
Tatoeba-test.yid-eng.yid.eng 15.8 0.344
Tatoeba-test.yid-enm.yid.enm 1.3 0.166
Tatoeba-test.yid-fry.yid.fry 5.6 0.157
Tatoeba-test.yid-gos.yid.gos 2.2 0.160
Tatoeba-test.yid-ltz.yid.ltz 2.1 0.238
Tatoeba-test.yid-nds.yid.nds 14.4 0.365
Tatoeba-test.yid-nld.yid.nld 20.9 0.397
Tatoeba-test.yid-stq.yid.stq 3.7 0.165
Tatoeba-test.yid-swg.yid.swg 1.8 0.156

System Info:

  • hf_name: gmw-gmw

  • source_languages: gmw

  • target_languages: gmw

  • opus_readme_url: https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/gmw-gmw/README.md

  • original_repo: Tatoeba-Challenge

  • tags: ['translation']

  • languages: ['nl', 'en', 'lb', 'af', 'de', 'fy', 'yi', 'gmw']

  • src_constituents: {'ksh', 'nld', 'eng', 'enm_Latn', 'ltz', 'stq', 'afr', 'pdc', 'deu', 'gos', 'ang_Latn', 'fry', 'gsw', 'frr', 'nds', 'yid', 'swg', 'sco'}

  • tgt_constituents: {'ksh', 'nld', 'eng', 'enm_Latn', 'ltz', 'stq', 'afr', 'pdc', 'deu', 'gos', 'ang_Latn', 'fry', 'gsw', 'frr', 'nds', 'yid', 'swg', 'sco'}

  • src_multilingual: True

  • tgt_multilingual: True

  • prepro: normalization + SentencePiece (spm32k,spm32k)

  • url_model: https://object.pouta.csc.fi/Tatoeba-MT-models/gmw-gmw/opus-2020-07-27.zip

  • url_test_set: https://object.pouta.csc.fi/Tatoeba-MT-models/gmw-gmw/opus-2020-07-27.test.txt

  • src_alpha3: gmw

  • tgt_alpha3: gmw

  • short_pair: gmw-gmw

  • chrF2_score: 0.568

  • bleu: 36.4

  • brevity_penalty: 1.0

  • ref_len: 72534.0

  • src_name: West Germanic languages

  • tgt_name: West Germanic languages

  • train_date: 2020-07-27

  • src_alpha2: gmw

  • tgt_alpha2: gmw

  • prefer_old: False

  • long_pair: gmw-gmw

  • helsinki_git_sha: 480fcbe0ee1bf4774bcbe6226ad9f58e63f6c535

  • transformers_git_sha: 2207e5d8cb224e954a7cba69fa4ac2309e9ff30b

  • port_machine: brutasse

  • port_time: 2020-08-21-14:41