opus-mt-en-mul / README.md
system
Update README.md 2e7c494
1
---
2
language: 
3
- en
4
- ca
5
- es
6
- os
7
- eo
8
- ro
9
- fy
10
- cy
11
- is
12
- lb
13
- su
14
- an
15
- sq
16
- fr
17
- ht
18
- rm
19
- cv
20
- ig
21
- am
22
- eu
23
- tr
24
- ps
25
- af
26
- ny
27
- ch
28
- uk
29
- sl
30
- lt
31
- tk
32
- sg
33
- ar
34
- lg
35
- bg
36
- be
37
- ka
38
- gd
39
- ja
40
- si
41
- br
42
- mh
43
- km
44
- th
45
- ty
46
- rw
47
- te
48
- mk
49
- or
50
- wo
51
- kl
52
- mr
53
- ru
54
- yo
55
- hu
56
- fo
57
- zh
58
- ti
59
- co
60
- ee
61
- oc
62
- sn
63
- mt
64
- ts
65
- pl
66
- gl
67
- nb
68
- bn
69
- tt
70
- bo
71
- lo
72
- id
73
- gn
74
- nv
75
- hy
76
- kn
77
- to
78
- io
79
- so
80
- vi
81
- da
82
- fj
83
- gv
84
- sm
85
- nl
86
- mi
87
- pt
88
- hi
89
- se
90
- as
91
- ta
92
- et
93
- kw
94
- ga
95
- sv
96
- ln
97
- na
98
- mn
99
- gu
100
- wa
101
- lv
102
- jv
103
- el
104
- my
105
- ba
106
- it
107
- hr
108
- ur
109
- ce
110
- nn
111
- fi
112
- mg
113
- rn
114
- xh
115
- ab
116
- de
117
- cs
118
- he
119
- zu
120
- yi
121
- ml
122
- mul
123
124
tags:
125
- translation
126
127
license: apache-2.0
128
---
129
130
### eng-mul
131
132
* source group: English 
133
* target group: Multiple languages 
134
*  OPUS readme: [eng-mul](https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/eng-mul/README.md)
135
136
*  model: transformer
137
* source language(s): eng
138
* target language(s): abk acm ady afb afh_Latn afr akl_Latn aln amh ang_Latn apc ara arg arq ary arz asm ast avk_Latn awa aze_Latn bak bam_Latn bel bel_Latn ben bho bod bos_Latn bre brx brx_Latn bul bul_Latn cat ceb ces cha che chr chv cjy_Hans cjy_Hant cmn cmn_Hans cmn_Hant cor cos crh crh_Latn csb_Latn cym dan deu dsb dtp dws_Latn egl ell enm_Latn epo est eus ewe ext fao fij fin fkv_Latn fra frm_Latn frr fry fuc fuv gan gcf_Latn gil gla gle glg glv gom gos got_Goth grc_Grek grn gsw guj hat hau_Latn haw heb hif_Latn hil hin hnj_Latn hoc hoc_Latn hrv hsb hun hye iba ibo ido ido_Latn ike_Latn ile_Latn ilo ina_Latn ind isl ita izh jav jav_Java jbo jbo_Cyrl jbo_Latn jdt_Cyrl jpn kab kal kan kat kaz_Cyrl kaz_Latn kek_Latn kha khm khm_Latn kin kir_Cyrl kjh kpv krl ksh kum kur_Arab kur_Latn lad lad_Latn lao lat_Latn lav ldn_Latn lfn_Cyrl lfn_Latn lij lin lit liv_Latn lkt lld_Latn lmo ltg ltz lug lzh lzh_Hans mad mah mai mal mar max_Latn mdf mfe mhr mic min mkd mlg mlt mnw moh mon mri mwl mww mya myv nan nau nav nds niu nld nno nob nob_Hebr nog non_Latn nov_Latn npi nya oci ori orv_Cyrl oss ota_Arab ota_Latn pag pan_Guru pap pau pdc pes pes_Latn pes_Thaa pms pnb pol por ppl_Latn prg_Latn pus quc qya qya_Latn rap rif_Latn roh rom ron rue run rus sag sah san_Deva scn sco sgs shs_Latn shy_Latn sin sjn_Latn slv sma sme smo sna snd_Arab som spa sqi srp_Cyrl srp_Latn stq sun swe swg swh tah tam tat tat_Arab tat_Latn tel tet tgk_Cyrl tha tir tlh_Latn tly_Latn tmw_Latn toi_Latn ton tpw_Latn tso tuk tuk_Latn tur tvl tyv tzl tzl_Latn udm uig_Arab uig_Cyrl ukr umb urd uzb_Cyrl uzb_Latn vec vie vie_Hani vol_Latn vro war wln wol wuu xal xho yid yor yue yue_Hans yue_Hant zho zho_Hans zho_Hant zlm_Latn zsm_Latn zul zza
139
* model: transformer
140
* pre-processing: normalization + SentencePiece (spm32k,spm32k)
141
* a sentence initial language token is required in the form of `>>id<<` (id = valid target language ID)
142
* download original weights: [opus2m-2020-08-01.zip](https://object.pouta.csc.fi/Tatoeba-MT-models/eng-mul/opus2m-2020-08-01.zip)
143
* test set translations: [opus2m-2020-08-01.test.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/eng-mul/opus2m-2020-08-01.test.txt)
144
* test set scores: [opus2m-2020-08-01.eval.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/eng-mul/opus2m-2020-08-01.eval.txt)
145
146
## Benchmarks
147
148
| testset               | BLEU  | chr-F |
149
|-----------------------|-------|-------|
150
| newsdev2014-enghin.eng.hin 	| 5.0 	| 0.288 |
151
| newsdev2015-enfi-engfin.eng.fin 	| 9.3 	| 0.418 |
152
| newsdev2016-enro-engron.eng.ron 	| 17.2 	| 0.488 |
153
| newsdev2016-entr-engtur.eng.tur 	| 8.2 	| 0.402 |
154
| newsdev2017-enlv-englav.eng.lav 	| 12.9 	| 0.444 |
155
| newsdev2017-enzh-engzho.eng.zho 	| 17.6 	| 0.170 |
156
| newsdev2018-enet-engest.eng.est 	| 10.9 	| 0.423 |
157
| newsdev2019-engu-engguj.eng.guj 	| 5.2 	| 0.284 |
158
| newsdev2019-enlt-englit.eng.lit 	| 11.0 	| 0.431 |
159
| newsdiscussdev2015-enfr-engfra.eng.fra 	| 22.6 	| 0.521 |
160
| newsdiscusstest2015-enfr-engfra.eng.fra 	| 25.9 	| 0.546 |
161
| newssyscomb2009-engces.eng.ces 	| 10.3 	| 0.394 |
162
| newssyscomb2009-engdeu.eng.deu 	| 13.3 	| 0.459 |
163
| newssyscomb2009-engfra.eng.fra 	| 21.5 	| 0.522 |
164
| newssyscomb2009-enghun.eng.hun 	| 8.1 	| 0.371 |
165
| newssyscomb2009-engita.eng.ita 	| 22.1 	| 0.540 |
166
| newssyscomb2009-engspa.eng.spa 	| 23.8 	| 0.531 |
167
| news-test2008-engces.eng.ces 	| 9.0 	| 0.376 |
168
| news-test2008-engdeu.eng.deu 	| 14.2 	| 0.451 |
169
| news-test2008-engfra.eng.fra 	| 19.8 	| 0.500 |
170
| news-test2008-engspa.eng.spa 	| 22.8 	| 0.518 |
171
| newstest2009-engces.eng.ces 	| 9.8 	| 0.392 |
172
| newstest2009-engdeu.eng.deu 	| 13.7 	| 0.454 |
173
| newstest2009-engfra.eng.fra 	| 20.7 	| 0.514 |
174
| newstest2009-enghun.eng.hun 	| 8.4 	| 0.370 |
175
| newstest2009-engita.eng.ita 	| 22.4 	| 0.538 |
176
| newstest2009-engspa.eng.spa 	| 23.5 	| 0.532 |
177
| newstest2010-engces.eng.ces 	| 10.0 	| 0.393 |
178
| newstest2010-engdeu.eng.deu 	| 15.2 	| 0.463 |
179
| newstest2010-engfra.eng.fra 	| 22.0 	| 0.524 |
180
| newstest2010-engspa.eng.spa 	| 27.2 	| 0.556 |
181
| newstest2011-engces.eng.ces 	| 10.8 	| 0.392 |
182
| newstest2011-engdeu.eng.deu 	| 14.2 	| 0.449 |
183
| newstest2011-engfra.eng.fra 	| 24.3 	| 0.544 |
184
| newstest2011-engspa.eng.spa 	| 28.3 	| 0.559 |
185
| newstest2012-engces.eng.ces 	| 9.9 	| 0.377 |
186
| newstest2012-engdeu.eng.deu 	| 14.3 	| 0.449 |
187
| newstest2012-engfra.eng.fra 	| 23.2 	| 0.530 |
188
| newstest2012-engrus.eng.rus 	| 16.0 	| 0.463 |
189
| newstest2012-engspa.eng.spa 	| 27.8 	| 0.555 |
190
| newstest2013-engces.eng.ces 	| 11.0 	| 0.392 |
191
| newstest2013-engdeu.eng.deu 	| 16.4 	| 0.469 |
192
| newstest2013-engfra.eng.fra 	| 22.6 	| 0.515 |
193
| newstest2013-engrus.eng.rus 	| 12.1 	| 0.414 |
194
| newstest2013-engspa.eng.spa 	| 24.9 	| 0.532 |
195
| newstest2014-hien-enghin.eng.hin 	| 7.2 	| 0.311 |
196
| newstest2015-encs-engces.eng.ces 	| 10.9 	| 0.396 |
197
| newstest2015-ende-engdeu.eng.deu 	| 18.3 	| 0.490 |
198
| newstest2015-enfi-engfin.eng.fin 	| 10.1 	| 0.421 |
199
| newstest2015-enru-engrus.eng.rus 	| 14.5 	| 0.445 |
200
| newstest2016-encs-engces.eng.ces 	| 12.2 	| 0.408 |
201
| newstest2016-ende-engdeu.eng.deu 	| 21.4 	| 0.517 |
202
| newstest2016-enfi-engfin.eng.fin 	| 11.2 	| 0.435 |
203
| newstest2016-enro-engron.eng.ron 	| 16.6 	| 0.472 |
204
| newstest2016-enru-engrus.eng.rus 	| 13.4 	| 0.435 |
205
| newstest2016-entr-engtur.eng.tur 	| 8.1 	| 0.385 |
206
| newstest2017-encs-engces.eng.ces 	| 9.6 	| 0.377 |
207
| newstest2017-ende-engdeu.eng.deu 	| 17.9 	| 0.482 |
208
| newstest2017-enfi-engfin.eng.fin 	| 11.8 	| 0.440 |
209
| newstest2017-enlv-englav.eng.lav 	| 9.6 	| 0.412 |
210
| newstest2017-enru-engrus.eng.rus 	| 14.1 	| 0.446 |
211
| newstest2017-entr-engtur.eng.tur 	| 8.0 	| 0.378 |
212
| newstest2017-enzh-engzho.eng.zho 	| 16.8 	| 0.175 |
213
| newstest2018-encs-engces.eng.ces 	| 9.8 	| 0.380 |
214
| newstest2018-ende-engdeu.eng.deu 	| 23.8 	| 0.536 |
215
| newstest2018-enet-engest.eng.est 	| 11.8 	| 0.433 |
216
| newstest2018-enfi-engfin.eng.fin 	| 7.8 	| 0.398 |
217
| newstest2018-enru-engrus.eng.rus 	| 12.2 	| 0.434 |
218
| newstest2018-entr-engtur.eng.tur 	| 7.5 	| 0.383 |
219
| newstest2018-enzh-engzho.eng.zho 	| 18.3 	| 0.179 |
220
| newstest2019-encs-engces.eng.ces 	| 10.7 	| 0.389 |
221
| newstest2019-ende-engdeu.eng.deu 	| 21.0 	| 0.512 |
222
| newstest2019-enfi-engfin.eng.fin 	| 10.4 	| 0.420 |
223
| newstest2019-engu-engguj.eng.guj 	| 5.8 	| 0.297 |
224
| newstest2019-enlt-englit.eng.lit 	| 8.0 	| 0.388 |
225
| newstest2019-enru-engrus.eng.rus 	| 13.0 	| 0.415 |
226
| newstest2019-enzh-engzho.eng.zho 	| 15.0 	| 0.192 |
227
| newstestB2016-enfi-engfin.eng.fin 	| 9.0 	| 0.414 |
228
| newstestB2017-enfi-engfin.eng.fin 	| 9.5 	| 0.415 |
229
| Tatoeba-test.eng-abk.eng.abk 	| 4.2 	| 0.275 |
230
| Tatoeba-test.eng-ady.eng.ady 	| 0.4 	| 0.006 |
231
| Tatoeba-test.eng-afh.eng.afh 	| 1.0 	| 0.058 |
232
| Tatoeba-test.eng-afr.eng.afr 	| 47.0 	| 0.663 |
233
| Tatoeba-test.eng-akl.eng.akl 	| 2.7 	| 0.080 |
234
| Tatoeba-test.eng-amh.eng.amh 	| 8.5 	| 0.455 |
235
| Tatoeba-test.eng-ang.eng.ang 	| 6.2 	| 0.138 |
236
| Tatoeba-test.eng-ara.eng.ara 	| 6.3 	| 0.325 |
237
| Tatoeba-test.eng-arg.eng.arg 	| 1.5 	| 0.107 |
238
| Tatoeba-test.eng-asm.eng.asm 	| 2.1 	| 0.265 |
239
| Tatoeba-test.eng-ast.eng.ast 	| 15.7 	| 0.393 |
240
| Tatoeba-test.eng-avk.eng.avk 	| 0.2 	| 0.095 |
241
| Tatoeba-test.eng-awa.eng.awa 	| 0.1 	| 0.002 |
242
| Tatoeba-test.eng-aze.eng.aze 	| 19.0 	| 0.500 |
243
| Tatoeba-test.eng-bak.eng.bak 	| 12.7 	| 0.379 |
244
| Tatoeba-test.eng-bam.eng.bam 	| 8.3 	| 0.037 |
245
| Tatoeba-test.eng-bel.eng.bel 	| 13.5 	| 0.396 |
246
| Tatoeba-test.eng-ben.eng.ben 	| 10.0 	| 0.383 |
247
| Tatoeba-test.eng-bho.eng.bho 	| 0.1 	| 0.003 |
248
| Tatoeba-test.eng-bod.eng.bod 	| 0.0 	| 0.147 |
249
| Tatoeba-test.eng-bre.eng.bre 	| 7.6 	| 0.275 |
250
| Tatoeba-test.eng-brx.eng.brx 	| 0.8 	| 0.060 |
251
| Tatoeba-test.eng-bul.eng.bul 	| 32.1 	| 0.542 |
252
| Tatoeba-test.eng-cat.eng.cat 	| 37.0 	| 0.595 |
253
| Tatoeba-test.eng-ceb.eng.ceb 	| 9.6 	| 0.409 |
254
| Tatoeba-test.eng-ces.eng.ces 	| 24.0 	| 0.475 |
255
| Tatoeba-test.eng-cha.eng.cha 	| 3.9 	| 0.228 |
256
| Tatoeba-test.eng-che.eng.che 	| 0.7 	| 0.013 |
257
| Tatoeba-test.eng-chm.eng.chm 	| 2.6 	| 0.212 |
258
| Tatoeba-test.eng-chr.eng.chr 	| 6.0 	| 0.190 |
259
| Tatoeba-test.eng-chv.eng.chv 	| 6.5 	| 0.369 |
260
| Tatoeba-test.eng-cor.eng.cor 	| 0.9 	| 0.086 |
261
| Tatoeba-test.eng-cos.eng.cos 	| 4.2 	| 0.174 |
262
| Tatoeba-test.eng-crh.eng.crh 	| 9.9 	| 0.361 |
263
| Tatoeba-test.eng-csb.eng.csb 	| 3.4 	| 0.230 |
264
| Tatoeba-test.eng-cym.eng.cym 	| 18.0 	| 0.418 |
265
| Tatoeba-test.eng-dan.eng.dan 	| 42.5 	| 0.624 |
266
| Tatoeba-test.eng-deu.eng.deu 	| 25.2 	| 0.505 |
267
| Tatoeba-test.eng-dsb.eng.dsb 	| 0.9 	| 0.121 |
268
| Tatoeba-test.eng-dtp.eng.dtp 	| 0.3 	| 0.084 |
269
| Tatoeba-test.eng-dws.eng.dws 	| 0.2 	| 0.040 |
270
| Tatoeba-test.eng-egl.eng.egl 	| 0.4 	| 0.085 |
271
| Tatoeba-test.eng-ell.eng.ell 	| 28.7 	| 0.543 |
272
| Tatoeba-test.eng-enm.eng.enm 	| 3.3 	| 0.295 |
273
| Tatoeba-test.eng-epo.eng.epo 	| 33.4 	| 0.570 |
274
| Tatoeba-test.eng-est.eng.est 	| 30.3 	| 0.545 |
275
| Tatoeba-test.eng-eus.eng.eus 	| 18.5 	| 0.486 |
276
| Tatoeba-test.eng-ewe.eng.ewe 	| 6.8 	| 0.272 |
277
| Tatoeba-test.eng-ext.eng.ext 	| 5.0 	| 0.228 |
278
| Tatoeba-test.eng-fao.eng.fao 	| 5.2 	| 0.277 |
279
| Tatoeba-test.eng-fas.eng.fas 	| 6.9 	| 0.265 |
280
| Tatoeba-test.eng-fij.eng.fij 	| 31.5 	| 0.365 |
281
| Tatoeba-test.eng-fin.eng.fin 	| 18.5 	| 0.459 |
282
| Tatoeba-test.eng-fkv.eng.fkv 	| 0.9 	| 0.132 |
283
| Tatoeba-test.eng-fra.eng.fra 	| 31.5 	| 0.546 |
284
| Tatoeba-test.eng-frm.eng.frm 	| 0.9 	| 0.128 |
285
| Tatoeba-test.eng-frr.eng.frr 	| 3.0 	| 0.025 |
286
| Tatoeba-test.eng-fry.eng.fry 	| 14.4 	| 0.387 |
287
| Tatoeba-test.eng-ful.eng.ful 	| 0.4 	| 0.061 |
288
| Tatoeba-test.eng-gcf.eng.gcf 	| 0.3 	| 0.075 |
289
| Tatoeba-test.eng-gil.eng.gil 	| 47.4 	| 0.706 |
290
| Tatoeba-test.eng-gla.eng.gla 	| 10.9 	| 0.341 |
291
| Tatoeba-test.eng-gle.eng.gle 	| 26.8 	| 0.493 |
292
| Tatoeba-test.eng-glg.eng.glg 	| 32.5 	| 0.565 |
293
| Tatoeba-test.eng-glv.eng.glv 	| 21.5 	| 0.395 |
294
| Tatoeba-test.eng-gos.eng.gos 	| 0.3 	| 0.124 |
295
| Tatoeba-test.eng-got.eng.got 	| 0.2 	| 0.010 |
296
| Tatoeba-test.eng-grc.eng.grc 	| 0.0 	| 0.005 |
297
| Tatoeba-test.eng-grn.eng.grn 	| 1.5 	| 0.129 |
298
| Tatoeba-test.eng-gsw.eng.gsw 	| 0.6 	| 0.106 |
299
| Tatoeba-test.eng-guj.eng.guj 	| 15.4 	| 0.347 |
300
| Tatoeba-test.eng-hat.eng.hat 	| 31.1 	| 0.527 |
301
| Tatoeba-test.eng-hau.eng.hau 	| 6.5 	| 0.385 |
302
| Tatoeba-test.eng-haw.eng.haw 	| 0.2 	| 0.066 |
303
| Tatoeba-test.eng-hbs.eng.hbs 	| 28.7 	| 0.531 |
304
| Tatoeba-test.eng-heb.eng.heb 	| 21.3 	| 0.443 |
305
| Tatoeba-test.eng-hif.eng.hif 	| 2.8 	| 0.268 |
306
| Tatoeba-test.eng-hil.eng.hil 	| 12.0 	| 0.463 |
307
| Tatoeba-test.eng-hin.eng.hin 	| 13.0 	| 0.401 |
308
| Tatoeba-test.eng-hmn.eng.hmn 	| 0.2 	| 0.073 |
309
| Tatoeba-test.eng-hoc.eng.hoc 	| 0.2 	| 0.077 |
310
| Tatoeba-test.eng-hsb.eng.hsb 	| 5.7 	| 0.308 |
311
| Tatoeba-test.eng-hun.eng.hun 	| 17.1 	| 0.431 |
312
| Tatoeba-test.eng-hye.eng.hye 	| 15.0 	| 0.378 |
313
| Tatoeba-test.eng-iba.eng.iba 	| 16.0 	| 0.437 |
314
| Tatoeba-test.eng-ibo.eng.ibo 	| 2.9 	| 0.221 |
315
| Tatoeba-test.eng-ido.eng.ido 	| 11.5 	| 0.403 |
316
| Tatoeba-test.eng-iku.eng.iku 	| 2.3 	| 0.089 |
317
| Tatoeba-test.eng-ile.eng.ile 	| 4.3 	| 0.282 |
318
| Tatoeba-test.eng-ilo.eng.ilo 	| 26.4 	| 0.522 |
319
| Tatoeba-test.eng-ina.eng.ina 	| 20.9 	| 0.493 |
320
| Tatoeba-test.eng-isl.eng.isl 	| 12.5 	| 0.375 |
321
| Tatoeba-test.eng-ita.eng.ita 	| 33.9 	| 0.592 |
322
| Tatoeba-test.eng-izh.eng.izh 	| 4.6 	| 0.050 |
323
| Tatoeba-test.eng-jav.eng.jav 	| 7.8 	| 0.328 |
324
| Tatoeba-test.eng-jbo.eng.jbo 	| 0.1 	| 0.123 |
325
| Tatoeba-test.eng-jdt.eng.jdt 	| 6.4 	| 0.008 |
326
| Tatoeba-test.eng-jpn.eng.jpn 	| 0.0 	| 0.000 |
327
| Tatoeba-test.eng-kab.eng.kab 	| 5.9 	| 0.261 |
328
| Tatoeba-test.eng-kal.eng.kal 	| 13.4 	| 0.382 |
329
| Tatoeba-test.eng-kan.eng.kan 	| 4.8 	| 0.358 |
330
| Tatoeba-test.eng-kat.eng.kat 	| 1.8 	| 0.115 |
331
| Tatoeba-test.eng-kaz.eng.kaz 	| 8.8 	| 0.354 |
332
| Tatoeba-test.eng-kek.eng.kek 	| 3.7 	| 0.188 |
333
| Tatoeba-test.eng-kha.eng.kha 	| 0.5 	| 0.094 |
334
| Tatoeba-test.eng-khm.eng.khm 	| 0.4 	| 0.243 |
335
| Tatoeba-test.eng-kin.eng.kin 	| 5.2 	| 0.362 |
336
| Tatoeba-test.eng-kir.eng.kir 	| 17.2 	| 0.416 |
337
| Tatoeba-test.eng-kjh.eng.kjh 	| 0.6 	| 0.009 |
338
| Tatoeba-test.eng-kok.eng.kok 	| 5.5 	| 0.005 |
339
| Tatoeba-test.eng-kom.eng.kom 	| 2.4 	| 0.012 |
340
| Tatoeba-test.eng-krl.eng.krl 	| 2.0 	| 0.099 |
341
| Tatoeba-test.eng-ksh.eng.ksh 	| 0.4 	| 0.074 |
342
| Tatoeba-test.eng-kum.eng.kum 	| 0.9 	| 0.007 |
343
| Tatoeba-test.eng-kur.eng.kur 	| 9.1 	| 0.174 |
344
| Tatoeba-test.eng-lad.eng.lad 	| 1.2 	| 0.154 |
345
| Tatoeba-test.eng-lah.eng.lah 	| 0.1 	| 0.001 |
346
| Tatoeba-test.eng-lao.eng.lao 	| 0.6 	| 0.426 |
347
| Tatoeba-test.eng-lat.eng.lat 	| 8.2 	| 0.366 |
348
| Tatoeba-test.eng-lav.eng.lav 	| 20.4 	| 0.475 |
349
| Tatoeba-test.eng-ldn.eng.ldn 	| 0.3 	| 0.059 |
350
| Tatoeba-test.eng-lfn.eng.lfn 	| 0.5 	| 0.104 |
351
| Tatoeba-test.eng-lij.eng.lij 	| 0.2 	| 0.094 |
352
| Tatoeba-test.eng-lin.eng.lin 	| 1.2 	| 0.276 |
353
| Tatoeba-test.eng-lit.eng.lit 	| 17.4 	| 0.488 |
354
| Tatoeba-test.eng-liv.eng.liv 	| 0.3 	| 0.039 |
355
| Tatoeba-test.eng-lkt.eng.lkt 	| 0.3 	| 0.041 |
356
| Tatoeba-test.eng-lld.eng.lld 	| 0.1 	| 0.083 |
357
| Tatoeba-test.eng-lmo.eng.lmo 	| 1.4 	| 0.154 |
358
| Tatoeba-test.eng-ltz.eng.ltz 	| 19.1 	| 0.395 |
359
| Tatoeba-test.eng-lug.eng.lug 	| 4.2 	| 0.382 |
360
| Tatoeba-test.eng-mad.eng.mad 	| 2.1 	| 0.075 |
361
| Tatoeba-test.eng-mah.eng.mah 	| 9.5 	| 0.331 |
362
| Tatoeba-test.eng-mai.eng.mai 	| 9.3 	| 0.372 |
363
| Tatoeba-test.eng-mal.eng.mal 	| 8.3 	| 0.437 |
364
| Tatoeba-test.eng-mar.eng.mar 	| 13.5 	| 0.410 |
365
| Tatoeba-test.eng-mdf.eng.mdf 	| 2.3 	| 0.008 |
366
| Tatoeba-test.eng-mfe.eng.mfe 	| 83.6 	| 0.905 |
367
| Tatoeba-test.eng-mic.eng.mic 	| 7.6 	| 0.214 |
368
| Tatoeba-test.eng-mkd.eng.mkd 	| 31.8 	| 0.540 |
369
| Tatoeba-test.eng-mlg.eng.mlg 	| 31.3 	| 0.464 |
370
| Tatoeba-test.eng-mlt.eng.mlt 	| 11.7 	| 0.427 |
371
| Tatoeba-test.eng-mnw.eng.mnw 	| 0.1 	| 0.000 |
372
| Tatoeba-test.eng-moh.eng.moh 	| 0.6 	| 0.067 |
373
| Tatoeba-test.eng-mon.eng.mon 	| 8.5 	| 0.323 |
374
| Tatoeba-test.eng-mri.eng.mri 	| 8.5 	| 0.320 |
375
| Tatoeba-test.eng-msa.eng.msa 	| 24.5 	| 0.498 |
376
| Tatoeba-test.eng.multi 	| 22.4 	| 0.451 |
377
| Tatoeba-test.eng-mwl.eng.mwl 	| 3.8 	| 0.169 |
378
| Tatoeba-test.eng-mya.eng.mya 	| 0.2 	| 0.123 |
379
| Tatoeba-test.eng-myv.eng.myv 	| 1.1 	| 0.014 |
380
| Tatoeba-test.eng-nau.eng.nau 	| 0.6 	| 0.109 |
381
| Tatoeba-test.eng-nav.eng.nav 	| 1.8 	| 0.149 |
382
| Tatoeba-test.eng-nds.eng.nds 	| 11.3 	| 0.365 |
383
| Tatoeba-test.eng-nep.eng.nep 	| 0.5 	| 0.004 |
384
| Tatoeba-test.eng-niu.eng.niu 	| 34.4 	| 0.501 |
385
| Tatoeba-test.eng-nld.eng.nld 	| 37.6 	| 0.598 |
386
| Tatoeba-test.eng-nog.eng.nog 	| 0.2 	| 0.010 |
387
| Tatoeba-test.eng-non.eng.non 	| 0.2 	| 0.096 |
388
| Tatoeba-test.eng-nor.eng.nor 	| 36.3 	| 0.577 |
389
| Tatoeba-test.eng-nov.eng.nov 	| 0.9 	| 0.180 |
390
| Tatoeba-test.eng-nya.eng.nya 	| 9.8 	| 0.524 |
391
| Tatoeba-test.eng-oci.eng.oci 	| 6.3 	| 0.288 |
392
| Tatoeba-test.eng-ori.eng.ori 	| 5.3 	| 0.273 |
393
| Tatoeba-test.eng-orv.eng.orv 	| 0.2 	| 0.007 |
394
| Tatoeba-test.eng-oss.eng.oss 	| 3.0 	| 0.230 |
395
| Tatoeba-test.eng-ota.eng.ota 	| 0.2 	| 0.053 |
396
| Tatoeba-test.eng-pag.eng.pag 	| 20.2 	| 0.513 |
397
| Tatoeba-test.eng-pan.eng.pan 	| 6.4 	| 0.301 |
398
| Tatoeba-test.eng-pap.eng.pap 	| 44.7 	| 0.624 |
399
| Tatoeba-test.eng-pau.eng.pau 	| 0.8 	| 0.098 |
400
| Tatoeba-test.eng-pdc.eng.pdc 	| 2.9 	| 0.143 |
401
| Tatoeba-test.eng-pms.eng.pms 	| 0.6 	| 0.124 |
402
| Tatoeba-test.eng-pol.eng.pol 	| 22.7 	| 0.500 |
403
| Tatoeba-test.eng-por.eng.por 	| 31.6 	| 0.570 |
404
| Tatoeba-test.eng-ppl.eng.ppl 	| 0.5 	| 0.085 |
405
| Tatoeba-test.eng-prg.eng.prg 	| 0.1 	| 0.078 |
406
| Tatoeba-test.eng-pus.eng.pus 	| 0.9 	| 0.137 |
407
| Tatoeba-test.eng-quc.eng.quc 	| 2.7 	| 0.255 |
408
| Tatoeba-test.eng-qya.eng.qya 	| 0.4 	| 0.084 |
409
| Tatoeba-test.eng-rap.eng.rap 	| 1.9 	| 0.050 |
410
| Tatoeba-test.eng-rif.eng.rif 	| 1.3 	| 0.102 |
411
| Tatoeba-test.eng-roh.eng.roh 	| 1.4 	| 0.169 |
412
| Tatoeba-test.eng-rom.eng.rom 	| 7.8 	| 0.329 |
413
| Tatoeba-test.eng-ron.eng.ron 	| 27.0 	| 0.530 |
414
| Tatoeba-test.eng-rue.eng.rue 	| 0.1 	| 0.009 |
415
| Tatoeba-test.eng-run.eng.run 	| 9.8 	| 0.434 |
416
| Tatoeba-test.eng-rus.eng.rus 	| 22.2 	| 0.465 |
417
| Tatoeba-test.eng-sag.eng.sag 	| 4.8 	| 0.155 |
418
| Tatoeba-test.eng-sah.eng.sah 	| 0.2 	| 0.007 |
419
| Tatoeba-test.eng-san.eng.san 	| 1.7 	| 0.143 |
420
| Tatoeba-test.eng-scn.eng.scn 	| 1.5 	| 0.083 |
421
| Tatoeba-test.eng-sco.eng.sco 	| 30.3 	| 0.514 |
422
| Tatoeba-test.eng-sgs.eng.sgs 	| 1.6 	| 0.104 |
423
| Tatoeba-test.eng-shs.eng.shs 	| 0.7 	| 0.049 |
424
| Tatoeba-test.eng-shy.eng.shy 	| 0.6 	| 0.064 |
425
| Tatoeba-test.eng-sin.eng.sin 	| 5.4 	| 0.317 |
426
| Tatoeba-test.eng-sjn.eng.sjn 	| 0.3 	| 0.074 |
427
| Tatoeba-test.eng-slv.eng.slv 	| 12.8 	| 0.313 |
428
| Tatoeba-test.eng-sma.eng.sma 	| 0.8 	| 0.063 |
429
| Tatoeba-test.eng-sme.eng.sme 	| 13.2 	| 0.290 |
430
| Tatoeba-test.eng-smo.eng.smo 	| 12.1 	| 0.416 |
431
| Tatoeba-test.eng-sna.eng.sna 	| 27.1 	| 0.533 |
432
| Tatoeba-test.eng-snd.eng.snd 	| 6.0 	| 0.359 |
433
| Tatoeba-test.eng-som.eng.som 	| 16.0 	| 0.274 |
434
| Tatoeba-test.eng-spa.eng.spa 	| 36.7 	| 0.603 |
435
| Tatoeba-test.eng-sqi.eng.sqi 	| 32.3 	| 0.573 |
436
| Tatoeba-test.eng-stq.eng.stq 	| 0.6 	| 0.198 |
437
| Tatoeba-test.eng-sun.eng.sun 	| 39.0 	| 0.447 |
438
| Tatoeba-test.eng-swa.eng.swa 	| 1.1 	| 0.109 |
439
| Tatoeba-test.eng-swe.eng.swe 	| 42.7 	| 0.614 |
440
| Tatoeba-test.eng-swg.eng.swg 	| 0.6 	| 0.118 |
441
| Tatoeba-test.eng-tah.eng.tah 	| 12.4 	| 0.294 |
442
| Tatoeba-test.eng-tam.eng.tam 	| 5.0 	| 0.404 |
443
| Tatoeba-test.eng-tat.eng.tat 	| 9.9 	| 0.326 |
444
| Tatoeba-test.eng-tel.eng.tel 	| 4.7 	| 0.326 |
445
| Tatoeba-test.eng-tet.eng.tet 	| 0.7 	| 0.100 |
446
| Tatoeba-test.eng-tgk.eng.tgk 	| 5.5 	| 0.304 |
447
| Tatoeba-test.eng-tha.eng.tha 	| 2.2 	| 0.456 |
448
| Tatoeba-test.eng-tir.eng.tir 	| 1.5 	| 0.197 |
449
| Tatoeba-test.eng-tlh.eng.tlh 	| 0.0 	| 0.032 |
450
| Tatoeba-test.eng-tly.eng.tly 	| 0.3 	| 0.061 |
451
| Tatoeba-test.eng-toi.eng.toi 	| 8.3 	| 0.219 |
452
| Tatoeba-test.eng-ton.eng.ton 	| 32.7 	| 0.619 |
453
| Tatoeba-test.eng-tpw.eng.tpw 	| 1.4 	| 0.136 |
454
| Tatoeba-test.eng-tso.eng.tso 	| 9.6 	| 0.465 |
455
| Tatoeba-test.eng-tuk.eng.tuk 	| 9.4 	| 0.383 |
456
| Tatoeba-test.eng-tur.eng.tur 	| 24.1 	| 0.542 |
457
| Tatoeba-test.eng-tvl.eng.tvl 	| 8.9 	| 0.398 |
458
| Tatoeba-test.eng-tyv.eng.tyv 	| 10.4 	| 0.249 |
459
| Tatoeba-test.eng-tzl.eng.tzl 	| 0.2 	| 0.098 |
460
| Tatoeba-test.eng-udm.eng.udm 	| 6.5 	| 0.212 |
461
| Tatoeba-test.eng-uig.eng.uig 	| 2.1 	| 0.266 |
462
| Tatoeba-test.eng-ukr.eng.ukr 	| 24.3 	| 0.479 |
463
| Tatoeba-test.eng-umb.eng.umb 	| 4.4 	| 0.274 |
464
| Tatoeba-test.eng-urd.eng.urd 	| 8.6 	| 0.344 |
465
| Tatoeba-test.eng-uzb.eng.uzb 	| 6.9 	| 0.343 |
466
| Tatoeba-test.eng-vec.eng.vec 	| 1.0 	| 0.094 |
467
| Tatoeba-test.eng-vie.eng.vie 	| 23.2 	| 0.420 |
468
| Tatoeba-test.eng-vol.eng.vol 	| 0.3 	| 0.086 |
469
| Tatoeba-test.eng-war.eng.war 	| 11.4 	| 0.415 |
470
| Tatoeba-test.eng-wln.eng.wln 	| 8.4 	| 0.218 |
471
| Tatoeba-test.eng-wol.eng.wol 	| 11.5 	| 0.252 |
472
| Tatoeba-test.eng-xal.eng.xal 	| 0.1 	| 0.007 |
473
| Tatoeba-test.eng-xho.eng.xho 	| 19.5 	| 0.552 |
474
| Tatoeba-test.eng-yid.eng.yid 	| 4.0 	| 0.256 |
475
| Tatoeba-test.eng-yor.eng.yor 	| 8.8 	| 0.247 |
476
| Tatoeba-test.eng-zho.eng.zho 	| 21.8 	| 0.192 |
477
| Tatoeba-test.eng-zul.eng.zul 	| 34.3 	| 0.655 |
478
| Tatoeba-test.eng-zza.eng.zza 	| 0.5 	| 0.080 |
479
480
481
### System Info: 
482
- hf_name: eng-mul
483
484
- source_languages: eng
485
486
- target_languages: mul
487
488
- opus_readme_url: https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/eng-mul/README.md
489
490
- original_repo: Tatoeba-Challenge
491
492
- tags: ['translation']
493
494
- languages: ['en', 'ca', 'es', 'os', 'eo', 'ro', 'fy', 'cy', 'is', 'lb', 'su', 'an', 'sq', 'fr', 'ht', 'rm', 'cv', 'ig', 'am', 'eu', 'tr', 'ps', 'af', 'ny', 'ch', 'uk', 'sl', 'lt', 'tk', 'sg', 'ar', 'lg', 'bg', 'be', 'ka', 'gd', 'ja', 'si', 'br', 'mh', 'km', 'th', 'ty', 'rw', 'te', 'mk', 'or', 'wo', 'kl', 'mr', 'ru', 'yo', 'hu', 'fo', 'zh', 'ti', 'co', 'ee', 'oc', 'sn', 'mt', 'ts', 'pl', 'gl', 'nb', 'bn', 'tt', 'bo', 'lo', 'id', 'gn', 'nv', 'hy', 'kn', 'to', 'io', 'so', 'vi', 'da', 'fj', 'gv', 'sm', 'nl', 'mi', 'pt', 'hi', 'se', 'as', 'ta', 'et', 'kw', 'ga', 'sv', 'ln', 'na', 'mn', 'gu', 'wa', 'lv', 'jv', 'el', 'my', 'ba', 'it', 'hr', 'ur', 'ce', 'nn', 'fi', 'mg', 'rn', 'xh', 'ab', 'de', 'cs', 'he', 'zu', 'yi', 'ml', 'mul']
495
496
- src_constituents: {'eng'}
497
498
- tgt_constituents: {'sjn_Latn', 'cat', 'nan', 'spa', 'ile_Latn', 'pap', 'mwl', 'uzb_Latn', 'mww', 'hil', 'lij', 'avk_Latn', 'lad_Latn', 'lat_Latn', 'bos_Latn', 'oss', 'epo', 'ron', 'fry', 'cym', 'toi_Latn', 'awa', 'swg', 'zsm_Latn', 'zho_Hant', 'gcf_Latn', 'uzb_Cyrl', 'isl', 'lfn_Latn', 'shs_Latn', 'nov_Latn', 'bho', 'ltz', 'lzh', 'kur_Latn', 'sun', 'arg', 'pes_Thaa', 'sqi', 'uig_Arab', 'csb_Latn', 'fra', 'hat', 'liv_Latn', 'non_Latn', 'sco', 'cmn_Hans', 'pnb', 'roh', 'chv', 'ibo', 'bul_Latn', 'amh', 'lfn_Cyrl', 'eus', 'fkv_Latn', 'tur', 'pus', 'afr', 'brx_Latn', 'nya', 'acm', 'ota_Latn', 'cha', 'ukr', 'xal', 'slv', 'lit', 'zho_Hans', 'tmw_Latn', 'kjh', 'ota_Arab', 'war', 'tuk', 'sag', 'myv', 'hsb', 'lzh_Hans', 'ara', 'tly_Latn', 'lug', 'brx', 'bul', 'bel', 'vol_Latn', 'kat', 'gan', 'got_Goth', 'vro', 'ext', 'afh_Latn', 'gla', 'jpn', 'udm', 'mai', 'ary', 'sin', 'tvl', 'hif_Latn', 'cjy_Hant', 'bre', 'ceb', 'mah', 'nob_Hebr', 'crh_Latn', 'prg_Latn', 'khm', 'ang_Latn', 'tha', 'tah', 'tzl', 'aln', 'kin', 'tel', 'ady', 'mkd', 'ori', 'wol', 'aze_Latn', 'jbo', 'niu', 'kal', 'mar', 'vie_Hani', 'arz', 'yue', 'kha', 'san_Deva', 'jbo_Latn', 'gos', 'hau_Latn', 'rus', 'quc', 'cmn', 'yor', 'hun', 'uig_Cyrl', 'fao', 'mnw', 'zho', 'orv_Cyrl', 'iba', 'bel_Latn', 'tir', 'afb', 'crh', 'mic', 'cos', 'swh', 'sah', 'krl', 'ewe', 'apc', 'zza', 'chr', 'grc_Grek', 'tpw_Latn', 'oci', 'mfe', 'sna', 'kir_Cyrl', 'tat_Latn', 'gom', 'ido_Latn', 'sgs', 'pau', 'tgk_Cyrl', 'nog', 'mlt', 'pdc', 'tso', 'srp_Cyrl', 'pol', 'ast', 'glg', 'pms', 'fuc', 'nob', 'qya', 'ben', 'tat', 'kab', 'min', 'srp_Latn', 'wuu', 'dtp', 'jbo_Cyrl', 'tet', 'bod', 'yue_Hans', 'zlm_Latn', 'lao', 'ind', 'grn', 'nav', 'kaz_Cyrl', 'rom', 'hye', 'kan', 'ton', 'ido', 'mhr', 'scn', 'som', 'rif_Latn', 'vie', 'enm_Latn', 'lmo', 'npi', 'pes', 'dan', 'fij', 'ina_Latn', 'cjy_Hans', 'jdt_Cyrl', 'gsw', 'glv', 'khm_Latn', 'smo', 'umb', 'sma', 'gil', 'nld', 'snd_Arab', 'arq', 'mri', 'kur_Arab', 'por', 'hin', 'shy_Latn', 'sme', 'rap', 'tyv', 'dsb', 'moh', 'asm', 'lad', 'yue_Hant', 'kpv', 'tam', 'est', 'frm_Latn', 'hoc_Latn', 'bam_Latn', 'kek_Latn', 'ksh', 'tlh_Latn', 'ltg', 'pan_Guru', 'hnj_Latn', 'cor', 'gle', 'swe', 'lin', 'qya_Latn', 'kum', 'mad', 'cmn_Hant', 'fuv', 'nau', 'mon', 'akl_Latn', 'guj', 'kaz_Latn', 'wln', 'tuk_Latn', 'jav_Java', 'lav', 'jav', 'ell', 'frr', 'mya', 'bak', 'rue', 'ita', 'hrv', 'izh', 'ilo', 'dws_Latn', 'urd', 'stq', 'tat_Arab', 'haw', 'che', 'pag', 'nno', 'fin', 'mlg', 'ppl_Latn', 'run', 'xho', 'abk', 'deu', 'hoc', 'lkt', 'lld_Latn', 'tzl_Latn', 'mdf', 'ike_Latn', 'ces', 'ldn_Latn', 'egl', 'heb', 'vec', 'zul', 'max_Latn', 'pes_Latn', 'yid', 'mal', 'nds'}
499
500
- src_multilingual: False
501
502
- tgt_multilingual: True
503
504
- prepro:  normalization + SentencePiece (spm32k,spm32k)
505
506
- url_model: https://object.pouta.csc.fi/Tatoeba-MT-models/eng-mul/opus2m-2020-08-01.zip
507
508
- url_test_set: https://object.pouta.csc.fi/Tatoeba-MT-models/eng-mul/opus2m-2020-08-01.test.txt
509
510
- src_alpha3: eng
511
512
- tgt_alpha3: mul
513
514
- short_pair: en-mul
515
516
- chrF2_score: 0.451
517
518
- bleu: 22.4
519
520
- brevity_penalty: 0.987
521
522
- ref_len: 68724.0
523
524
- src_name: English
525
526
- tgt_name: Multiple languages
527
528
- train_date: 2020-08-01
529
530
- src_alpha2: en
531
532
- tgt_alpha2: mul
533
534
- prefer_old: False
535
536
- long_pair: eng-mul
537
538
- helsinki_git_sha: 480fcbe0ee1bf4774bcbe6226ad9f58e63f6c535
539
540
- transformers_git_sha: 2207e5d8cb224e954a7cba69fa4ac2309e9ff30b
541
542
- port_machine: brutasse
543
544
- port_time: 2020-08-21-14:41