system HF staff commited on
Commit
02d74ff
1 Parent(s): 1c84650

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +115 -0
README.md ADDED
@@ -0,0 +1,115 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language: iir
3
+ tags:
4
+ - translation
5
+
6
+ license: apache-2.0
7
+ ---
8
+
9
+ ### iir-eng
10
+
11
+ * source group: Indo-Iranian languages
12
+ * target group: English
13
+ * OPUS readme: [iir-eng](https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/iir-eng/README.md)
14
+
15
+ * model: transformer
16
+ * source language(s): asm awa ben bho gom guj hif_Latn hin jdt_Cyrl kur_Arab kur_Latn mai mar npi ori oss pan_Guru pes pes_Latn pes_Thaa pnb pus rom san_Deva sin snd_Arab tgk_Cyrl tly_Latn urd zza
17
+ * target language(s): eng
18
+ * model: transformer
19
+ * pre-processing: normalization + SentencePiece (spm32k,spm32k)
20
+ * download original weights: [opus2m-2020-08-01.zip](https://object.pouta.csc.fi/Tatoeba-MT-models/iir-eng/opus2m-2020-08-01.zip)
21
+ * test set translations: [opus2m-2020-08-01.test.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/iir-eng/opus2m-2020-08-01.test.txt)
22
+ * test set scores: [opus2m-2020-08-01.eval.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/iir-eng/opus2m-2020-08-01.eval.txt)
23
+
24
+ ## Benchmarks
25
+
26
+ | testset | BLEU | chr-F |
27
+ |-----------------------|-------|-------|
28
+ | newsdev2014-hineng.hin.eng | 8.1 | 0.324 |
29
+ | newsdev2019-engu-gujeng.guj.eng | 8.1 | 0.309 |
30
+ | newstest2014-hien-hineng.hin.eng | 12.1 | 0.380 |
31
+ | newstest2019-guen-gujeng.guj.eng | 6.0 | 0.280 |
32
+ | Tatoeba-test.asm-eng.asm.eng | 13.9 | 0.327 |
33
+ | Tatoeba-test.awa-eng.awa.eng | 7.0 | 0.219 |
34
+ | Tatoeba-test.ben-eng.ben.eng | 42.5 | 0.576 |
35
+ | Tatoeba-test.bho-eng.bho.eng | 27.3 | 0.452 |
36
+ | Tatoeba-test.fas-eng.fas.eng | 5.6 | 0.262 |
37
+ | Tatoeba-test.guj-eng.guj.eng | 15.9 | 0.350 |
38
+ | Tatoeba-test.hif-eng.hif.eng | 10.1 | 0.247 |
39
+ | Tatoeba-test.hin-eng.hin.eng | 36.5 | 0.544 |
40
+ | Tatoeba-test.jdt-eng.jdt.eng | 11.4 | 0.094 |
41
+ | Tatoeba-test.kok-eng.kok.eng | 6.6 | 0.256 |
42
+ | Tatoeba-test.kur-eng.kur.eng | 3.4 | 0.149 |
43
+ | Tatoeba-test.lah-eng.lah.eng | 17.4 | 0.301 |
44
+ | Tatoeba-test.mai-eng.mai.eng | 65.4 | 0.703 |
45
+ | Tatoeba-test.mar-eng.mar.eng | 22.5 | 0.468 |
46
+ | Tatoeba-test.multi.eng | 21.3 | 0.424 |
47
+ | Tatoeba-test.nep-eng.nep.eng | 3.4 | 0.185 |
48
+ | Tatoeba-test.ori-eng.ori.eng | 4.8 | 0.244 |
49
+ | Tatoeba-test.oss-eng.oss.eng | 1.6 | 0.173 |
50
+ | Tatoeba-test.pan-eng.pan.eng | 14.8 | 0.348 |
51
+ | Tatoeba-test.pus-eng.pus.eng | 1.1 | 0.182 |
52
+ | Tatoeba-test.rom-eng.rom.eng | 2.8 | 0.185 |
53
+ | Tatoeba-test.san-eng.san.eng | 2.8 | 0.185 |
54
+ | Tatoeba-test.sin-eng.sin.eng | 22.8 | 0.474 |
55
+ | Tatoeba-test.snd-eng.snd.eng | 8.2 | 0.287 |
56
+ | Tatoeba-test.tgk-eng.tgk.eng | 11.9 | 0.321 |
57
+ | Tatoeba-test.tly-eng.tly.eng | 0.9 | 0.076 |
58
+ | Tatoeba-test.urd-eng.urd.eng | 23.9 | 0.438 |
59
+ | Tatoeba-test.zza-eng.zza.eng | 0.6 | 0.098 |
60
+
61
+
62
+ ### System Info:
63
+ - hf_name: iir-eng
64
+
65
+ - source_languages: iir
66
+
67
+ - target_languages: eng
68
+
69
+ - opus_readme_url: https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/iir-eng/README.md
70
+
71
+ - original_repo: Tatoeba-Challenge
72
+
73
+ - tags: ['translation']
74
+
75
+ - prepro: normalization + SentencePiece (spm32k,spm32k)
76
+
77
+ - url_model: https://object.pouta.csc.fi/Tatoeba-MT-models/iir-eng/opus2m-2020-08-01.zip
78
+
79
+ - url_test_set: https://object.pouta.csc.fi/Tatoeba-MT-models/iir-eng/opus2m-2020-08-01.test.txt
80
+
81
+ - src_alpha3: iir
82
+
83
+ - tgt_alpha3: eng
84
+
85
+ - short_pair: iir-en
86
+
87
+ - chrF2_score: 0.424
88
+
89
+ - bleu: 21.3
90
+
91
+ - brevity_penalty: 1.0
92
+
93
+ - ref_len: 67026.0
94
+
95
+ - src_name: Indo-Iranian languages
96
+
97
+ - tgt_name: English
98
+
99
+ - train_date: 2020-08-01
100
+
101
+ - src_alpha2: iir
102
+
103
+ - tgt_alpha2: en
104
+
105
+ - prefer_old: False
106
+
107
+ - long_pair: iir-eng
108
+
109
+ - helsinki_git_sha: 480fcbe0ee1bf4774bcbe6226ad9f58e63f6c535
110
+
111
+ - transformers_git_sha: 46e9f53347bbe9e989f0335f98465f30886d8173
112
+
113
+ - port_machine: brutasse
114
+
115
+ - port_time: 2020-08-18-01:48