| Model description: eng-cat | |
| Date: 2023-10-30 | |
| TF version 2.10.0, OpenNMT version 2.29.1, CTranslate2 version 3.20.0 | |
| Test data set | |
| BLEU|nrefs:1|bs:1000|seed:12345|case:mixed|eff:no|tok:13a|smooth:exp|version:2.1.0 = 46.9 (μ = 46.9 ± 0.4) 71.7/52.5/41.0/32.6 (BP = 0.989 ratio = 0.989 hyp_len = 374814 ref_len = 378948) | |
| chrF2|nrefs:1|bs:1000|seed:12345|case:mixed|eff:yes|nc:6|nw:0|space:no|version:2.1.0 = 68.7 (μ = 68.7 ± 0.3) | |
| Flores data set | |
| BLEU|nrefs:1|bs:1000|seed:12345|case:mixed|eff:no|tok:13a|smooth:exp|version:2.1.0 = 43.8 (μ = 43.8 ± 1.1) 71.4/50.4/37.7/28.6 (BP = 0.987 ratio = 0.987 hyp_len = 26956 ref_len = 27304) | |
| chrF2|nrefs:1|bs:1000|seed:12345|case:mixed|eff:yes|nc:6|nw:0|space:no|version:2.1.0 = 67.2 (μ = 67.2 ± 0.8) | |