---
language:
- ko
- fr

tags:
- translation

license: apache-2.0
---

### kor-fra

* source group: Korean
* target group: French
*  OPUS readme: [kor-fra](https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/kor-fra/README.md)

*  model: transformer-align
* source language(s): kor kor_Hang kor_Hani kor_Latn
* target language(s): fra
* model: transformer-align
* pre-processing: normalization + SentencePiece (spm32k,spm32k)
* download original weights: [opus-2020-06-17.zip](https://object.pouta.csc.fi/Tatoeba-MT-models/kor-fra/opus-2020-06-17.zip)
* test set translations: [opus-2020-06-17.test.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/kor-fra/opus-2020-06-17.test.txt)
* test set scores: [opus-2020-06-17.eval.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/kor-fra/opus-2020-06-17.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| Tatoeba-test.kor.fra 	| 30.4 	| 0.503 |

### System Info:
- hf_name: kor-fra

- source_languages: kor

- target_languages: fra

- opus_readme_url: https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/kor-fra/README.md

- original_repo: Tatoeba-Challenge

- tags: ['translation']

- languages: ['ko', 'fr']

- src_constituents: {'kor_Hani', 'kor_Hang', 'kor_Latn', 'kor'}

- tgt_constituents: {'fra'}

- src_multilingual: False

- tgt_multilingual: False

- prepro:  normalization + SentencePiece (spm32k,spm32k)

- url_model: https://object.pouta.csc.fi/Tatoeba-MT-models/kor-fra/opus-2020-06-17.zip

- url_test_set: https://object.pouta.csc.fi/Tatoeba-MT-models/kor-fra/opus-2020-06-17.test.txt

- src_alpha3: kor

- tgt_alpha3: fra

- short_pair: ko-fr

- chrF2_score: 0.503

- bleu: 30.4

- brevity_penalty: 0.9179999999999999

- ref_len: 2714.0

- src_name: Korean

- tgt_name: French

- train_date: 2020-06-17

- src_alpha2: ko

- tgt_alpha2: fr

- prefer_old: False

- long_pair: kor-fra

- helsinki_git_sha: 480fcbe0ee1bf4774bcbe6226ad9f58e63f6c535

- transformers_git_sha: 2207e5d8cb224e954a7cba69fa4ac2309e9ff30b

- port_machine: brutasse

- port_time: 2020-08-21-14:41


---
tags:
- translation
license: apache-2.0
---

### opus-mt-pag-es

* source languages: pag
* target languages: es
*  OPUS readme: [pag-es](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/pag-es/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-16.zip](https://object.pouta.csc.fi/OPUS-MT-models/pag-es/opus-2020-01-16.zip)
* test set translations: [opus-2020-01-16.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/pag-es/opus-2020-01-16.test.txt)
* test set scores: [opus-2020-01-16.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/pag-es/opus-2020-01-16.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| JW300.pag.es 	| 27.9 	| 0.459 |


---
language:
- en
- es

tags:
- translation

license: apache-2.0
---

### eng-spa

* source group: English
* target group: Spanish
*  OPUS readme: [eng-spa](https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/eng-spa/README.md)

*  model: transformer
* source language(s): eng
* target language(s): spa
* model: transformer
* pre-processing: normalization + SentencePiece (spm32k,spm32k)
* download original weights: [opus-2020-08-18.zip](https://object.pouta.csc.fi/Tatoeba-MT-models/eng-spa/opus-2020-08-18.zip)
* test set translations: [opus-2020-08-18.test.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/eng-spa/opus-2020-08-18.test.txt)
* test set scores: [opus-2020-08-18.eval.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/eng-spa/opus-2020-08-18.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| newssyscomb2009-engspa.eng.spa 	| 31.0 	| 0.583 |
| news-test2008-engspa.eng.spa 	| 29.7 	| 0.564 |
| newstest2009-engspa.eng.spa 	| 30.2 	| 0.578 |
| newstest2010-engspa.eng.spa 	| 36.9 	| 0.620 |
| newstest2011-engspa.eng.spa 	| 38.2 	| 0.619 |
| newstest2012-engspa.eng.spa 	| 39.0 	| 0.625 |
| newstest2013-engspa.eng.spa 	| 35.0 	| 0.598 |
| Tatoeba-test.eng.spa 	| 54.9 	| 0.721 |

### System Info:
- hf_name: eng-spa

- source_languages: eng

- target_languages: spa

- opus_readme_url: https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/eng-spa/README.md

- original_repo: Tatoeba-Challenge

- tags: ['translation']

- languages: ['en', 'es']

- src_constituents: {'eng'}

- tgt_constituents: {'spa'}

- src_multilingual: False

- tgt_multilingual: False

- prepro:  normalization + SentencePiece (spm32k,spm32k)

- url_model: https://object.pouta.csc.fi/Tatoeba-MT-models/eng-spa/opus-2020-08-18.zip

- url_test_set: https://object.pouta.csc.fi/Tatoeba-MT-models/eng-spa/opus-2020-08-18.test.txt

- src_alpha3: eng

- tgt_alpha3: spa

- short_pair: en-es

- chrF2_score: 0.721

- bleu: 54.9

- brevity_penalty: 0.978

- ref_len: 77311.0

- src_name: English

- tgt_name: Spanish

- train_date: 2020-08-18 00:00:00

- src_alpha2: en

- tgt_alpha2: es

- prefer_old: False

- long_pair: eng-spa

- helsinki_git_sha: d2f0910c89026c34a44e331e785dec1e0faa7b82

- transformers_git_sha: f7af09b4524b784d67ae8526f0e2fcc6f5ed0de9

- port_machine: brutasse

- port_time: 2020-08-24-18:20


---
tags:
- translation
license: apache-2.0
---

### opus-mt-en-ny

* source languages: en
* target languages: ny
*  OPUS readme: [en-ny](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/en-ny/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-08.zip](https://object.pouta.csc.fi/OPUS-MT-models/en-ny/opus-2020-01-08.zip)
* test set translations: [opus-2020-01-08.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/en-ny/opus-2020-01-08.test.txt)
* test set scores: [opus-2020-01-08.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/en-ny/opus-2020-01-08.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| JW300.en.ny 	| 31.4 	| 0.570 |
| Tatoeba.en.ny 	| 26.8 	| 0.645 |


---
language:
- rn
- en

tags:
- translation

license: apache-2.0
---

### run-eng

* source group: Rundi
* target group: English
*  OPUS readme: [run-eng](https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/run-eng/README.md)

*  model: transformer-align
* source language(s): run
* target language(s): eng
* model: transformer-align
* pre-processing: normalization + SentencePiece (spm4k,spm4k)
* download original weights: [opus-2020-06-16.zip](https://object.pouta.csc.fi/Tatoeba-MT-models/run-eng/opus-2020-06-16.zip)
* test set translations: [opus-2020-06-16.test.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/run-eng/opus-2020-06-16.test.txt)
* test set scores: [opus-2020-06-16.eval.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/run-eng/opus-2020-06-16.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| Tatoeba-test.run.eng 	| 26.7 	| 0.428 |

### System Info:
- hf_name: run-eng

- source_languages: run

- target_languages: eng

- opus_readme_url: https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/run-eng/README.md

- original_repo: Tatoeba-Challenge

- tags: ['translation']

- languages: ['rn', 'en']

- src_constituents: {'run'}

- tgt_constituents: {'eng'}

- src_multilingual: False

- tgt_multilingual: False

- prepro:  normalization + SentencePiece (spm4k,spm4k)

- url_model: https://object.pouta.csc.fi/Tatoeba-MT-models/run-eng/opus-2020-06-16.zip

- url_test_set: https://object.pouta.csc.fi/Tatoeba-MT-models/run-eng/opus-2020-06-16.test.txt

- src_alpha3: run

- tgt_alpha3: eng

- short_pair: rn-en

- chrF2_score: 0.428

- bleu: 26.7

- brevity_penalty: 0.99

- ref_len: 10041.0

- src_name: Rundi

- tgt_name: English

- train_date: 2020-06-16

- src_alpha2: rn

- tgt_alpha2: en

- prefer_old: False

- long_pair: run-eng

- helsinki_git_sha: 480fcbe0ee1bf4774bcbe6226ad9f58e63f6c535

- transformers_git_sha: 2207e5d8cb224e954a7cba69fa4ac2309e9ff30b

- port_machine: brutasse

- port_time: 2020-08-21-14:41


---
tags:
- translation
license: apache-2.0
---

### opus-mt-zne-fr

* source languages: zne
* target languages: fr
*  OPUS readme: [zne-fr](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/zne-fr/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-16.zip](https://object.pouta.csc.fi/OPUS-MT-models/zne-fr/opus-2020-01-16.zip)
* test set translations: [opus-2020-01-16.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/zne-fr/opus-2020-01-16.test.txt)
* test set scores: [opus-2020-01-16.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/zne-fr/opus-2020-01-16.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| JW300.zne.fr 	| 25.3 	| 0.416 |


---
tags:
- translation
license: apache-2.0
---

### opus-mt-mt-fr

* source languages: mt
* target languages: fr
*  OPUS readme: [mt-fr](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/mt-fr/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-16.zip](https://object.pouta.csc.fi/OPUS-MT-models/mt-fr/opus-2020-01-16.zip)
* test set translations: [opus-2020-01-16.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/mt-fr/opus-2020-01-16.test.txt)
* test set scores: [opus-2020-01-16.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/mt-fr/opus-2020-01-16.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| JW300.mt.fr 	| 27.2 	| 0.475 |


---
tags:
- translation
license: apache-2.0
---

### opus-mt-es-tpi

* source languages: es
* target languages: tpi
*  OPUS readme: [es-tpi](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/es-tpi/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-16.zip](https://object.pouta.csc.fi/OPUS-MT-models/es-tpi/opus-2020-01-16.zip)
* test set translations: [opus-2020-01-16.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/es-tpi/opus-2020-01-16.test.txt)
* test set scores: [opus-2020-01-16.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/es-tpi/opus-2020-01-16.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| JW300.es.tpi 	| 27.0 	| 0.472 |


---
tags:
- translation
license: apache-2.0
---

### opus-mt-sv-mt

* source languages: sv
* target languages: mt
*  OPUS readme: [sv-mt](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/sv-mt/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-16.zip](https://object.pouta.csc.fi/OPUS-MT-models/sv-mt/opus-2020-01-16.zip)
* test set translations: [opus-2020-01-16.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/sv-mt/opus-2020-01-16.test.txt)
* test set scores: [opus-2020-01-16.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/sv-mt/opus-2020-01-16.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| JW300.sv.mt 	| 32.2 	| 0.509 |


---
tags:
- translation
license: apache-2.0
---

### opus-mt-tw-fi

* source languages: tw
* target languages: fi
*  OPUS readme: [tw-fi](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/tw-fi/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-24.zip](https://object.pouta.csc.fi/OPUS-MT-models/tw-fi/opus-2020-01-24.zip)
* test set translations: [opus-2020-01-24.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/tw-fi/opus-2020-01-24.test.txt)
* test set scores: [opus-2020-01-24.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/tw-fi/opus-2020-01-24.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| JW300.tw.fi 	| 25.6 	| 0.488 |


---
language:
- no
- pl

tags:
- translation

license: apache-2.0
---

### nor-pol

* source group: Norwegian
* target group: Polish
*  OPUS readme: [nor-pol](https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/nor-pol/README.md)

*  model: transformer-align
* source language(s): nob
* target language(s): pol
* model: transformer-align
* pre-processing: normalization + SentencePiece (spm4k,spm4k)
* download original weights: [opus-2020-06-17.zip](https://object.pouta.csc.fi/Tatoeba-MT-models/nor-pol/opus-2020-06-17.zip)
* test set translations: [opus-2020-06-17.test.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/nor-pol/opus-2020-06-17.test.txt)
* test set scores: [opus-2020-06-17.eval.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/nor-pol/opus-2020-06-17.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| Tatoeba-test.nor.pol 	| 20.9 	| 0.455 |

### System Info:
- hf_name: nor-pol

- source_languages: nor

- target_languages: pol

- opus_readme_url: https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/nor-pol/README.md

- original_repo: Tatoeba-Challenge

- tags: ['translation']

- languages: ['no', 'pl']

- src_constituents: {'nob', 'nno'}

- tgt_constituents: {'pol'}

- src_multilingual: False

- tgt_multilingual: False

- prepro:  normalization + SentencePiece (spm4k,spm4k)

- url_model: https://object.pouta.csc.fi/Tatoeba-MT-models/nor-pol/opus-2020-06-17.zip

- url_test_set: https://object.pouta.csc.fi/Tatoeba-MT-models/nor-pol/opus-2020-06-17.test.txt

- src_alpha3: nor

- tgt_alpha3: pol

- short_pair: no-pl

- chrF2_score: 0.455

- bleu: 20.9

- brevity_penalty: 0.941

- ref_len: 1828.0

- src_name: Norwegian

- tgt_name: Polish

- train_date: 2020-06-17

- src_alpha2: no

- tgt_alpha2: pl

- prefer_old: False

- long_pair: nor-pol

- helsinki_git_sha: 480fcbe0ee1bf4774bcbe6226ad9f58e63f6c535

- transformers_git_sha: 2207e5d8cb224e954a7cba69fa4ac2309e9ff30b

- port_machine: brutasse

- port_time: 2020-08-21-14:41


---
tags:
- translation
license: apache-2.0
---

### opus-mt-sv-pap

* source languages: sv
* target languages: pap
*  OPUS readme: [sv-pap](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/sv-pap/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-21.zip](https://object.pouta.csc.fi/OPUS-MT-models/sv-pap/opus-2020-01-21.zip)
* test set translations: [opus-2020-01-21.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/sv-pap/opus-2020-01-21.test.txt)
* test set scores: [opus-2020-01-21.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/sv-pap/opus-2020-01-21.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| JW300.sv.pap 	| 31.0 	| 0.505 |


---
tags:
- translation
license: apache-2.0
---

### opus-mt-es-es

* source languages: es
* target languages: es
*  OPUS readme: [es-es](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/es-es/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-20.zip](https://object.pouta.csc.fi/OPUS-MT-models/es-es/opus-2020-01-20.zip)
* test set translations: [opus-2020-01-20.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/es-es/opus-2020-01-20.test.txt)
* test set scores: [opus-2020-01-20.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/es-es/opus-2020-01-20.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| Tatoeba.es.es 	| 51.7 	| 0.688 |


---
language:
- bg
- fr

tags:
- translation

license: apache-2.0
---

### bul-fra

* source group: Bulgarian
* target group: French
*  OPUS readme: [bul-fra](https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/bul-fra/README.md)

*  model: transformer
* source language(s): bul
* target language(s): fra
* model: transformer
* pre-processing: normalization + SentencePiece (spm32k,spm32k)
* download original weights: [opus-2020-07-03.zip](https://object.pouta.csc.fi/Tatoeba-MT-models/bul-fra/opus-2020-07-03.zip)
* test set translations: [opus-2020-07-03.test.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/bul-fra/opus-2020-07-03.test.txt)
* test set scores: [opus-2020-07-03.eval.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/bul-fra/opus-2020-07-03.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| Tatoeba-test.bul.fra 	| 53.7 	| 0.693 |

### System Info:
- hf_name: bul-fra

- source_languages: bul

- target_languages: fra

- opus_readme_url: https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/bul-fra/README.md

- original_repo: Tatoeba-Challenge

- tags: ['translation']

- languages: ['bg', 'fr']

- src_constituents: {'bul', 'bul_Latn'}

- tgt_constituents: {'fra'}

- src_multilingual: False

- tgt_multilingual: False

- prepro:  normalization + SentencePiece (spm32k,spm32k)

- url_model: https://object.pouta.csc.fi/Tatoeba-MT-models/bul-fra/opus-2020-07-03.zip

- url_test_set: https://object.pouta.csc.fi/Tatoeba-MT-models/bul-fra/opus-2020-07-03.test.txt

- src_alpha3: bul

- tgt_alpha3: fra

- short_pair: bg-fr

- chrF2_score: 0.693

- bleu: 53.7

- brevity_penalty: 0.977

- ref_len: 3669.0

- src_name: Bulgarian

- tgt_name: French

- train_date: 2020-07-03

- src_alpha2: bg

- tgt_alpha2: fr

- prefer_old: False

- long_pair: bul-fra

- helsinki_git_sha: 480fcbe0ee1bf4774bcbe6226ad9f58e63f6c535

- transformers_git_sha: 2207e5d8cb224e954a7cba69fa4ac2309e9ff30b

- port_machine: brutasse

- port_time: 2020-08-21-14:41


---
tags:
- translation
license: apache-2.0
---

### opus-mt-cs-de

* source languages: cs
* target languages: de
*  OPUS readme: [cs-de](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/cs-de/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-20.zip](https://object.pouta.csc.fi/OPUS-MT-models/cs-de/opus-2020-01-20.zip)
* test set translations: [opus-2020-01-20.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/cs-de/opus-2020-01-20.test.txt)
* test set scores: [opus-2020-01-20.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/cs-de/opus-2020-01-20.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| newssyscomb2009.cs.de 	| 22.0 	| 0.525 |
| news-test2008.cs.de 	| 21.1 	| 0.520 |
| newstest2009.cs.de 	| 22.2 	| 0.525 |
| newstest2010.cs.de 	| 22.1 	| 0.527 |
| newstest2011.cs.de 	| 21.6 	| 0.515 |
| newstest2012.cs.de 	| 22.2 	| 0.516 |
| newstest2013.cs.de 	| 24.8 	| 0.538 |
| newstest2019-csde.cs.de 	| 23.6 	| 0.530 |
| Tatoeba.cs.de 	| 51.6 	| 0.687 |


---
language:
- ru
- et

tags:
- translation

license: apache-2.0
---

### rus-est

* source group: Russian
* target group: Estonian
*  OPUS readme: [rus-est](https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/rus-est/README.md)

*  model: transformer-align
* source language(s): rus
* target language(s): est
* model: transformer-align
* pre-processing: normalization + SentencePiece (spm32k,spm32k)
* download original weights: [opus-2020-06-17.zip](https://object.pouta.csc.fi/Tatoeba-MT-models/rus-est/opus-2020-06-17.zip)
* test set translations: [opus-2020-06-17.test.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/rus-est/opus-2020-06-17.test.txt)
* test set scores: [opus-2020-06-17.eval.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/rus-est/opus-2020-06-17.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| Tatoeba-test.rus.est 	| 57.5 	| 0.749 |

### System Info:
- hf_name: rus-est

- source_languages: rus

- target_languages: est

- opus_readme_url: https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/rus-est/README.md

- original_repo: Tatoeba-Challenge

- tags: ['translation']

- languages: ['ru', 'et']

- src_constituents: {'rus'}

- tgt_constituents: {'est'}

- src_multilingual: False

- tgt_multilingual: False

- prepro:  normalization + SentencePiece (spm32k,spm32k)

- url_model: https://object.pouta.csc.fi/Tatoeba-MT-models/rus-est/opus-2020-06-17.zip

- url_test_set: https://object.pouta.csc.fi/Tatoeba-MT-models/rus-est/opus-2020-06-17.test.txt

- src_alpha3: rus

- tgt_alpha3: est

- short_pair: ru-et

- chrF2_score: 0.7490000000000001

- bleu: 57.5

- brevity_penalty: 0.975

- ref_len: 3572.0

- src_name: Russian

- tgt_name: Estonian

- train_date: 2020-06-17

- src_alpha2: ru

- tgt_alpha2: et

- prefer_old: False

- long_pair: rus-est

- helsinki_git_sha: 480fcbe0ee1bf4774bcbe6226ad9f58e63f6c535

- transformers_git_sha: 2207e5d8cb224e954a7cba69fa4ac2309e9ff30b

- port_machine: brutasse

- port_time: 2020-08-21-14:41


---
tags:
- translation
license: apache-2.0
---

### opus-mt-sv-ee

* source languages: sv
* target languages: ee
*  OPUS readme: [sv-ee](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/sv-ee/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-16.zip](https://object.pouta.csc.fi/OPUS-MT-models/sv-ee/opus-2020-01-16.zip)
* test set translations: [opus-2020-01-16.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/sv-ee/opus-2020-01-16.test.txt)
* test set scores: [opus-2020-01-16.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/sv-ee/opus-2020-01-16.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| JW300.sv.ee 	| 29.7 	| 0.508 |


---
language:
- da
- ru

tags:
- translation

license: apache-2.0
---

### dan-rus

* source group: Danish
* target group: Russian
*  OPUS readme: [dan-rus](https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/dan-rus/README.md)

*  model: transformer-align
* source language(s): dan
* target language(s): rus
* model: transformer-align
* pre-processing: normalization + SentencePiece (spm32k,spm32k)
* download original weights: [opus-2020-06-17.zip](https://object.pouta.csc.fi/Tatoeba-MT-models/dan-rus/opus-2020-06-17.zip)
* test set translations: [opus-2020-06-17.test.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/dan-rus/opus-2020-06-17.test.txt)
* test set scores: [opus-2020-06-17.eval.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/dan-rus/opus-2020-06-17.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| Tatoeba-test.dan.rus 	| 52.5 	| 0.715 |

### System Info:
- hf_name: dan-rus

- source_languages: dan

- target_languages: rus

- opus_readme_url: https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/dan-rus/README.md

- original_repo: Tatoeba-Challenge

- tags: ['translation']

- languages: ['da', 'ru']

- src_constituents: {'dan'}

- tgt_constituents: {'rus'}

- src_multilingual: False

- tgt_multilingual: False

- prepro:  normalization + SentencePiece (spm32k,spm32k)

- url_model: https://object.pouta.csc.fi/Tatoeba-MT-models/dan-rus/opus-2020-06-17.zip

- url_test_set: https://object.pouta.csc.fi/Tatoeba-MT-models/dan-rus/opus-2020-06-17.test.txt

- src_alpha3: dan

- tgt_alpha3: rus

- short_pair: da-ru

- chrF2_score: 0.715

- bleu: 52.5

- brevity_penalty: 0.991

- ref_len: 10480.0

- src_name: Danish

- tgt_name: Russian

- train_date: 2020-06-17

- src_alpha2: da

- tgt_alpha2: ru

- prefer_old: False

- long_pair: dan-rus

- helsinki_git_sha: 480fcbe0ee1bf4774bcbe6226ad9f58e63f6c535

- transformers_git_sha: 2207e5d8cb224e954a7cba69fa4ac2309e9ff30b

- port_machine: brutasse

- port_time: 2020-08-21-14:41


---
tags:
- translation
license: apache-2.0
---

### opus-mt-hi-en

* source languages: hi
* target languages: en
*  OPUS readme: [hi-en](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/hi-en/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2019-12-18.zip](https://object.pouta.csc.fi/OPUS-MT-models/hi-en/opus-2019-12-18.zip)
* test set translations: [opus-2019-12-18.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/hi-en/opus-2019-12-18.test.txt)
* test set scores: [opus-2019-12-18.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/hi-en/opus-2019-12-18.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| newsdev2014.hi.en 	| 9.1 	| 0.357 |
| newstest2014-hien.hi.en 	| 13.6 	| 0.409 |
| Tatoeba.hi.en 	| 40.4 	| 0.580 |


---
language:
- az
- tr

tags:
- translation

license: apache-2.0
---

### aze-tur

* source group: Azerbaijani
* target group: Turkish
*  OPUS readme: [aze-tur](https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/aze-tur/README.md)

*  model: transformer-align
* source language(s): aze_Latn
* target language(s): tur
* model: transformer-align
* pre-processing: normalization + SentencePiece (spm4k,spm4k)
* download original weights: [opus-2020-06-16.zip](https://object.pouta.csc.fi/Tatoeba-MT-models/aze-tur/opus-2020-06-16.zip)
* test set translations: [opus-2020-06-16.test.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/aze-tur/opus-2020-06-16.test.txt)
* test set scores: [opus-2020-06-16.eval.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/aze-tur/opus-2020-06-16.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| Tatoeba-test.aze.tur 	| 24.4 	| 0.529 |

### System Info:
- hf_name: aze-tur

- source_languages: aze

- target_languages: tur

- opus_readme_url: https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/aze-tur/README.md

- original_repo: Tatoeba-Challenge

- tags: ['translation']

- languages: ['az', 'tr']

- src_constituents: {'aze_Latn'}

- tgt_constituents: {'tur'}

- src_multilingual: False

- tgt_multilingual: False

- prepro:  normalization + SentencePiece (spm4k,spm4k)

- url_model: https://object.pouta.csc.fi/Tatoeba-MT-models/aze-tur/opus-2020-06-16.zip

- url_test_set: https://object.pouta.csc.fi/Tatoeba-MT-models/aze-tur/opus-2020-06-16.test.txt

- src_alpha3: aze

- tgt_alpha3: tur

- short_pair: az-tr

- chrF2_score: 0.529

- bleu: 24.4

- brevity_penalty: 0.956

- ref_len: 5380.0

- src_name: Azerbaijani

- tgt_name: Turkish

- train_date: 2020-06-16

- src_alpha2: az

- tgt_alpha2: tr

- prefer_old: False

- long_pair: aze-tur

- helsinki_git_sha: 480fcbe0ee1bf4774bcbe6226ad9f58e63f6c535

- transformers_git_sha: 2207e5d8cb224e954a7cba69fa4ac2309e9ff30b

- port_machine: brutasse

- port_time: 2020-08-21-14:41


---
tags:
- translation
license: apache-2.0
---

### opus-mt-bem-es

* source languages: bem
* target languages: es
*  OPUS readme: [bem-es](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/bem-es/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-15.zip](https://object.pouta.csc.fi/OPUS-MT-models/bem-es/opus-2020-01-15.zip)
* test set translations: [opus-2020-01-15.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/bem-es/opus-2020-01-15.test.txt)
* test set scores: [opus-2020-01-15.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/bem-es/opus-2020-01-15.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| JW300.bem.es 	| 22.8 	| 0.403 |


---
tags:
- translation
license: apache-2.0
---

### opus-mt-tr-en

* source languages: tr
* target languages: en
*  OPUS readme: [tr-en](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/tr-en/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-16.zip](https://object.pouta.csc.fi/OPUS-MT-models/tr-en/opus-2020-01-16.zip)
* test set translations: [opus-2020-01-16.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/tr-en/opus-2020-01-16.test.txt)
* test set scores: [opus-2020-01-16.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/tr-en/opus-2020-01-16.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| newsdev2016-entr.tr.en 	| 27.6 	| 0.548 |
| newstest2016-entr.tr.en 	| 25.2 	| 0.532 |
| newstest2017-entr.tr.en 	| 24.7 	| 0.530 |
| newstest2018-entr.tr.en 	| 27.0 	| 0.547 |
| Tatoeba.tr.en 	| 63.5 	| 0.760 |


---
tags:
- translation
license: apache-2.0
---

### opus-mt-kl-en

* source languages: kl
* target languages: en
*  OPUS readme: [kl-en](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/kl-en/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-09.zip](https://object.pouta.csc.fi/OPUS-MT-models/kl-en/opus-2020-01-09.zip)
* test set translations: [opus-2020-01-09.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/kl-en/opus-2020-01-09.test.txt)
* test set scores: [opus-2020-01-09.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/kl-en/opus-2020-01-09.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| JW300.kl.en 	| 26.4 	| 0.432 |
| Tatoeba.kl.en 	| 35.5 	| 0.443 |


---
tags:
- translation
license: apache-2.0
---

### opus-mt-es-prl

* source languages: es
* target languages: prl
*  OPUS readme: [es-prl](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/es-prl/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-16.zip](https://object.pouta.csc.fi/OPUS-MT-models/es-prl/opus-2020-01-16.zip)
* test set translations: [opus-2020-01-16.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/es-prl/opus-2020-01-16.test.txt)
* test set scores: [opus-2020-01-16.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/es-prl/opus-2020-01-16.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| JW300.es.prl 	| 92.2 	| 0.950 |


---
tags:
- translation
license: apache-2.0
---

### opus-mt-lu-fr

* source languages: lu
* target languages: fr
*  OPUS readme: [lu-fr](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/lu-fr/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-21.zip](https://object.pouta.csc.fi/OPUS-MT-models/lu-fr/opus-2020-01-21.zip)
* test set translations: [opus-2020-01-21.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/lu-fr/opus-2020-01-21.test.txt)
* test set scores: [opus-2020-01-21.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/lu-fr/opus-2020-01-21.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| JW300.lu.fr 	| 26.4 	| 0.431 |


---
tags:
- translation
license: apache-2.0
---

### opus-mt-lua-en

* source languages: lua
* target languages: en
*  OPUS readme: [lua-en](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/lua-en/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-09.zip](https://object.pouta.csc.fi/OPUS-MT-models/lua-en/opus-2020-01-09.zip)
* test set translations: [opus-2020-01-09.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/lua-en/opus-2020-01-09.test.txt)
* test set scores: [opus-2020-01-09.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/lua-en/opus-2020-01-09.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| JW300.lua.en 	| 34.4 	| 0.502 |


---
tags:
- translation
license: apache-2.0
---

### opus-mt-de-hr

* source languages: de
* target languages: hr
*  OPUS readme: [de-hr](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/de-hr/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-26.zip](https://object.pouta.csc.fi/OPUS-MT-models/de-hr/opus-2020-01-26.zip)
* test set translations: [opus-2020-01-26.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/de-hr/opus-2020-01-26.test.txt)
* test set scores: [opus-2020-01-26.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/de-hr/opus-2020-01-26.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| Tatoeba.de.hr 	| 42.6 	| 0.643 |


---
tags:
- translation
license: apache-2.0
---

### opus-mt-gaa-es

* source languages: gaa
* target languages: es
*  OPUS readme: [gaa-es](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/gaa-es/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-16.zip](https://object.pouta.csc.fi/OPUS-MT-models/gaa-es/opus-2020-01-16.zip)
* test set translations: [opus-2020-01-16.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/gaa-es/opus-2020-01-16.test.txt)
* test set scores: [opus-2020-01-16.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/gaa-es/opus-2020-01-16.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| JW300.gaa.es 	| 28.6 	| 0.463 |


---
tags:
- translation
license: apache-2.0
---

### opus-mt-en-nso

* source languages: en
* target languages: nso
*  OPUS readme: [en-nso](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/en-nso/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-08.zip](https://object.pouta.csc.fi/OPUS-MT-models/en-nso/opus-2020-01-08.zip)
* test set translations: [opus-2020-01-08.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/en-nso/opus-2020-01-08.test.txt)
* test set scores: [opus-2020-01-08.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/en-nso/opus-2020-01-08.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| JW300.en.nso 	| 52.2 	| 0.684 |


---
tags:
- translation
license: apache-2.0
---

### opus-mt-fi-zne

* source languages: fi
* target languages: zne
*  OPUS readme: [fi-zne](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/fi-zne/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-09.zip](https://object.pouta.csc.fi/OPUS-MT-models/fi-zne/opus-2020-01-09.zip)
* test set translations: [opus-2020-01-09.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/fi-zne/opus-2020-01-09.test.txt)
* test set scores: [opus-2020-01-09.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/fi-zne/opus-2020-01-09.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| JW300.fi.zne 	| 22.7 	| 0.464 |


---
language:
- fi
- eo

tags:
- translation

license: apache-2.0
---

### fin-epo

* source group: Finnish
* target group: Esperanto
*  OPUS readme: [fin-epo](https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/fin-epo/README.md)

*  model: transformer-align
* source language(s): fin
* target language(s): epo
* model: transformer-align
* pre-processing: normalization + SentencePiece (spm4k,spm4k)
* download original weights: [opus-2020-06-16.zip](https://object.pouta.csc.fi/Tatoeba-MT-models/fin-epo/opus-2020-06-16.zip)
* test set translations: [opus-2020-06-16.test.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/fin-epo/opus-2020-06-16.test.txt)
* test set scores: [opus-2020-06-16.eval.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/fin-epo/opus-2020-06-16.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| Tatoeba-test.fin.epo 	| 22.5 	| 0.413 |

### System Info:
- hf_name: fin-epo

- source_languages: fin

- target_languages: epo

- opus_readme_url: https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/fin-epo/README.md

- original_repo: Tatoeba-Challenge

- tags: ['translation']

- languages: ['fi', 'eo']

- src_constituents: {'fin'}

- tgt_constituents: {'epo'}

- src_multilingual: False

- tgt_multilingual: False

- prepro:  normalization + SentencePiece (spm4k,spm4k)

- url_model: https://object.pouta.csc.fi/Tatoeba-MT-models/fin-epo/opus-2020-06-16.zip

- url_test_set: https://object.pouta.csc.fi/Tatoeba-MT-models/fin-epo/opus-2020-06-16.test.txt

- src_alpha3: fin

- tgt_alpha3: epo

- short_pair: fi-eo

- chrF2_score: 0.413

- bleu: 22.5

- brevity_penalty: 0.9490000000000001

- ref_len: 18881.0

- src_name: Finnish

- tgt_name: Esperanto

- train_date: 2020-06-16

- src_alpha2: fi

- tgt_alpha2: eo

- prefer_old: False

- long_pair: fin-epo

- helsinki_git_sha: 480fcbe0ee1bf4774bcbe6226ad9f58e63f6c535

- transformers_git_sha: 2207e5d8cb224e954a7cba69fa4ac2309e9ff30b

- port_machine: brutasse

- port_time: 2020-08-21-14:41


---
language:
- bn
- or
- gu
- mr
- ur
- hi
- ps
- os
- as
- si
- iir
- en

tags:
- translation

license: apache-2.0
---

### iir-eng

* source group: Indo-Iranian languages
* target group: English
*  OPUS readme: [iir-eng](https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/iir-eng/README.md)

*  model: transformer
* source language(s): asm awa ben bho gom guj hif_Latn hin jdt_Cyrl kur_Arab kur_Latn mai mar npi ori oss pan_Guru pes pes_Latn pes_Thaa pnb pus rom san_Deva sin snd_Arab tgk_Cyrl tly_Latn urd zza
* target language(s): eng
* model: transformer
* pre-processing: normalization + SentencePiece (spm32k,spm32k)
* download original weights: [opus2m-2020-08-01.zip](https://object.pouta.csc.fi/Tatoeba-MT-models/iir-eng/opus2m-2020-08-01.zip)
* test set translations: [opus2m-2020-08-01.test.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/iir-eng/opus2m-2020-08-01.test.txt)
* test set scores: [opus2m-2020-08-01.eval.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/iir-eng/opus2m-2020-08-01.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| newsdev2014-hineng.hin.eng 	| 8.1 	| 0.324 |
| newsdev2019-engu-gujeng.guj.eng 	| 8.1 	| 0.309 |
| newstest2014-hien-hineng.hin.eng 	| 12.1 	| 0.380 |
| newstest2019-guen-gujeng.guj.eng 	| 6.0 	| 0.280 |
| Tatoeba-test.asm-eng.asm.eng 	| 13.9 	| 0.327 |
| Tatoeba-test.awa-eng.awa.eng 	| 7.0 	| 0.219 |
| Tatoeba-test.ben-eng.ben.eng 	| 42.5 	| 0.576 |
| Tatoeba-test.bho-eng.bho.eng 	| 27.3 	| 0.452 |
| Tatoeba-test.fas-eng.fas.eng 	| 5.6 	| 0.262 |
| Tatoeba-test.guj-eng.guj.eng 	| 15.9 	| 0.350 |
| Tatoeba-test.hif-eng.hif.eng 	| 10.1 	| 0.247 |
| Tatoeba-test.hin-eng.hin.eng 	| 36.5 	| 0.544 |
| Tatoeba-test.jdt-eng.jdt.eng 	| 11.4 	| 0.094 |
| Tatoeba-test.kok-eng.kok.eng 	| 6.6 	| 0.256 |
| Tatoeba-test.kur-eng.kur.eng 	| 3.4 	| 0.149 |
| Tatoeba-test.lah-eng.lah.eng 	| 17.4 	| 0.301 |
| Tatoeba-test.mai-eng.mai.eng 	| 65.4 	| 0.703 |
| Tatoeba-test.mar-eng.mar.eng 	| 22.5 	| 0.468 |
| Tatoeba-test.multi.eng 	| 21.3 	| 0.424 |
| Tatoeba-test.nep-eng.nep.eng 	| 3.4 	| 0.185 |
| Tatoeba-test.ori-eng.ori.eng 	| 4.8 	| 0.244 |
| Tatoeba-test.oss-eng.oss.eng 	| 1.6 	| 0.173 |
| Tatoeba-test.pan-eng.pan.eng 	| 14.8 	| 0.348 |
| Tatoeba-test.pus-eng.pus.eng 	| 1.1 	| 0.182 |
| Tatoeba-test.rom-eng.rom.eng 	| 2.8 	| 0.185 |
| Tatoeba-test.san-eng.san.eng 	| 2.8 	| 0.185 |
| Tatoeba-test.sin-eng.sin.eng 	| 22.8 	| 0.474 |
| Tatoeba-test.snd-eng.snd.eng 	| 8.2 	| 0.287 |
| Tatoeba-test.tgk-eng.tgk.eng 	| 11.9 	| 0.321 |
| Tatoeba-test.tly-eng.tly.eng 	| 0.9 	| 0.076 |
| Tatoeba-test.urd-eng.urd.eng 	| 23.9 	| 0.438 |
| Tatoeba-test.zza-eng.zza.eng 	| 0.6 	| 0.098 |

### System Info:
- hf_name: iir-eng

- source_languages: iir

- target_languages: eng

- opus_readme_url: https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/iir-eng/README.md

- original_repo: Tatoeba-Challenge

- tags: ['translation']

- languages: ['bn', 'or', 'gu', 'mr', 'ur', 'hi', 'ps', 'os', 'as', 'si', 'iir', 'en']

- src_constituents: {'pnb', 'gom', 'ben', 'hif_Latn', 'ori', 'guj', 'pan_Guru', 'snd_Arab', 'npi', 'mar', 'urd', 'pes', 'bho', 'kur_Arab', 'tgk_Cyrl', 'hin', 'kur_Latn', 'pes_Thaa', 'pus', 'san_Deva', 'oss', 'tly_Latn', 'jdt_Cyrl', 'asm', 'zza', 'rom', 'mai', 'pes_Latn', 'awa', 'sin'}

- tgt_constituents: {'eng'}

- src_multilingual: True

- tgt_multilingual: False

- prepro:  normalization + SentencePiece (spm32k,spm32k)

- url_model: https://object.pouta.csc.fi/Tatoeba-MT-models/iir-eng/opus2m-2020-08-01.zip

- url_test_set: https://object.pouta.csc.fi/Tatoeba-MT-models/iir-eng/opus2m-2020-08-01.test.txt

- src_alpha3: iir

- tgt_alpha3: eng

- short_pair: iir-en

- chrF2_score: 0.424

- bleu: 21.3

- brevity_penalty: 1.0

- ref_len: 67026.0

- src_name: Indo-Iranian languages

- tgt_name: English

- train_date: 2020-08-01

- src_alpha2: iir

- tgt_alpha2: en

- prefer_old: False

- long_pair: iir-eng

- helsinki_git_sha: 480fcbe0ee1bf4774bcbe6226ad9f58e63f6c535

- transformers_git_sha: 2207e5d8cb224e954a7cba69fa4ac2309e9ff30b

- port_machine: brutasse

- port_time: 2020-08-21-14:41


---
language:
- zh
- de

tags:
- translation

license: apache-2.0
---

### zho-deu

* source group: Chinese
* target group: German
*  OPUS readme: [zho-deu](https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/zho-deu/README.md)

*  model: transformer-align
* source language(s): cmn cmn_Bopo cmn_Hang cmn_Hani cmn_Hira cmn_Kana cmn_Latn lzh_Hani wuu_Hani yue_Hani
* target language(s): deu
* model: transformer-align
* pre-processing: normalization + SentencePiece (spm32k,spm32k)
* download original weights: [opus-2020-06-17.zip](https://object.pouta.csc.fi/Tatoeba-MT-models/zho-deu/opus-2020-06-17.zip)
* test set translations: [opus-2020-06-17.test.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/zho-deu/opus-2020-06-17.test.txt)
* test set scores: [opus-2020-06-17.eval.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/zho-deu/opus-2020-06-17.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| Tatoeba-test.zho.deu 	| 32.1 	| 0.522 |

### System Info:
- hf_name: zho-deu

- source_languages: zho

- target_languages: deu

- opus_readme_url: https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/zho-deu/README.md

- original_repo: Tatoeba-Challenge

- tags: ['translation']

- languages: ['zh', 'de']

- src_constituents: {'cmn_Hans', 'nan', 'nan_Hani', 'gan', 'yue', 'cmn_Kana', 'yue_Hani', 'wuu_Bopo', 'cmn_Latn', 'yue_Hira', 'cmn_Hani', 'cjy_Hans', 'cmn', 'lzh_Hang', 'lzh_Hira', 'cmn_Hant', 'lzh_Bopo', 'zho', 'zho_Hans', 'zho_Hant', 'lzh_Hani', 'yue_Hang', 'wuu', 'yue_Kana', 'wuu_Latn', 'yue_Bopo', 'cjy_Hant', 'yue_Hans', 'lzh', 'cmn_Hira', 'lzh_Yiii', 'lzh_Hans', 'cmn_Bopo', 'cmn_Hang', 'hak_Hani', 'cmn_Yiii', 'yue_Hant', 'lzh_Kana', 'wuu_Hani'}

- tgt_constituents: {'deu'}

- src_multilingual: False

- tgt_multilingual: False

- prepro:  normalization + SentencePiece (spm32k,spm32k)

- url_model: https://object.pouta.csc.fi/Tatoeba-MT-models/zho-deu/opus-2020-06-17.zip

- url_test_set: https://object.pouta.csc.fi/Tatoeba-MT-models/zho-deu/opus-2020-06-17.test.txt

- src_alpha3: zho

- tgt_alpha3: deu

- short_pair: zh-de

- chrF2_score: 0.522

- bleu: 32.1

- brevity_penalty: 0.9540000000000001

- ref_len: 19102.0

- src_name: Chinese

- tgt_name: German

- train_date: 2020-06-17

- src_alpha2: zh

- tgt_alpha2: de

- prefer_old: False

- long_pair: zho-deu

- helsinki_git_sha: 480fcbe0ee1bf4774bcbe6226ad9f58e63f6c535

- transformers_git_sha: 2207e5d8cb224e954a7cba69fa4ac2309e9ff30b

- port_machine: brutasse

- port_time: 2020-08-21-14:41


---
tags:
- translation
license: apache-2.0
---

### opus-mt-en-sm

* source languages: en
* target languages: sm
*  OPUS readme: [en-sm](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/en-sm/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-08.zip](https://object.pouta.csc.fi/OPUS-MT-models/en-sm/opus-2020-01-08.zip)
* test set translations: [opus-2020-01-08.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/en-sm/opus-2020-01-08.test.txt)
* test set scores: [opus-2020-01-08.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/en-sm/opus-2020-01-08.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| JW300.en.sm 	| 40.1 	| 0.585 |


---
tags:
- translation
license: apache-2.0
---

### opus-mt-pag-en

* source languages: pag
* target languages: en
*  OPUS readme: [pag-en](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/pag-en/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-21.zip](https://object.pouta.csc.fi/OPUS-MT-models/pag-en/opus-2020-01-21.zip)
* test set translations: [opus-2020-01-21.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/pag-en/opus-2020-01-21.test.txt)
* test set scores: [opus-2020-01-21.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/pag-en/opus-2020-01-21.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| JW300.pag.en 	| 42.4 	| 0.580 |


---
tags:
- translation
license: apache-2.0
---

### opus-mt-es-iso

* source languages: es
* target languages: iso
*  OPUS readme: [es-iso](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/es-iso/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-16.zip](https://object.pouta.csc.fi/OPUS-MT-models/es-iso/opus-2020-01-16.zip)
* test set translations: [opus-2020-01-16.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/es-iso/opus-2020-01-16.test.txt)
* test set scores: [opus-2020-01-16.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/es-iso/opus-2020-01-16.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| JW300.es.iso 	| 22.4 	| 0.396 |


---
tags:
- translation
license: apache-2.0
---

### opus-mt-es-tzo

* source languages: es
* target languages: tzo
*  OPUS readme: [es-tzo](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/es-tzo/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-16.zip](https://object.pouta.csc.fi/OPUS-MT-models/es-tzo/opus-2020-01-16.zip)
* test set translations: [opus-2020-01-16.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/es-tzo/opus-2020-01-16.test.txt)
* test set scores: [opus-2020-01-16.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/es-tzo/opus-2020-01-16.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| JW300.es.tzo 	| 22.6 	| 0.469 |


---
tags:
- translation
license: apache-2.0
---

### opus-mt-es-aed

* source languages: es
* target languages: aed
*  OPUS readme: [es-aed](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/es-aed/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-16.zip](https://object.pouta.csc.fi/OPUS-MT-models/es-aed/opus-2020-01-16.zip)
* test set translations: [opus-2020-01-16.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/es-aed/opus-2020-01-16.test.txt)
* test set scores: [opus-2020-01-16.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/es-aed/opus-2020-01-16.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| JW300.es.aed 	| 89.2 	| 0.915 |


---
tags:
- translation
license: apache-2.0
---

### opus-mt-sv-th

* source languages: sv
* target languages: th
*  OPUS readme: [sv-th](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/sv-th/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-16.zip](https://object.pouta.csc.fi/OPUS-MT-models/sv-th/opus-2020-01-16.zip)
* test set translations: [opus-2020-01-16.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/sv-th/opus-2020-01-16.test.txt)
* test set scores: [opus-2020-01-16.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/sv-th/opus-2020-01-16.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| JW300.sv.th 	| 21.2 	| 0.373 |


---
tags:
- translation
license: apache-2.0
---

### opus-mt-st-es

* source languages: st
* target languages: es
*  OPUS readme: [st-es](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/st-es/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-16.zip](https://object.pouta.csc.fi/OPUS-MT-models/st-es/opus-2020-01-16.zip)
* test set translations: [opus-2020-01-16.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/st-es/opus-2020-01-16.test.txt)
* test set scores: [opus-2020-01-16.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/st-es/opus-2020-01-16.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| JW300.st.es 	| 31.3 	| 0.499 |


---
tags:
- translation
license: apache-2.0
---

### opus-mt-en-ts

* source languages: en
* target languages: ts
*  OPUS readme: [en-ts](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/en-ts/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-08.zip](https://object.pouta.csc.fi/OPUS-MT-models/en-ts/opus-2020-01-08.zip)
* test set translations: [opus-2020-01-08.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/en-ts/opus-2020-01-08.test.txt)
* test set scores: [opus-2020-01-08.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/en-ts/opus-2020-01-08.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| JW300.en.ts 	| 43.4 	| 0.639 |


---
language:
- ht
- cpf
- en

tags:
- translation

license: apache-2.0
---

### cpf-eng

* source group: Creoles and pidgins, French‑based
* target group: English
*  OPUS readme: [cpf-eng](https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/cpf-eng/README.md)

*  model: transformer
* source language(s): gcf_Latn hat mfe
* target language(s): eng
* model: transformer
* pre-processing: normalization + SentencePiece (spm32k,spm32k)
* download original weights: [opus2m-2020-07-31.zip](https://object.pouta.csc.fi/Tatoeba-MT-models/cpf-eng/opus2m-2020-07-31.zip)
* test set translations: [opus2m-2020-07-31.test.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/cpf-eng/opus2m-2020-07-31.test.txt)
* test set scores: [opus2m-2020-07-31.eval.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/cpf-eng/opus2m-2020-07-31.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| Tatoeba-test.gcf-eng.gcf.eng 	| 8.4 	| 0.229 |
| Tatoeba-test.hat-eng.hat.eng 	| 28.0 	| 0.421 |
| Tatoeba-test.mfe-eng.mfe.eng 	| 66.0 	| 0.808 |
| Tatoeba-test.multi.eng 	| 16.3 	| 0.323 |

### System Info:
- hf_name: cpf-eng

- source_languages: cpf

- target_languages: eng

- opus_readme_url: https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/cpf-eng/README.md

- original_repo: Tatoeba-Challenge

- tags: ['translation']

- languages: ['ht', 'cpf', 'en']

- src_constituents: {'gcf_Latn', 'hat', 'mfe'}

- tgt_constituents: {'eng'}

- src_multilingual: True

- tgt_multilingual: False

- prepro:  normalization + SentencePiece (spm32k,spm32k)

- url_model: https://object.pouta.csc.fi/Tatoeba-MT-models/cpf-eng/opus2m-2020-07-31.zip

- url_test_set: https://object.pouta.csc.fi/Tatoeba-MT-models/cpf-eng/opus2m-2020-07-31.test.txt

- src_alpha3: cpf

- tgt_alpha3: eng

- short_pair: cpf-en

- chrF2_score: 0.32299999999999995

- bleu: 16.3

- brevity_penalty: 1.0

- ref_len: 990.0

- src_name: Creoles and pidgins, French‑based

- tgt_name: English

- train_date: 2020-07-31

- src_alpha2: cpf

- tgt_alpha2: en

- prefer_old: False

- long_pair: cpf-eng

- helsinki_git_sha: 480fcbe0ee1bf4774bcbe6226ad9f58e63f6c535

- transformers_git_sha: 2207e5d8cb224e954a7cba69fa4ac2309e9ff30b

- port_machine: brutasse

- port_time: 2020-08-21-14:41


---
tags:
- translation
license: apache-2.0
---

### opus-mt-efi-fr

* source languages: efi
* target languages: fr
*  OPUS readme: [efi-fr](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/efi-fr/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-20.zip](https://object.pouta.csc.fi/OPUS-MT-models/efi-fr/opus-2020-01-20.zip)
* test set translations: [opus-2020-01-20.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/efi-fr/opus-2020-01-20.test.txt)
* test set scores: [opus-2020-01-20.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/efi-fr/opus-2020-01-20.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| JW300.efi.fr 	| 25.1 	| 0.419 |


---
tags:
- translation
license: apache-2.0
---

### opus-mt-pag-fi

* source languages: pag
* target languages: fi
*  OPUS readme: [pag-fi](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/pag-fi/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-24.zip](https://object.pouta.csc.fi/OPUS-MT-models/pag-fi/opus-2020-01-24.zip)
* test set translations: [opus-2020-01-24.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/pag-fi/opus-2020-01-24.test.txt)
* test set scores: [opus-2020-01-24.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/pag-fi/opus-2020-01-24.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| JW300.pag.fi 	| 26.7 	| 0.496 |


---
tags:
- translation
license: apache-2.0
---

### opus-mt-fr-tw

* source languages: fr
* target languages: tw
*  OPUS readme: [fr-tw](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/fr-tw/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-16.zip](https://object.pouta.csc.fi/OPUS-MT-models/fr-tw/opus-2020-01-16.zip)
* test set translations: [opus-2020-01-16.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/fr-tw/opus-2020-01-16.test.txt)
* test set scores: [opus-2020-01-16.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/fr-tw/opus-2020-01-16.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| JW300.fr.tw 	| 27.9 	| 0.469 |


---
language:
- so
- ti
- am
- he
- mt
- ar
- afa
- en

tags:
- translation

license: apache-2.0
---

### afa-eng

* source group: Afro-Asiatic languages
* target group: English
*  OPUS readme: [afa-eng](https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/afa-eng/README.md)

*  model: transformer
* source language(s): acm afb amh apc ara arq ary arz hau_Latn heb kab mlt rif_Latn shy_Latn som tir
* target language(s): eng
* model: transformer
* pre-processing: normalization + SentencePiece (spm32k,spm32k)
* download original weights: [opus2m-2020-07-31.zip](https://object.pouta.csc.fi/Tatoeba-MT-models/afa-eng/opus2m-2020-07-31.zip)
* test set translations: [opus2m-2020-07-31.test.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/afa-eng/opus2m-2020-07-31.test.txt)
* test set scores: [opus2m-2020-07-31.eval.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/afa-eng/opus2m-2020-07-31.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| Tatoeba-test.amh-eng.amh.eng 	| 35.9 	| 0.550 |
| Tatoeba-test.ara-eng.ara.eng 	| 36.6 	| 0.543 |
| Tatoeba-test.hau-eng.hau.eng 	| 11.9 	| 0.327 |
| Tatoeba-test.heb-eng.heb.eng 	| 42.7 	| 0.591 |
| Tatoeba-test.kab-eng.kab.eng 	| 4.3 	| 0.213 |
| Tatoeba-test.mlt-eng.mlt.eng 	| 44.3 	| 0.618 |
| Tatoeba-test.multi.eng 	| 27.1 	| 0.464 |
| Tatoeba-test.rif-eng.rif.eng 	| 3.5 	| 0.141 |
| Tatoeba-test.shy-eng.shy.eng 	| 0.6 	| 0.125 |
| Tatoeba-test.som-eng.som.eng 	| 23.6 	| 0.472 |
| Tatoeba-test.tir-eng.tir.eng 	| 13.1 	| 0.328 |

### System Info:
- hf_name: afa-eng

- source_languages: afa

- target_languages: eng

- opus_readme_url: https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/afa-eng/README.md

- original_repo: Tatoeba-Challenge

- tags: ['translation']

- languages: ['so', 'ti', 'am', 'he', 'mt', 'ar', 'afa', 'en']

- src_constituents: {'som', 'rif_Latn', 'tir', 'kab', 'arq', 'afb', 'amh', 'arz', 'heb', 'shy_Latn', 'apc', 'mlt', 'thv', 'ara', 'hau_Latn', 'acm', 'ary'}

- tgt_constituents: {'eng'}

- src_multilingual: True

- tgt_multilingual: False

- prepro:  normalization + SentencePiece (spm32k,spm32k)

- url_model: https://object.pouta.csc.fi/Tatoeba-MT-models/afa-eng/opus2m-2020-07-31.zip

- url_test_set: https://object.pouta.csc.fi/Tatoeba-MT-models/afa-eng/opus2m-2020-07-31.test.txt

- src_alpha3: afa

- tgt_alpha3: eng

- short_pair: afa-en

- chrF2_score: 0.46399999999999997

- bleu: 27.1

- brevity_penalty: 1.0

- ref_len: 69373.0

- src_name: Afro-Asiatic languages

- tgt_name: English

- train_date: 2020-07-31

- src_alpha2: afa

- tgt_alpha2: en

- prefer_old: False

- long_pair: afa-eng

- helsinki_git_sha: 480fcbe0ee1bf4774bcbe6226ad9f58e63f6c535

- transformers_git_sha: 2207e5d8cb224e954a7cba69fa4ac2309e9ff30b

- port_machine: brutasse

- port_time: 2020-08-21-14:41


---
tags:
- translation
license: apache-2.0
---

### opus-mt-gil-es

* source languages: gil
* target languages: es
*  OPUS readme: [gil-es](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/gil-es/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-16.zip](https://object.pouta.csc.fi/OPUS-MT-models/gil-es/opus-2020-01-16.zip)
* test set translations: [opus-2020-01-16.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/gil-es/opus-2020-01-16.test.txt)
* test set scores: [opus-2020-01-16.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/gil-es/opus-2020-01-16.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| JW300.gil.es 	| 21.8 	| 0.398 |


---
language:
- en
- map

tags:
- translation

license: apache-2.0
---

### eng-map

* source group: English
* target group: Austronesian languages
*  OPUS readme: [eng-map](https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/eng-map/README.md)

*  model: transformer
* source language(s): eng
* target language(s): akl_Latn ceb cha dtp fij gil haw hil iba ilo ind jav jav_Java lkt mad mah max_Latn min mlg mri nau niu pag pau rap smo sun tah tet tmw_Latn ton tvl war zlm_Latn zsm_Latn
* model: transformer
* pre-processing: normalization + SentencePiece (spm32k,spm32k)
* a sentence initial language token is required in the form of `>>id<<` (id = valid target language ID)
* download original weights: [opus-2020-07-27.zip](https://object.pouta.csc.fi/Tatoeba-MT-models/eng-map/opus-2020-07-27.zip)
* test set translations: [opus-2020-07-27.test.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/eng-map/opus-2020-07-27.test.txt)
* test set scores: [opus-2020-07-27.eval.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/eng-map/opus-2020-07-27.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| Tatoeba-test.eng-akl.eng.akl 	| 2.2 	| 0.103 |
| Tatoeba-test.eng-ceb.eng.ceb 	| 10.7 	| 0.425 |
| Tatoeba-test.eng-cha.eng.cha 	| 3.2 	| 0.201 |
| Tatoeba-test.eng-dtp.eng.dtp 	| 0.5 	| 0.120 |
| Tatoeba-test.eng-fij.eng.fij 	| 26.8 	| 0.453 |
| Tatoeba-test.eng-gil.eng.gil 	| 59.3 	| 0.762 |
| Tatoeba-test.eng-haw.eng.haw 	| 1.0 	| 0.116 |
| Tatoeba-test.eng-hil.eng.hil 	| 19.0 	| 0.517 |
| Tatoeba-test.eng-iba.eng.iba 	| 15.5 	| 0.400 |
| Tatoeba-test.eng-ilo.eng.ilo 	| 33.6 	| 0.591 |
| Tatoeba-test.eng-jav.eng.jav 	| 7.8 	| 0.301 |
| Tatoeba-test.eng-lkt.eng.lkt 	| 1.0 	| 0.064 |
| Tatoeba-test.eng-mad.eng.mad 	| 1.1 	| 0.142 |
| Tatoeba-test.eng-mah.eng.mah 	| 9.1 	| 0.374 |
| Tatoeba-test.eng-mlg.eng.mlg 	| 35.4 	| 0.526 |
| Tatoeba-test.eng-mri.eng.mri 	| 7.6 	| 0.309 |
| Tatoeba-test.eng-msa.eng.msa 	| 31.1 	| 0.565 |
| Tatoeba-test.eng.multi 	| 17.6 	| 0.411 |
| Tatoeba-test.eng-nau.eng.nau 	| 1.4 	| 0.098 |
| Tatoeba-test.eng-niu.eng.niu 	| 40.1 	| 0.560 |
| Tatoeba-test.eng-pag.eng.pag 	| 16.8 	| 0.526 |
| Tatoeba-test.eng-pau.eng.pau 	| 1.9 	| 0.139 |
| Tatoeba-test.eng-rap.eng.rap 	| 2.7 	| 0.090 |
| Tatoeba-test.eng-smo.eng.smo 	| 24.9 	| 0.453 |
| Tatoeba-test.eng-sun.eng.sun 	| 33.2 	| 0.439 |
| Tatoeba-test.eng-tah.eng.tah 	| 12.5 	| 0.278 |
| Tatoeba-test.eng-tet.eng.tet 	| 1.6 	| 0.140 |
| Tatoeba-test.eng-ton.eng.ton 	| 25.8 	| 0.530 |
| Tatoeba-test.eng-tvl.eng.tvl 	| 31.1 	| 0.523 |
| Tatoeba-test.eng-war.eng.war 	| 12.8 	| 0.436 |

### System Info:
- hf_name: eng-map

- source_languages: eng

- target_languages: map

- opus_readme_url: https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/eng-map/README.md

- original_repo: Tatoeba-Challenge

- tags: ['translation']

- languages: ['en', 'map']

- src_constituents: {'eng'}

- tgt_constituents: set()

- src_multilingual: False

- tgt_multilingual: True

- prepro:  normalization + SentencePiece (spm32k,spm32k)

- url_model: https://object.pouta.csc.fi/Tatoeba-MT-models/eng-map/opus-2020-07-27.zip

- url_test_set: https://object.pouta.csc.fi/Tatoeba-MT-models/eng-map/opus-2020-07-27.test.txt

- src_alpha3: eng

- tgt_alpha3: map

- short_pair: en-map

- chrF2_score: 0.41100000000000003

- bleu: 17.6

- brevity_penalty: 1.0

- ref_len: 66963.0

- src_name: English

- tgt_name: Austronesian languages

- train_date: 2020-07-27

- src_alpha2: en

- tgt_alpha2: map

- prefer_old: False

- long_pair: eng-map

- helsinki_git_sha: 480fcbe0ee1bf4774bcbe6226ad9f58e63f6c535

- transformers_git_sha: 2207e5d8cb224e954a7cba69fa4ac2309e9ff30b

- port_machine: brutasse

- port_time: 2020-08-21-14:41


---
tags:
- translation
license: apache-2.0
---

### opus-mt-st-en

* source languages: st
* target languages: en
*  OPUS readme: [st-en](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/st-en/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-16.zip](https://object.pouta.csc.fi/OPUS-MT-models/st-en/opus-2020-01-16.zip)
* test set translations: [opus-2020-01-16.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/st-en/opus-2020-01-16.test.txt)
* test set scores: [opus-2020-01-16.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/st-en/opus-2020-01-16.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| JW300.st.en 	| 45.7 	| 0.609 |


---
tags:
- translation
license: apache-2.0
---

### opus-mt-de-ee

* source languages: de
* target languages: ee
*  OPUS readme: [de-ee](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/de-ee/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-20.zip](https://object.pouta.csc.fi/OPUS-MT-models/de-ee/opus-2020-01-20.zip)
* test set translations: [opus-2020-01-20.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/de-ee/opus-2020-01-20.test.txt)
* test set scores: [opus-2020-01-20.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/de-ee/opus-2020-01-20.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| JW300.de.ee 	| 24.6 	| 0.463 |


---
language:
- bg
- ru

tags:
- translation

license: apache-2.0
---

### bul-rus

* source group: Bulgarian
* target group: Russian
*  OPUS readme: [bul-rus](https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/bul-rus/README.md)

*  model: transformer
* source language(s): bul bul_Latn
* target language(s): rus
* model: transformer
* pre-processing: normalization + SentencePiece (spm32k,spm32k)
* download original weights: [opus-2020-07-03.zip](https://object.pouta.csc.fi/Tatoeba-MT-models/bul-rus/opus-2020-07-03.zip)
* test set translations: [opus-2020-07-03.test.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/bul-rus/opus-2020-07-03.test.txt)
* test set scores: [opus-2020-07-03.eval.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/bul-rus/opus-2020-07-03.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| Tatoeba-test.bul.rus 	| 48.5 	| 0.691 |

### System Info:
- hf_name: bul-rus

- source_languages: bul

- target_languages: rus

- opus_readme_url: https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/bul-rus/README.md

- original_repo: Tatoeba-Challenge

- tags: ['translation']

- languages: ['bg', 'ru']

- src_constituents: {'bul', 'bul_Latn'}

- tgt_constituents: {'rus'}

- src_multilingual: False

- tgt_multilingual: False

- prepro:  normalization + SentencePiece (spm32k,spm32k)

- url_model: https://object.pouta.csc.fi/Tatoeba-MT-models/bul-rus/opus-2020-07-03.zip

- url_test_set: https://object.pouta.csc.fi/Tatoeba-MT-models/bul-rus/opus-2020-07-03.test.txt

- src_alpha3: bul

- tgt_alpha3: rus

- short_pair: bg-ru

- chrF2_score: 0.691

- bleu: 48.5

- brevity_penalty: 1.0

- ref_len: 7870.0

- src_name: Bulgarian

- tgt_name: Russian

- train_date: 2020-07-03

- src_alpha2: bg

- tgt_alpha2: ru

- prefer_old: False

- long_pair: bul-rus

- helsinki_git_sha: 480fcbe0ee1bf4774bcbe6226ad9f58e63f6c535

- transformers_git_sha: 2207e5d8cb224e954a7cba69fa4ac2309e9ff30b

- port_machine: brutasse

- port_time: 2020-08-21-14:41


---
tags:
- translation
license: apache-2.0
---

### opus-mt-uk-fr

* source languages: uk
* target languages: fr
*  OPUS readme: [uk-fr](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/uk-fr/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-16.zip](https://object.pouta.csc.fi/OPUS-MT-models/uk-fr/opus-2020-01-16.zip)
* test set translations: [opus-2020-01-16.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/uk-fr/opus-2020-01-16.test.txt)
* test set scores: [opus-2020-01-16.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/uk-fr/opus-2020-01-16.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| Tatoeba.uk.fr 	| 52.1 	| 0.681 |


---
tags:
- translation
license: apache-2.0
---

### opus-mt-es-gil

* source languages: es
* target languages: gil
*  OPUS readme: [es-gil](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/es-gil/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-16.zip](https://object.pouta.csc.fi/OPUS-MT-models/es-gil/opus-2020-01-16.zip)
* test set translations: [opus-2020-01-16.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/es-gil/opus-2020-01-16.test.txt)
* test set scores: [opus-2020-01-16.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/es-gil/opus-2020-01-16.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| JW300.es.gil 	| 23.8 	| 0.470 |


---
tags:
- translation
license: apache-2.0
---

### opus-mt-ja-fi

* source languages: ja
* target languages: fi
*  OPUS readme: [ja-fi](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/ja-fi/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-09.zip](https://object.pouta.csc.fi/OPUS-MT-models/ja-fi/opus-2020-01-09.zip)
* test set translations: [opus-2020-01-09.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/ja-fi/opus-2020-01-09.test.txt)
* test set scores: [opus-2020-01-09.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/ja-fi/opus-2020-01-09.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| Tatoeba.ja.fi 	| 21.2 	| 0.448 |


---
tags:
- translation
license: apache-2.0
---

### opus-mt-niu-en

* source languages: niu
* target languages: en
*  OPUS readme: [niu-en](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/niu-en/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-21.zip](https://object.pouta.csc.fi/OPUS-MT-models/niu-en/opus-2020-01-21.zip)
* test set translations: [opus-2020-01-21.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/niu-en/opus-2020-01-21.test.txt)
* test set scores: [opus-2020-01-21.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/niu-en/opus-2020-01-21.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| JW300.niu.en 	| 46.1 	| 0.604 |


---
tags:
- translation
license: apache-2.0
---

### opus-mt-en-fj

* source languages: en
* target languages: fj
*  OPUS readme: [en-fj](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/en-fj/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-08.zip](https://object.pouta.csc.fi/OPUS-MT-models/en-fj/opus-2020-01-08.zip)
* test set translations: [opus-2020-01-08.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/en-fj/opus-2020-01-08.test.txt)
* test set scores: [opus-2020-01-08.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/en-fj/opus-2020-01-08.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| JW300.en.fj 	| 34.0 	| 0.561 |
| Tatoeba.en.fj 	| 62.5 	| 0.781 |


---
tags:
- translation
license: apache-2.0
---

### opus-mt-kqn-es

* source languages: kqn
* target languages: es
*  OPUS readme: [kqn-es](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/kqn-es/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-16.zip](https://object.pouta.csc.fi/OPUS-MT-models/kqn-es/opus-2020-01-16.zip)
* test set translations: [opus-2020-01-16.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/kqn-es/opus-2020-01-16.test.txt)
* test set scores: [opus-2020-01-16.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/kqn-es/opus-2020-01-16.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| JW300.kqn.es 	| 20.9 	| 0.378 |


---
tags:
- translation
license: apache-2.0
---

### opus-mt-es-xh

* source languages: es
* target languages: xh
*  OPUS readme: [es-xh](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/es-xh/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-16.zip](https://object.pouta.csc.fi/OPUS-MT-models/es-xh/opus-2020-01-16.zip)
* test set translations: [opus-2020-01-16.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/es-xh/opus-2020-01-16.test.txt)
* test set scores: [opus-2020-01-16.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/es-xh/opus-2020-01-16.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| JW300.es.xh 	| 25.0 	| 0.541 |


---
tags:
- translation
license: apache-2.0
---

### opus-mt-sv-lv

* source languages: sv
* target languages: lv
*  OPUS readme: [sv-lv](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/sv-lv/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-16.zip](https://object.pouta.csc.fi/OPUS-MT-models/sv-lv/opus-2020-01-16.zip)
* test set translations: [opus-2020-01-16.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/sv-lv/opus-2020-01-16.test.txt)
* test set scores: [opus-2020-01-16.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/sv-lv/opus-2020-01-16.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| JW300.sv.lv 	| 20.2 	| 0.433 |


---
tags:
- translation
license: apache-2.0
---

### opus-mt-fr-tiv

* source languages: fr
* target languages: tiv
*  OPUS readme: [fr-tiv](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/fr-tiv/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-16.zip](https://object.pouta.csc.fi/OPUS-MT-models/fr-tiv/opus-2020-01-16.zip)
* test set translations: [opus-2020-01-16.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/fr-tiv/opus-2020-01-16.test.txt)
* test set scores: [opus-2020-01-16.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/fr-tiv/opus-2020-01-16.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| JW300.fr.tiv 	| 23.5 	| 0.406 |


---
tags:
- translation
license: apache-2.0
---

### opus-mt-crs-es

* source languages: crs
* target languages: es
*  OPUS readme: [crs-es](https://github.com/Helsinki-NLP/OPUS-MT-train/blob/master/models/crs-es/README.md)

*  dataset: opus
* model: transformer-align
* pre-processing: normalization + SentencePiece
* download original weights: [opus-2020-01-15.zip](https://object.pouta.csc.fi/OPUS-MT-models/crs-es/opus-2020-01-15.zip)
* test set translations: [opus-2020-01-15.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/crs-es/opus-2020-01-15.test.txt)
* test set scores: [opus-2020-01-15.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/crs-es/opus-2020-01-15.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| JW300.crs.es 	| 26.1 	| 0.445 |


---
license: mit
tags:
- generated_from_trainer
datasets:
- squad
model-index:
- name: bert_medium_pretrain_squad
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# bert_medium_pretrain_squad

This model is a fine-tuned version of [prajjwal1/bert-medium](https://huggingface.co/prajjwal1/bert-medium) on the squad dataset.
It achieves the following results on the evaluation set:
- Loss: 0.0973

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 5e-05
- train_batch_size: 16
- eval_batch_size: 16
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 3.0

### Training results

### Framework versions

- Transformers 4.16.0.dev0
- Pytorch 1.10.1+cu102
- Datasets 1.17.0
- Tokenizers 0.10.3


---
license: mit
tags:
- generated_from_trainer
datasets:
- squad
model-index:
- name: bert-small-pretrained-finetuned-squad
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# bert-small-pretrained-finetuned-squad

This model is a fine-tuned version of [anas-awadalla/bert-small-pretrained-on-squad](https://huggingface.co/anas-awadalla/bert-small-pretrained-on-squad) on the squad dataset.

- "exact_match": 72.20435193945127
- "f1": 81.31832229156294

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 5e-05
- train_batch_size: 16
- eval_batch_size: 16
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 3.0

### Training results

### Framework versions

- Transformers 4.16.0.dev0
- Pytorch 1.10.1+cu102
- Datasets 1.17.0
- Tokenizers 0.10.3


---
tags:
- generated_from_trainer
datasets:
- squad
model-index:
- name: bert-small-finetuned-squad
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# bert-small-finetuned-squad

This model is a fine-tuned version of [prajjwal1/bert-small](https://huggingface.co/prajjwal1/bert-small) on the squad dataset.
It achieves the following results on the evaluation set:
- eval_loss: 1.3138
- eval_runtime: 46.6577
- eval_samples_per_second: 231.13
- eval_steps_per_second: 14.446
- epoch: 4.0
- step: 22132

{'exact_match': 71.05960264900662, 'f1': 80.8260245470904}

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 2e-05
- train_batch_size: 16
- eval_batch_size: 16
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 20

### Framework versions

- Transformers 4.15.0
- Pytorch 1.10.0+cu111
- Datasets 1.18.0
- Tokenizers 0.10.3


---
license: mit
tags:
- generated_from_trainer
datasets:
- squad
model-index:
- name: bert_small_pretrain_squad
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# bert_small_pretrain_squad

This model is a fine-tuned version of [prajjwal1/bert-small](https://huggingface.co/prajjwal1/bert-small) on the squad dataset.
It achieves the following results on the evaluation set:
- Loss: 0.1410

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 5e-05
- train_batch_size: 16
- eval_batch_size: 16
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 3.0

### Training results

### Framework versions

- Transformers 4.16.0.dev0
- Pytorch 1.10.1+cu102
- Datasets 1.17.0
- Tokenizers 0.10.3


---
license: mit
tags:
- generated_from_trainer
datasets:
- squad
model-index:
- name: bert-tiny-finetuned-squad
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# bert-tiny-finetuned-squad

This model is a fine-tuned version of [prajjwal1/bert-tiny](https://huggingface.co/prajjwal1/bert-tiny) on the squad dataset.
It achieves the following results on the evaluation set:
- Loss: 2.3478

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 2e-05
- train_batch_size: 32
- eval_batch_size: 32
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 20

### Training results

| Training Loss | Epoch | Step  | Validation Loss |
|:-------------:|:-----:|:-----:|:---------------:|
| 2.7198        | 1.0   | 2767  | 2.5916          |
| 2.6502        | 2.0   | 5534  | 2.5309          |
| 2.5589        | 3.0   | 8301  | 2.4849          |
| 2.5128        | 4.0   | 11068 | 2.4474          |
| 2.4631        | 5.0   | 13835 | 2.4226          |
| 2.4165        | 6.0   | 16602 | 2.3987          |
| 2.3634        | 7.0   | 19369 | 2.4002          |
| 2.3243        | 8.0   | 22136 | 2.3855          |
| 2.2799        | 9.0   | 24903 | 2.3827          |
| 2.2596        | 10.0  | 27670 | 2.3641          |
| 2.2133        | 11.0  | 30437 | 2.3464          |
| 2.1911        | 12.0  | 33204 | 2.3551          |
| 2.1621        | 13.0  | 35971 | 2.3553          |
| 2.1421        | 14.0  | 38738 | 2.3584          |
| 2.1202        | 15.0  | 41505 | 2.3501          |
| 2.1154        | 16.0  | 44272 | 2.3548          |
| 2.1237        | 17.0  | 47039 | 2.3456          |
| 2.0952        | 18.0  | 49806 | 2.3507          |
| 2.0886        | 19.0  | 52573 | 2.3500          |
| 2.1062        | 20.0  | 55340 | 2.3478          |

### Framework versions

- Transformers 4.15.0
- Pytorch 1.10.0+cu111
- Datasets 1.18.0
- Tokenizers 0.10.3


---
license: mit
tags:
- generated_from_trainer
datasets:
- squad
model-index:
- name: bert_medium_pretrain_squad
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# bert_medium_pretrain_squad

This model is a fine-tuned version of [anas-awadalla/bert-medium-pretrained-on-squad](https://huggingface.co/anas-awadalla/bert-medium-pretrained-on-squad) on the squad dataset.
It achieves the following results on the evaluation set:
- Loss: 0.0973
- "exact_match": 77.95648060548723
- "f1": 85.85300366384631

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 5e-05
- train_batch_size: 16
- eval_batch_size: 16
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 3.0

### Training results

### Framework versions

- Transformers 4.16.0.dev0
- Pytorch 1.10.1+cu102
- Datasets 1.17.0
- Tokenizers 0.10.3


# LayoutXLM finetuned on XFUN.ja

```python
import torch
import numpy as np
from PIL import Image, ImageDraw, ImageFont
from pathlib import Path
from itertools import chain
from tqdm.notebook import tqdm
from pdf2image import convert_from_path
from transformers import LayoutXLMProcessor, LayoutLMv2ForTokenClassification
import os
os.environ["TOKENIZERS_PARALLELISM"] = "false"
labels = [
    'O',
    'B-QUESTION',
    'B-ANSWER',
    'B-HEADER',
    'I-ANSWER',
    'I-QUESTION',
    'I-HEADER'
]
id2label = {v: k for v, k in enumerate(labels)}
label2id = {k: v for v, k in enumerate(labels)}
def unnormalize_box(bbox, width, height):
    return [
         width * (bbox[0] / 1000),
         height * (bbox[1] / 1000),
         width * (bbox[2] / 1000),
         height * (bbox[3] / 1000),
    ]
def iob_to_label(label):
    label = label[2:]
    if not label:
        return 'other'
    return label
label2color = {'question':'blue', 'answer':'green', 'header':'orange', 'other':'violet'}
def infer(image, processor, model, label2color):
    # Use this if you're loading images
    # image = Image.open(img_path).convert("RGB")

    image = image.convert("RGB") # loading PDFs
    encoding = processor(image, return_offsets_mapping=True, return_tensors="pt", truncation=True, max_length=514)
    offset_mapping = encoding.pop('offset_mapping')
    outputs = model(**encoding)
    predictions = outputs.logits.argmax(-1).squeeze().tolist()
    token_boxes = encoding.bbox.squeeze().tolist()
    width, height = image.size
    is_subword = np.array(offset_mapping.squeeze().tolist())[:,0] != 0
    true_predictions = [id2label[pred] for idx, pred in enumerate(predictions) if not is_subword[idx]]
    true_boxes = [unnormalize_box(box, width, height) for idx, box in enumerate(token_boxes) if not is_subword[idx]]
    draw = ImageDraw.Draw(image)
    font = ImageFont.load_default()
    for prediction, box in zip(true_predictions, true_boxes):
        predicted_label = iob_to_label(prediction).lower()
        draw.rectangle(box, outline=label2color[predicted_label])
        draw.text((box[0]+10, box[1]-10), text=predicted_label, fill=label2color[predicted_label], font=font)
    return image
processor = LayoutXLMProcessor.from_pretrained('cuongngm/xlm')
model = LayoutLMv2ForTokenClassification.from_pretrained("cuongngm/xlm")
# imgs = [img_path for img_path in Path('/your/path/imgs/').glob('*.jpg')]
img = Image.open(your image path)
outputs = infer(img_path, processor, model, label2color)
# type(outputs[0]) -> PIL.Image.Image
```


Fine tuning LayoutLMv2 model on Vietnamese bill dataset
```python
from transformers import LayoutLMv2ForTokenClassification
model = LayoutLMv2ForTokenClassification.from_pretrained('cuongngm/layoutlm-bill', num_labels=len(labels))
```


---
tags:
- conversational
---

# My Awesome Model