projecte-aina
/

aina-translator-en-ca

Fairseq

English

Catalan

Model card Files Files and versions Community

carlosep93 commited on Nov 29, 2022

Commit

da2d3dd

•

1 Parent(s): a45b450

Update README.md

Browse files

Files changed (1) hide show

README.md +9 -12

README.md CHANGED Viewed

@@ -130,7 +130,7 @@ The model was trained for a total of 45.000 updates. Weights were saved every 10
 ### Variable and metrics
-We use the BLEU score for evaluation on test sets: [Flores-101](https://github.com/facebookresearch/flores), [TaCon](https://elrc-share.eu/repository/browse/tacon-spanish-constitution-mt-test-set/84a96138b98611ec9c1a00155d02670628f3e6857b0f422abd82abc3795ec8c2/), [United Nations](https://zenodo.org/record/3888414#.Y33-_tLMIW0), [Cybersecurity](https://elrc-share.eu/repository/browse/cyber-mt-test-set/2bd93faab98c11ec9c1a00155d026706b96a490ed3e140f0a29a80a08c46e91e/), [wmt19 biomedical test set](), [wmt13 news test set](https://elrc-share.eu/repository/browse/catalan-wmt2013-machine-translation-shared-task-test-set/84a96139b98611ec9c1a00155d0267061a0aa1b62e2248e89aab4952f3c230fc/), [aina aapp]()
 ### Evaluation results
@@ -139,17 +139,14 @@ Below are the evaluation results on the machine translation from English to Cata
 | Test set             | SoftCatalà | Google Translate | mt-aina-en-ca |
 |----------------------|------------|------------------|---------------|
-| Spanish Constitution |            | 37,6             | **37,7**      |
-| United Nations       |            | 39,7             | **39,8**      |
-| aina_aapp            |            | 51,5             |               |
-| aina_eu_comission    |            | 52               |               |
-| Flores 101 dev       |            | 41,6             | **42,9**      |
-| Flores 101 devtest   |            | 42,2             | **44,0**      |
-| Cybersecurity        |            | **46,5**         | 45,8          |
-| wmt 19 biomedical    |            | **25,2**         | 25,1          |
-| wmt 13 news          |            | 33,8             | **35,6**      |
-|----------------------|------------|------------------|---------------|
-| Average              |            |                  |               |

 ### Variable and metrics
+We use the BLEU score for evaluation on test sets: [Flores-101](https://github.com/facebookresearch/flores), [TaCon](https://elrc-share.eu/repository/browse/tacon-spanish-constitution-mt-test-set/84a96138b98611ec9c1a00155d02670628f3e6857b0f422abd82abc3795ec8c2/), [United Nations](https://zenodo.org/record/3888414#.Y33-_tLMIW0), [Cybersecurity](https://elrc-share.eu/repository/browse/cyber-mt-test-set/2bd93faab98c11ec9c1a00155d026706b96a490ed3e140f0a29a80a08c46e91e/), [wmt19 biomedical test set](), [wmt13 news test set](https://elrc-share.eu/repository/browse/catalan-wmt2013-machine-translation-shared-task-test-set/84a96139b98611ec9c1a00155d0267061a0aa1b62e2248e89aab4952f3c230fc/)
 ### Evaluation results
 | Test set             | SoftCatalà | Google Translate | mt-aina-en-ca |
 |----------------------|------------|------------------|---------------|
+| Spanish Constitution | 32,6       | 37,6             | **37,7**      |
+| United Nations       | 39,0       | 39,7             | **39,8**      |
+| Flores 101 dev       | 41,0       | 41,6             | **42,9**      |
+| Flores 101 devtest   | 42,1       | 42,2             | **44,0**      |
+| Cybersecurity        | 42,5       | **46,5**         | 45,8          |
+| wmt 19 biomedical    | 21,7       | **25,2**         | 25,1          |
+| wmt 13 news          | 34,9       | 33,8             | **35,6**      |
+| Average              | 36,3       | 38,1             | **38,7**      |