Commit
•
6dc7260
1
Parent(s):
ef7c556
fixed typo for 'vi' vietnamese
Browse files
README.md
CHANGED
|
@@ -14,7 +14,7 @@ language:
|
|
| 14 |
- th
|
| 15 |
- tr
|
| 16 |
- ur
|
| 17 |
-
-
|
| 18 |
- zh
|
| 19 |
license: mit
|
| 20 |
tags:
|
|
@@ -80,7 +80,7 @@ The model was evaluated on the XNLI test set on 15 languages (5010 texts per lan
|
|
| 80 |
|
| 81 |
Also note that if other multilingual models on the model hub claim performance of around 90% on languages other than English, the authors have most likely made a mistake during testing since non of the latest papers shows a multilingual average performance of more than a few points above 80% on XNLI (see [here](https://arxiv.org/pdf/2111.09543.pdf) or [here](https://arxiv.org/pdf/1911.02116.pdf)).
|
| 82 |
|
| 83 |
-
average | ar | bg | de | el | en | es | fr | hi | ru | sw | th | tr | ur |
|
| 84 |
---------|----------|---------|----------|----------|----------|----------|----------|----------|----------|----------|----------|----------|----------|----------|----------
|
| 85 |
0.808 | 0.802 | 0.829 | 0.825 | 0.826 | 0.883 | 0.845 | 0.834 | 0.771 | 0.813 | 0.748 | 0.793 | 0.807 | 0.740 | 0.795 | 0.8116
|
| 86 |
|
|
|
|
| 14 |
- th
|
| 15 |
- tr
|
| 16 |
- ur
|
| 17 |
+
- vi
|
| 18 |
- zh
|
| 19 |
license: mit
|
| 20 |
tags:
|
|
|
|
| 80 |
|
| 81 |
Also note that if other multilingual models on the model hub claim performance of around 90% on languages other than English, the authors have most likely made a mistake during testing since non of the latest papers shows a multilingual average performance of more than a few points above 80% on XNLI (see [here](https://arxiv.org/pdf/2111.09543.pdf) or [here](https://arxiv.org/pdf/1911.02116.pdf)).
|
| 82 |
|
| 83 |
+
average | ar | bg | de | el | en | es | fr | hi | ru | sw | th | tr | ur | vi | zh
|
| 84 |
---------|----------|---------|----------|----------|----------|----------|----------|----------|----------|----------|----------|----------|----------|----------|----------
|
| 85 |
0.808 | 0.802 | 0.829 | 0.825 | 0.826 | 0.883 | 0.845 | 0.834 | 0.771 | 0.813 | 0.748 | 0.793 | 0.807 | 0.740 | 0.795 | 0.8116
|
| 86 |
|