antoinelouis
commited on
Commit
•
173a793
1
Parent(s):
416bd54
Update README.md
Browse files
README.md
CHANGED
@@ -166,7 +166,7 @@ with Run().context(RunConfig(nranks=n_gpu,experiment=experiment)):
|
|
166 |
|
167 |
## Evaluation
|
168 |
|
169 |
-
- **
|
170 |
We evaluate our model on the small development sets of [mMARCO](https://huggingface.co/datasets/unicamp-dl/mmarco), which consists of 6,980 queries for a corpus of 8.8M candidate passages in 14 languages. Below, we compared its multilingual performance with other retrieval models on the dataset official metrics, i.e., mean reciprocal rank at cut-off 10 (MRR@10).
|
171 |
|
172 |
| | model | Type | #Samples | #Params | en | es | fr | it | pt | id | de | ru | zh | ja | nl | vi | hi | ar | Avg. |
|
|
|
166 |
|
167 |
## Evaluation
|
168 |
|
169 |
+
- **mMARCO**:
|
170 |
We evaluate our model on the small development sets of [mMARCO](https://huggingface.co/datasets/unicamp-dl/mmarco), which consists of 6,980 queries for a corpus of 8.8M candidate passages in 14 languages. Below, we compared its multilingual performance with other retrieval models on the dataset official metrics, i.e., mean reciprocal rank at cut-off 10 (MRR@10).
|
171 |
|
172 |
| | model | Type | #Samples | #Params | en | es | fr | it | pt | id | de | ru | zh | ja | nl | vi | hi | ar | Avg. |
|