Leveraging LLMs for Synthesizing Training Data Across Many Languages in Multilingual Dense Retrieval
Paper
•
2311.05800
•
Published
•
3
🦢SWIM-IR Dataset [NAACL'24]
29 million Synthetic Wikipedia-based Multilingual Retrieval Training Pairs.
-
nthakur/swim-ir-cross-lingual
Viewer • Updated • 15.4M • 575 • 6Note SWIM-IR (Cross-lingual) dataset, where the query is in the target language and the passage is in English.
nthakur/swim-ir-monolingual
Viewer • Updated • 3.17M • 254 • 6Note SWIM-IR (Monolingual) dataset, where both the query and the passage are in the target language.
nthakur/indic-swim-ir-cross-lingual
Viewer • Updated • 93k • 203 • 2Note Indic SWIM-IR (Cross-lingual) dataset, where the query is in the Indo-European language and the passage is in English.