rajpurkar/squad
Viewer • Updated • 98.2k • 209k • 1.25k
intfloat/multilingual-e5-small fine-tuned with InfoNCE on GermanDPR (article-disjoint from its test split) and a SQuAD sample,
with BM25-mined hard negatives and 50 % machine-translated German queries for English passages (seed 1 of 3).
Use the e5 prefixes query: and passage: , mean pooling, cosine similarity.
| nDCG@10 (%) | GermanDPR test | XQuAD en->en | XQuAD de->en |
|---|---|---|---|
| multilingual-e5-small | 78.0 | 87.8 | 76.2 |
| this model (seed 1) | 80.5 | 87.4 | 78.8 |
XQuAD is scored against all 2,069 SQuAD v1.1 dev paragraphs. Training data licences: GermanDPR CC BY 4.0, SQuAD CC BY-SA 4.0. Code, all runs and limits: https://github.com/pavanyadava007/multilingual-retrieval-lab (author: Pavan Yadava Annappa).
Base model
intfloat/multilingual-e5-small