Commit
•
c8fc850
1
Parent(s):
24b6b76
updated
Browse files
README.md
CHANGED
@@ -32,6 +32,7 @@ evaluation dataset: UKPLab/beir test data but we have used first 2lac passage on
|
|
32 |
|model_name|data_name|num of queries|num of passages|R@10|R@20|R@50|R@100|R@100|
|
33 |
|---|---|---|---|---|---|---|---|---|
|
34 |
|nlpconnect/dpr-ctx_encoder_bert_uncased_L-2_H-128_A-2(our)|nq-test dataset|3452|200001|49.68%|59.06%|69.40%|75.75%|89.28%|
|
|
|
35 |
|*facebook/dpr-ctx_encoder-single-nq-base(hf/fb)|nq-test dataset|3452|200001|32.93%|43.74%|56.95%|66.30%|83.92%|
|
36 |
|
37 |
Note: * means we have evaluated on same eval dataset.
|
|
|
32 |
|model_name|data_name|num of queries|num of passages|R@10|R@20|R@50|R@100|R@100|
|
33 |
|---|---|---|---|---|---|---|---|---|
|
34 |
|nlpconnect/dpr-ctx_encoder_bert_uncased_L-2_H-128_A-2(our)|nq-test dataset|3452|200001|49.68%|59.06%|69.40%|75.75%|89.28%|
|
35 |
+
|nlpconnect/dpr-ctx_encoder_bert_uncased_L-12_H-128_A-2(our)|nq-test dataset|3452|200001|51.62%|61.09%|70.10%|76.07%|88.70%|
|
36 |
|*facebook/dpr-ctx_encoder-single-nq-base(hf/fb)|nq-test dataset|3452|200001|32.93%|43.74%|56.95%|66.30%|83.92%|
|
37 |
|
38 |
Note: * means we have evaluated on same eval dataset.
|