File size: 1,431 Bytes
e908019
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
2023-06-18 22:04:09 - Load pretrained SentenceTransformer: msmarco-bert-base-dot-v5
2023-06-18 22:04:11 - Use pytorch device: cuda
2023-06-18 22:04:11 - Train Corpus Size: 150000
2023-06-18 22:04:11 - Train Query Size: 105000
2023-06-18 22:04:11 - Train qrels Size: 105000
2023-06-18 22:04:11 - Information Retrieval Evaluation on Standard_Title dataset:
2023-06-18 22:30:00 - Queries: 22500
2023-06-18 22:30:00 - Corpus: 150000

2023-06-18 22:30:19 - Score-Function: dot_score
2023-06-18 22:30:19 - Accuracy@1: 58.27%
2023-06-18 22:30:19 - Accuracy@3: 71.01%
2023-06-18 22:30:19 - Accuracy@5: 75.05%
2023-06-18 22:30:19 - Accuracy@10: 79.98%
2023-06-18 22:30:19 - Accuracy@100: 91.04%
2023-06-18 22:30:19 - Precision@1: 58.27%
2023-06-18 22:30:19 - Precision@3: 23.67%
2023-06-18 22:30:19 - Precision@5: 15.01%
2023-06-18 22:30:19 - Precision@10: 8.00%
2023-06-18 22:30:19 - Precision@100: 0.91%
2023-06-18 22:30:19 - Recall@1: 58.27%
2023-06-18 22:30:19 - Recall@3: 71.01%
2023-06-18 22:30:19 - Recall@5: 75.05%
2023-06-18 22:30:19 - Recall@10: 79.98%
2023-06-18 22:30:19 - Recall@100: 91.04%
2023-06-18 22:30:19 - MRR@1: 0.5827
2023-06-18 22:30:19 - MRR@10: 0.6557
2023-06-18 22:30:19 - MRR@100: 0.6604
2023-06-18 22:30:19 - NDCG@1: 0.5827
2023-06-18 22:30:19 - NDCG@10: 0.6905
2023-06-18 22:30:19 - NDCG@100: 0.7139
2023-06-18 22:30:19 - MAP@1: 0.5827
2023-06-18 22:30:19 - MAP@10: 0.6557
2023-06-18 22:30:19 - MAP@100: 0.6604