Hugging Face's logo

ByteDance
/
ListConRanker

Safetensors
bert
mteb
Eval Results
Model card Files Community
ianma2024 commited on
Commit
46d30f8
•
1 Parent(s): 5697681

reformat metadata and reorg ckp path

Browse files
Files changed (10) hide show
  1. README.md +28 -37
  2. ListConRanker_ckpt/config.json → config.json +0 -0
  3. eval_listconranker.py +1 -1
  4. eval_listconranker_iterative_inference.py +1 -1
  5. ListConRanker_ckpt/linear_in_embedding.pt → linear_in_embedding.pt +0 -0
  6. ListConRanker_ckpt/list_transformer.pt → list_transformer.pt +0 -0
  7. ListConRanker_ckpt/model.safetensors → model.safetensors +0 -0
  8. ListConRanker_ckpt/special_tokens_map.json → special_tokens_map.json +0 -0
  9. ListConRanker_ckpt/tokenizer_config.json → tokenizer_config.json +0 -0
  10. ListConRanker_ckpt/vocab.txt → vocab.txt +0 -0
README.md CHANGED
@@ -1,13 +1,17 @@
1
  ---
 
 
2
  model-index:
3
  - name: ListConRanker
4
  results:
5
- - dataset:
 
 
 
 
6
  config: default
7
- name: MTEB CMedQAv1-reranking (default)
8
- revision: None
9
  split: test
10
- type: C-MTEB/CMedQAv1-reranking
11
  metrics:
12
  - type: map
13
  value: 90.55366308098787
@@ -17,16 +21,14 @@ model-index:
17
  value: 92.45134920634919
18
  - type: mrr_5
19
  value: 92.325
20
- - type: main_score
21
- value: 90.55366308098787
22
- task:
23
  type: Reranking
24
- - dataset:
 
 
25
  config: default
26
- name: MTEB CMedQAv2-reranking (default)
27
- revision: None
28
  split: test
29
- type: C-MTEB/CMedQAv2-reranking
30
  metrics:
31
  - type: map
32
  value: 89.38076135722042
@@ -36,53 +38,42 @@ model-index:
36
  value: 91.28769841269842
37
  - type: mrr_5
38
  value: 91.08999999999999
39
- - type: main_score
40
- value: 89.38076135722042
41
- task:
42
  type: Reranking
43
- - dataset:
 
 
44
  config: default
45
- name: MTEB MMarcoReranking (default)
46
- revision: None
47
  split: dev
48
- type: C-MTEB/Mmarco-reranking
49
  metrics:
50
  - type: map
51
  value: 43.881461866703894
52
  - type: mrr_1
53
  value: 32.0
54
  - type: mrr_10
55
- value: 44.700793650793656
56
  - type: mrr_5
57
- value: 43.61666666666667
58
- - type: main_score
59
- value: 43.881461866703894
60
- task:
61
  type: Reranking
62
- - dataset:
 
 
63
  config: default
64
- name: MTEB T2Reranking (default)
65
- revision: None
66
  split: dev
67
- type: C-MTEB/T2Reranking
68
  metrics:
69
  - type: map
70
  value: 69.16513825032682
71
  - type: mrr_1
72
- value: 67.41706161137441
73
  - type: mrr_10
74
- value: 80.0946053776961
75
  - type: mrr_5
76
- value: 79.71676822387724
77
- - type: main_score
78
- value: 69.16513825032682
79
- task:
80
- type: Reranking
81
- tags:
82
- - mteb
83
  ---
84
 
85
-
86
  # ListConRanker
87
  ## Model
88
 
 
1
  ---
2
+ tags:
3
+ - mteb
4
  model-index:
5
  - name: ListConRanker
6
  results:
7
+ - task:
8
+ type: Reranking
9
+ dataset:
10
+ type: C-MTEB/CMedQAv1-reranking
11
+ name: MTEB CMedQAv1
12
  config: default
 
 
13
  split: test
14
+ revision: None
15
  metrics:
16
  - type: map
17
  value: 90.55366308098787
 
21
  value: 92.45134920634919
22
  - type: mrr_5
23
  value: 92.325
24
+ - task:
 
 
25
  type: Reranking
26
+ dataset:
27
+ type: C-MTEB/CMedQAv2-reranking
28
+ name: MTEB CMedQAv2
29
  config: default
 
 
30
  split: test
31
+ revision: None
32
  metrics:
33
  - type: map
34
  value: 89.38076135722042
 
38
  value: 91.28769841269842
39
  - type: mrr_5
40
  value: 91.08999999999999
41
+ - task:
 
 
42
  type: Reranking
43
+ dataset:
44
+ type: C-MTEB/Mmarco-reranking
45
+ name: MTEB MMarcoReranking
46
  config: default
 
 
47
  split: dev
48
+ revision: None
49
  metrics:
50
  - type: map
51
  value: 43.881461866703894
52
  - type: mrr_1
53
  value: 32.0
54
  - type: mrr_10
55
+ value: 44.534126984126985
56
  - type: mrr_5
57
+ value: 43.45
58
+ - task:
 
 
59
  type: Reranking
60
+ dataset:
61
+ type: C-MTEB/T2Reranking
62
+ name: MTEB T2Reranking
63
  config: default
 
 
64
  split: dev
65
+ revision: None
66
  metrics:
67
  - type: map
68
  value: 69.16513825032682
69
  - type: mrr_1
70
+ value: 67.36628300609343
71
  - type: mrr_10
72
+ value: 80.06914890758831
73
  - type: mrr_5
74
+ value: 79.69137892123675
 
 
 
 
 
 
75
  ---
76
 
 
77
  # ListConRanker
78
  ## Model
79
 
ListConRanker_ckpt/config.json → config.json RENAMED
File without changes
eval_listconranker.py CHANGED
@@ -25,7 +25,7 @@ from modules.listconranker import ListConRanker
25
 
26
  def get_args():
27
  parser = argparse.ArgumentParser()
28
- parser.add_argument('--model_name_or_path', default="./ListConRanker_ckpt", type=str)
29
  return parser.parse_args()
30
 
31
 
 
25
 
26
  def get_args():
27
  parser = argparse.ArgumentParser()
28
+ parser.add_argument('--model_name_or_path', default="./", type=str)
29
  return parser.parse_args()
30
 
31
 
eval_listconranker_iterative_inference.py CHANGED
@@ -25,7 +25,7 @@ from modules.listconranker import ListConRanker
25
 
26
  def get_args():
27
  parser = argparse.ArgumentParser()
28
- parser.add_argument('--model_name_or_path', default="./ListConRanker_ckpt", type=str)
29
  return parser.parse_args()
30
 
31
 
 
25
 
26
  def get_args():
27
  parser = argparse.ArgumentParser()
28
+ parser.add_argument('--model_name_or_path', default="./", type=str)
29
  return parser.parse_args()
30
 
31
 
ListConRanker_ckpt/linear_in_embedding.pt → linear_in_embedding.pt RENAMED
File without changes
ListConRanker_ckpt/list_transformer.pt → list_transformer.pt RENAMED
File without changes
ListConRanker_ckpt/model.safetensors → model.safetensors RENAMED
File without changes
ListConRanker_ckpt/special_tokens_map.json → special_tokens_map.json RENAMED
File without changes
ListConRanker_ckpt/tokenizer_config.json → tokenizer_config.json RENAMED
File without changes
ListConRanker_ckpt/vocab.txt → vocab.txt RENAMED
File without changes