Hugging Face's logo

jhu-clsp
/
FollowIR-7B

Text Generation
Transformers
Safetensors
English
mistral
retrieval
instructions
reranking
mteb
conversational
Eval Results
text-generation-inference
Inference Endpoints
Model card Files Community
orionweller commited on
Commit
26af411
•
1 Parent(s): 32d1b00

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +38 -38
README.md CHANGED
@@ -8,45 +8,45 @@ tags:
8
  - reranking
9
  datasets:
10
  - jhu-clsp/FollowIR-train
 
 
 
11
  model-index:
12
- - name: FollowIR-7B
13
- results:
14
- - task:
15
- type: Reranking
16
- dataset:
17
- type: jhu-clsp/news21-instructions
18
- name: FollowIR New21
19
- config: en
20
- split: test
21
- metrics:
22
- - type: map
23
- value: 25.7
24
- - type: p-MRR
25
- value: 10.8
26
- - task:
27
- type: Reranking
28
- dataset:
29
- type: jhu-clsp/robust04-instructions
30
- name: FollowIR Robust04
31
- config: en
32
- split: test
33
- metrics:
34
- - type: map
35
- value: 25.9
36
- - type: p-MRR
37
- value: 13.6
38
- - task:
39
- type: Reranking
40
- dataset:
41
- type: jhu-clsp/core17-instructions
42
- name: FollowIR Core17
43
- config: en
44
- split: test
45
- metrics:
46
- - type: map
47
- value: 20.0
48
- - type: p-MRR
49
- value: 16.3
50
  ---
51
 
52
  # Model Summary
 
8
  - reranking
9
  datasets:
10
  - jhu-clsp/FollowIR-train
11
+ ---
12
+ tags:
13
+ - mteb
14
  model-index:
15
+ - name: FollowIR-7B
16
+ results:
17
+ - task:
18
+ type: InstructionRetrieval
19
+ dataset:
20
+ type: jhu-clsp/core17-instructions
21
+ name: MTEB Core17InstructionRetrieval
22
+ config: default
23
+ split: test
24
+ revision: e39ff896cf3efbbdeeb950e6bd7c79f266995b07
25
+ metrics:
26
+ - type: p-MRR
27
+ value: 16.47851858684521
28
+ - task:
29
+ type: InstructionRetrieval
30
+ dataset:
31
+ type: jhu-clsp/news21-instructions
32
+ name: MTEB News21InstructionRetrieval
33
+ config: default
34
+ split: test
35
+ revision: e0144086b45fe31ac125e9ac1a83b6a409bb6ca6
36
+ metrics:
37
+ - type: p-MRR
38
+ value: 6.2615989256510005
39
+ - task:
40
+ type: InstructionRetrieval
41
+ dataset:
42
+ type: jhu-clsp/robust04-instructions
43
+ name: MTEB Robust04InstructionRetrieval
44
+ config: default
45
+ split: test
46
+ revision: a5a1c4fe2bc528ac12e83f8cdf82178da85d2f1d
47
+ metrics:
48
+ - type: p-MRR
49
+ value: 13.717553757582253
 
 
 
50
  ---
51
 
52
  # Model Summary