asahi417 commited on
Commit
15cffdf
1 Parent(s): a2bcbf2

model update

Browse files
Files changed (1) hide show
  1. README.md +4 -4
README.md CHANGED
@@ -91,7 +91,7 @@ model-index:
91
  metrics:
92
  - name: Accuracy
93
  type: accuracy
94
- value: 0.5567765567765568
95
  - task:
96
  name: Analogy Questions (TREX Analogy)
97
  type: multiple-choice-qa
@@ -102,7 +102,7 @@ model-index:
102
  metrics:
103
  - name: Accuracy
104
  type: accuracy
105
- value: 0.8363095238095238
106
  - task:
107
  name: Lexical Relation Classification (BLESS)
108
  type: classification
@@ -186,8 +186,8 @@ This model achieves the following results on the relation understanding tasks:
186
  - Accuracy on U2: 0.6008771929824561
187
  - Accuracy on U4: 0.6111111111111112
188
  - Accuracy on Google: 0.908
189
- - Accuracy on ConceptNet Analogy: 0.5567765567765568
190
- - Accuracy on T-Rex Analogy: 0.8363095238095238
191
  - Lexical Relation Classification ([dataset](https://huggingface.co/datasets/relbert/lexical_relation_classification), [full result](https://huggingface.co/relbert/relbert-roberta-large-triplet-a-semeval2012/raw/main/classification.json)):
192
  - Micro F1 score on BLESS: 0.9059816182009944
193
  - Micro F1 score on CogALexV: 0.8582159624413146
 
91
  metrics:
92
  - name: Accuracy
93
  type: accuracy
94
+ value: 0.2986577181208054
95
  - task:
96
  name: Analogy Questions (TREX Analogy)
97
  type: multiple-choice-qa
 
102
  metrics:
103
  - name: Accuracy
104
  type: accuracy
105
+ value: 0.5191256830601093
106
  - task:
107
  name: Lexical Relation Classification (BLESS)
108
  type: classification
 
186
  - Accuracy on U2: 0.6008771929824561
187
  - Accuracy on U4: 0.6111111111111112
188
  - Accuracy on Google: 0.908
189
+ - Accuracy on ConceptNet Analogy: 0.2986577181208054
190
+ - Accuracy on T-Rex Analogy: 0.5191256830601093
191
  - Lexical Relation Classification ([dataset](https://huggingface.co/datasets/relbert/lexical_relation_classification), [full result](https://huggingface.co/relbert/relbert-roberta-large-triplet-a-semeval2012/raw/main/classification.json)):
192
  - Micro F1 score on BLESS: 0.9059816182009944
193
  - Micro F1 score on CogALexV: 0.8582159624413146