model update
Browse files
README.md
CHANGED
@@ -91,7 +91,7 @@ model-index:
|
|
91 |
metrics:
|
92 |
- name: Accuracy
|
93 |
type: accuracy
|
94 |
-
value: 0.
|
95 |
- task:
|
96 |
name: Analogy Questions (TREX Analogy)
|
97 |
type: multiple-choice-qa
|
@@ -102,7 +102,7 @@ model-index:
|
|
102 |
metrics:
|
103 |
- name: Accuracy
|
104 |
type: accuracy
|
105 |
-
value: 0.
|
106 |
- task:
|
107 |
name: Lexical Relation Classification (BLESS)
|
108 |
type: classification
|
@@ -186,8 +186,8 @@ This model achieves the following results on the relation understanding tasks:
|
|
186 |
- Accuracy on U2: 0.6008771929824561
|
187 |
- Accuracy on U4: 0.6111111111111112
|
188 |
- Accuracy on Google: 0.908
|
189 |
-
- Accuracy on ConceptNet Analogy: 0.
|
190 |
-
- Accuracy on T-Rex Analogy: 0.
|
191 |
- Lexical Relation Classification ([dataset](https://huggingface.co/datasets/relbert/lexical_relation_classification), [full result](https://huggingface.co/relbert/relbert-roberta-large-triplet-a-semeval2012/raw/main/classification.json)):
|
192 |
- Micro F1 score on BLESS: 0.9059816182009944
|
193 |
- Micro F1 score on CogALexV: 0.8582159624413146
|
|
|
91 |
metrics:
|
92 |
- name: Accuracy
|
93 |
type: accuracy
|
94 |
+
value: 0.2986577181208054
|
95 |
- task:
|
96 |
name: Analogy Questions (TREX Analogy)
|
97 |
type: multiple-choice-qa
|
|
|
102 |
metrics:
|
103 |
- name: Accuracy
|
104 |
type: accuracy
|
105 |
+
value: 0.5191256830601093
|
106 |
- task:
|
107 |
name: Lexical Relation Classification (BLESS)
|
108 |
type: classification
|
|
|
186 |
- Accuracy on U2: 0.6008771929824561
|
187 |
- Accuracy on U4: 0.6111111111111112
|
188 |
- Accuracy on Google: 0.908
|
189 |
+
- Accuracy on ConceptNet Analogy: 0.2986577181208054
|
190 |
+
- Accuracy on T-Rex Analogy: 0.5191256830601093
|
191 |
- Lexical Relation Classification ([dataset](https://huggingface.co/datasets/relbert/lexical_relation_classification), [full result](https://huggingface.co/relbert/relbert-roberta-large-triplet-a-semeval2012/raw/main/classification.json)):
|
192 |
- Micro F1 score on BLESS: 0.9059816182009944
|
193 |
- Micro F1 score on CogALexV: 0.8582159624413146
|