asahi417 commited on
Commit
3da7c6e
1 Parent(s): 846dbae

model update

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -102,7 +102,7 @@ model-index:
102
  metrics:
103
  - name: Accuracy
104
  type: accuracy
105
- value: 0.5901639344262295
106
  - task:
107
  name: Analogy Questions (NELL-ONE Analogy)
108
  type: multiple-choice-qa
@@ -198,7 +198,7 @@ This model achieves the following results on the relation understanding tasks:
198
  - Accuracy on U4: 0.5069444444444444
199
  - Accuracy on Google: 0.776
200
  - Accuracy on ConceptNet Analogy: 0.3062080536912752
201
- - Accuracy on T-Rex Analogy: 0.5901639344262295
202
  - Accuracy on NELL-ONE Analogy: 0.5983333333333334
203
  - Lexical Relation Classification ([dataset](https://huggingface.co/datasets/relbert/lexical_relation_classification), [full result](https://huggingface.co/relbert/relbert-roberta-large-nce-e-conceptnet/raw/main/classification.json)):
204
  - Micro F1 score on BLESS: 0.9044749133644719
 
102
  metrics:
103
  - name: Accuracy
104
  type: accuracy
105
+ value: 0.6065573770491803
106
  - task:
107
  name: Analogy Questions (NELL-ONE Analogy)
108
  type: multiple-choice-qa
 
198
  - Accuracy on U4: 0.5069444444444444
199
  - Accuracy on Google: 0.776
200
  - Accuracy on ConceptNet Analogy: 0.3062080536912752
201
+ - Accuracy on T-Rex Analogy: 0.6065573770491803
202
  - Accuracy on NELL-ONE Analogy: 0.5983333333333334
203
  - Lexical Relation Classification ([dataset](https://huggingface.co/datasets/relbert/lexical_relation_classification), [full result](https://huggingface.co/relbert/relbert-roberta-large-nce-e-conceptnet/raw/main/classification.json)):
204
  - Micro F1 score on BLESS: 0.9044749133644719