research-backup
/

roberta-large-semeval2012-average-no-mask-prompt-a-nce

Feature Extraction

text-embeddings-inference

Inference Endpoints

Model card Files Files and versions Community

asahi417 commited on Aug 12, 2022

Commit

d81fb15

•

1 Parent(s): dab4572

model update

Files changed (1) hide show

README.md +3 -3

README.md CHANGED Viewed

@@ -14,7 +14,7 @@ model-index:
     metrics:
     - name: Accuracy
       type: accuracy
-      value: None
   - task:
       name: Analogy Questions (SAT full)
       type: multiple-choice-qa
@@ -166,14 +166,14 @@ It achieves the following results on the relation understanding tasks:
     - Accuracy on U2: 0.6754385964912281
     - Accuracy on U4: 0.6921296296296297
     - Accuracy on Google: 0.936
-- Lexical Relation Classification ([dataset](https://huggingface.co/datasets/relbert/lexical_relation_classification), [full result](https://huggingface.co/relbert/relbert-roberta-large-semeval2012-average-no-mask-prompt-a-nce/raw/main/classification.json))):
     - Micro F1 score on BLESS: 0.9124604489980412
     - Micro F1 score on CogALexV: 0.8607981220657277
     - Micro F1 score on EVALution: 0.6863488624052004
     - Micro F1 score on K&H+N: 0.9499895666689852
     - Micro F1 score on ROOT09: 0.9075524913820119
 - Relation Mapping ([dataset](https://huggingface.co/datasets/relbert/relation_mapping), [full result](https://huggingface.co/relbert/relbert-roberta-large-semeval2012-average-no-mask-prompt-a-nce/raw/main/relation_mapping.json)):
-    - Accuracy on Relation Mapping: None
 ### Usage

     metrics:
     - name: Accuracy
       type: accuracy
+      value: 95.0
   - task:
       name: Analogy Questions (SAT full)
       type: multiple-choice-qa
     - Accuracy on U2: 0.6754385964912281
     - Accuracy on U4: 0.6921296296296297
     - Accuracy on Google: 0.936
+- Lexical Relation Classification ([dataset](https://huggingface.co/datasets/relbert/lexical_relation_classification), [full result](https://huggingface.co/relbert/relbert-roberta-large-semeval2012-average-no-mask-prompt-a-nce/raw/main/classification.json)):
     - Micro F1 score on BLESS: 0.9124604489980412
     - Micro F1 score on CogALexV: 0.8607981220657277
     - Micro F1 score on EVALution: 0.6863488624052004
     - Micro F1 score on K&H+N: 0.9499895666689852
     - Micro F1 score on ROOT09: 0.9075524913820119
 - Relation Mapping ([dataset](https://huggingface.co/datasets/relbert/relation_mapping), [full result](https://huggingface.co/relbert/relbert-roberta-large-semeval2012-average-no-mask-prompt-a-nce/raw/main/relation_mapping.json)):
+    - Accuracy on Relation Mapping: 95.0
 ### Usage