autoevaluator HF staff commited on
Commit
9599eb1
1 Parent(s): c9c1510

Add evaluation results on the vi_3 config and test split of futin/guess

Browse files

Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the vi_3 config and test split of the [futin/guess](https://huggingface.co/datasets/futin/guess) dataset by

@futin

, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-eval-futin__guess-vi_3-6b1064-2012566622).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=futin/guess).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=futin/guess).

Files changed (1) hide show
  1. README.md +20 -1
README.md CHANGED
@@ -4,9 +4,28 @@ inference: false
4
  tags:
5
  - text-generation
6
  - opt
7
-
8
  license: other
9
  commercial: false
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
10
  ---
11
 
12
  # OPT : Open Pre-trained Transformer Language Models
 
4
  tags:
5
  - text-generation
6
  - opt
 
7
  license: other
8
  commercial: false
9
+ model-index:
10
+ - name: facebook/opt-2.7b
11
+ results:
12
+ - task:
13
+ type: zero-shot-classification
14
+ name: Zero-Shot Text Classification
15
+ dataset:
16
+ name: futin/guess
17
+ type: futin/guess
18
+ config: vi_3
19
+ split: test
20
+ metrics:
21
+ - name: Accuracy
22
+ type: accuracy
23
+ value: 0.3551236749116608
24
+ verified: true
25
+ - name: Loss
26
+ type: loss
27
+ value: 1.7380365481885904
28
+ verified: true
29
  ---
30
 
31
  # OPT : Open Pre-trained Transformer Language Models