Corianas commited on
Commit
0afb5fe
1 Parent(s): f00281d

Upload folder using huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +29 -0
README.md ADDED
@@ -0,0 +1,29 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: cc-by-sa-3.0
3
+ tags:
4
+ - autoquant
5
+ - gguf
6
+ ---
7
+ G.A.R.Y. (Guided Artificially Resourceful Yes-man)
8
+
9
+ A clone of Dolly (https://github.com/databrickslabs/dolly)
10
+
11
+ Trained on 8xa100s over the course of 45 minutes. (total time less than 3 hours with false starts and getting less optimal results while learning how best to proceed.)
12
+
13
+ ---
14
+ license: cc-by-nc-2.0
15
+ ---
16
+
17
+ # [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
18
+ Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_Corianas__gpt-j-6B-Dolly)
19
+
20
+ | Metric | Value |
21
+ |-----------------------|---------------------------|
22
+ | Avg. | 35.1 |
23
+ | ARC (25-shot) | 41.3 |
24
+ | HellaSwag (10-shot) | 65.97 |
25
+ | MMLU (5-shot) | 26.78 |
26
+ | TruthfulQA (0-shot) | 37.91 |
27
+ | Winogrande (5-shot) | 64.72 |
28
+ | GSM8K (5-shot) | 0.91 |
29
+ | DROP (3-shot) | 8.1 |