Hugging Face's logo

ghost-x
/
ghost-8b-beta-1608

Text Generation
Transformers
Safetensors
llama
ghost
tools
chat
unsloth
conversational
text-generation-inference
Inference Endpoints
Model card Files Community
4
leaderboard-pr-bot commited on
Commit
43d7ccc
•
1 Parent(s): 6d1b385

Adding Evaluation Results

Browse files

This is an automated PR created with https://huggingface.co/spaces/Weyaxi/open-llm-leaderboard-results-pr

The purpose of this PR is to add evaluation results from the Open LLM Leaderboard to your model card.

If you encounter any issues, please report them to https://huggingface.co/spaces/Weyaxi/open-llm-leaderboard-results-pr/discussions

Files changed (1) hide show
  1. README.md +134 -25
README.md CHANGED
@@ -1,35 +1,130 @@
1
  ---
2
- base_model: ghost-x/ghost-8b-beta
3
  language:
4
- - vi
5
- - ko
6
- - es
7
- - pt
8
- - zh
9
- - fr
10
- - it
11
- - de
12
- - ja
13
- - ru
14
- - pl
15
- - nl
16
- - hi
17
- - tr
18
- - id
19
- - en
20
  license: other
 
 
 
 
 
 
 
 
21
  license_name: ghost-open-llms
22
  license_link: https://ghost-x.org/ghost-open-llms-license
23
- tags:
24
- - ghost
25
- - tools
26
- - chat
27
- - transformers
28
- - unsloth
29
- - llama
30
  pipeline_tag: text-generation
31
  widget:
32
- - text: Why is the sky blue ?
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
33
  ---
34
 
35
  <p><img src="https://ghost-x.org/docs/models/ghost-8b-beta/images/logo.jpeg" width="40%" align="center" /></p>
@@ -830,3 +925,17 @@ If you find our work helpful, feel free to give us a cite.
830
  year = {2024}
831
  }
832
  ```
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
 
2
  language:
3
+ - vi
4
+ - ko
5
+ - es
6
+ - pt
7
+ - zh
8
+ - fr
9
+ - it
10
+ - de
11
+ - ja
12
+ - ru
13
+ - pl
14
+ - nl
15
+ - hi
16
+ - tr
17
+ - id
18
+ - en
19
  license: other
20
+ tags:
21
+ - ghost
22
+ - tools
23
+ - chat
24
+ - transformers
25
+ - unsloth
26
+ - llama
27
+ base_model: ghost-x/ghost-8b-beta
28
  license_name: ghost-open-llms
29
  license_link: https://ghost-x.org/ghost-open-llms-license
 
 
 
 
 
 
 
30
  pipeline_tag: text-generation
31
  widget:
32
+ - text: Why is the sky blue ?
33
+ model-index:
34
+ - name: ghost-8b-beta-1608
35
+ results:
36
+ - task:
37
+ type: text-generation
38
+ name: Text Generation
39
+ dataset:
40
+ name: IFEval (0-Shot)
41
+ type: HuggingFaceH4/ifeval
42
+ args:
43
+ num_few_shot: 0
44
+ metrics:
45
+ - type: inst_level_strict_acc and prompt_level_strict_acc
46
+ value: 42.73
47
+ name: strict accuracy
48
+ source:
49
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=ghost-x/ghost-8b-beta-1608
50
+ name: Open LLM Leaderboard
51
+ - task:
52
+ type: text-generation
53
+ name: Text Generation
54
+ dataset:
55
+ name: BBH (3-Shot)
56
+ type: BBH
57
+ args:
58
+ num_few_shot: 3
59
+ metrics:
60
+ - type: acc_norm
61
+ value: 23.46
62
+ name: normalized accuracy
63
+ source:
64
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=ghost-x/ghost-8b-beta-1608
65
+ name: Open LLM Leaderboard
66
+ - task:
67
+ type: text-generation
68
+ name: Text Generation
69
+ dataset:
70
+ name: MATH Lvl 5 (4-Shot)
71
+ type: hendrycks/competition_math
72
+ args:
73
+ num_few_shot: 4
74
+ metrics:
75
+ - type: exact_match
76
+ value: 1.21
77
+ name: exact match
78
+ source:
79
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=ghost-x/ghost-8b-beta-1608
80
+ name: Open LLM Leaderboard
81
+ - task:
82
+ type: text-generation
83
+ name: Text Generation
84
+ dataset:
85
+ name: GPQA (0-shot)
86
+ type: Idavidrein/gpqa
87
+ args:
88
+ num_few_shot: 0
89
+ metrics:
90
+ - type: acc_norm
91
+ value: 1.12
92
+ name: acc_norm
93
+ source:
94
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=ghost-x/ghost-8b-beta-1608
95
+ name: Open LLM Leaderboard
96
+ - task:
97
+ type: text-generation
98
+ name: Text Generation
99
+ dataset:
100
+ name: MuSR (0-shot)
101
+ type: TAUR-Lab/MuSR
102
+ args:
103
+ num_few_shot: 0
104
+ metrics:
105
+ - type: acc_norm
106
+ value: 1.58
107
+ name: acc_norm
108
+ source:
109
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=ghost-x/ghost-8b-beta-1608
110
+ name: Open LLM Leaderboard
111
+ - task:
112
+ type: text-generation
113
+ name: Text Generation
114
+ dataset:
115
+ name: MMLU-PRO (5-shot)
116
+ type: TIGER-Lab/MMLU-Pro
117
+ config: main
118
+ split: test
119
+ args:
120
+ num_few_shot: 5
121
+ metrics:
122
+ - type: acc
123
+ value: 20.44
124
+ name: accuracy
125
+ source:
126
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=ghost-x/ghost-8b-beta-1608
127
+ name: Open LLM Leaderboard
128
  ---
129
 
130
  <p><img src="https://ghost-x.org/docs/models/ghost-8b-beta/images/logo.jpeg" width="40%" align="center" /></p>
 
925
  year = {2024}
926
  }
927
  ```
928
+
929
+ # [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard)
930
+ Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_ghost-x__ghost-8b-beta-1608)
931
+
932
+ | Metric |Value|
933
+ |-------------------|----:|
934
+ |Avg. |15.09|
935
+ |IFEval (0-Shot) |42.73|
936
+ |BBH (3-Shot) |23.46|
937
+ |MATH Lvl 5 (4-Shot)| 1.21|
938
+ |GPQA (0-shot) | 1.12|
939
+ |MuSR (0-shot) | 1.58|
940
+ |MMLU-PRO (5-shot) |20.44|
941
+