Hugging Face's logo

arslan2012
/
BigMaid-20B-v1.0-AWQ

Text Generation
Transformers
Safetensors
English
llama
roleplay
text-generation-inference
Merge
Not-For-All-Audiences
awq
Eval Results
Inference Endpoints
4-bit precision
Model card Files Community
arslan2012 commited on
Commit
4f987da
•
1 Parent(s): b149568

add awq tag

Browse files
Files changed (1) hide show
  1. README.md +14 -8
README.md CHANGED
@@ -8,6 +8,7 @@ tags:
8
  - text-generation-inference
9
  - merge
10
  - not-for-all-audiences
 
11
  model-index:
12
  - name: BigMaid-20B-v1.0
13
  results:
@@ -26,7 +27,8 @@ model-index:
26
  value: 61.35
27
  name: normalized accuracy
28
  source:
29
- url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=TeeZee/BigMaid-20B-v1.0
 
30
  name: Open LLM Leaderboard
31
  - task:
32
  type: text-generation
@@ -42,7 +44,8 @@ model-index:
42
  value: 85.26
43
  name: normalized accuracy
44
  source:
45
- url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=TeeZee/BigMaid-20B-v1.0
 
46
  name: Open LLM Leaderboard
47
  - task:
48
  type: text-generation
@@ -59,7 +62,8 @@ model-index:
59
  value: 57.15
60
  name: accuracy
61
  source:
62
- url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=TeeZee/BigMaid-20B-v1.0
 
63
  name: Open LLM Leaderboard
64
  - task:
65
  type: text-generation
@@ -75,7 +79,8 @@ model-index:
75
  - type: mc2
76
  value: 55.29
77
  source:
78
- url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=TeeZee/BigMaid-20B-v1.0
 
79
  name: Open LLM Leaderboard
80
  - task:
81
  type: text-generation
@@ -92,7 +97,8 @@ model-index:
92
  value: 75.3
93
  name: accuracy
94
  source:
95
- url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=TeeZee/BigMaid-20B-v1.0
 
96
  name: Open LLM Leaderboard
97
  - task:
98
  type: text-generation
@@ -109,7 +115,8 @@ model-index:
109
  value: 2.05
110
  name: accuracy
111
  source:
112
- url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=TeeZee/BigMaid-20B-v1.0
 
113
  name: Open LLM Leaderboard
114
  ---
115
 
@@ -155,5 +162,4 @@ Detailed results can be found [here](https://huggingface.co/datasets/open-llm-le
155
  |MMLU (5-Shot) |57.15|
156
  |TruthfulQA (0-shot) |55.29|
157
  |Winogrande (5-shot) |75.30|
158
- |GSM8k (5-shot) | 2.05|
159
-
 
8
  - text-generation-inference
9
  - merge
10
  - not-for-all-audiences
11
+ - awq
12
  model-index:
13
  - name: BigMaid-20B-v1.0
14
  results:
 
27
  value: 61.35
28
  name: normalized accuracy
29
  source:
30
+ url: >-
31
+ https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=TeeZee/BigMaid-20B-v1.0
32
  name: Open LLM Leaderboard
33
  - task:
34
  type: text-generation
 
44
  value: 85.26
45
  name: normalized accuracy
46
  source:
47
+ url: >-
48
+ https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=TeeZee/BigMaid-20B-v1.0
49
  name: Open LLM Leaderboard
50
  - task:
51
  type: text-generation
 
62
  value: 57.15
63
  name: accuracy
64
  source:
65
+ url: >-
66
+ https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=TeeZee/BigMaid-20B-v1.0
67
  name: Open LLM Leaderboard
68
  - task:
69
  type: text-generation
 
79
  - type: mc2
80
  value: 55.29
81
  source:
82
+ url: >-
83
+ https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=TeeZee/BigMaid-20B-v1.0
84
  name: Open LLM Leaderboard
85
  - task:
86
  type: text-generation
 
97
  value: 75.3
98
  name: accuracy
99
  source:
100
+ url: >-
101
+ https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=TeeZee/BigMaid-20B-v1.0
102
  name: Open LLM Leaderboard
103
  - task:
104
  type: text-generation
 
115
  value: 2.05
116
  name: accuracy
117
  source:
118
+ url: >-
119
+ https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=TeeZee/BigMaid-20B-v1.0
120
  name: Open LLM Leaderboard
121
  ---
122
 
 
162
  |MMLU (5-Shot) |57.15|
163
  |TruthfulQA (0-shot) |55.29|
164
  |Winogrande (5-shot) |75.30|
165
+ |GSM8k (5-shot) | 2.05|