Hugging Face's logo

922-CA
/
Llama-3-natsuki-ddlc-8b-v1

Text Generation
Transformers
PyTorch
English
llama
text-generation-inference
unsloth
trl
Eval Results
Inference Endpoints
Model card Files Community
2
922CA commited on
Commit
bcf9fe0
•
1 Parent(s): 6bf83b8

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +15 -8
README.md CHANGED
@@ -27,7 +27,8 @@ model-index:
27
  value: 60.32
28
  name: normalized accuracy
29
  source:
30
- url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=922-CA/Llama-3-natsuki-ddlc-8b-v1
 
31
  name: Open LLM Leaderboard
32
  - task:
33
  type: text-generation
@@ -43,7 +44,8 @@ model-index:
43
  value: 80.99
44
  name: normalized accuracy
45
  source:
46
- url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=922-CA/Llama-3-natsuki-ddlc-8b-v1
 
47
  name: Open LLM Leaderboard
48
  - task:
49
  type: text-generation
@@ -60,7 +62,8 @@ model-index:
60
  value: 64.75
61
  name: accuracy
62
  source:
63
- url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=922-CA/Llama-3-natsuki-ddlc-8b-v1
 
64
  name: Open LLM Leaderboard
65
  - task:
66
  type: text-generation
@@ -76,7 +79,8 @@ model-index:
76
  - type: mc2
77
  value: 45.41
78
  source:
79
- url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=922-CA/Llama-3-natsuki-ddlc-8b-v1
 
80
  name: Open LLM Leaderboard
81
  - task:
82
  type: text-generation
@@ -93,7 +97,8 @@ model-index:
93
  value: 78.77
94
  name: accuracy
95
  source:
96
- url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=922-CA/Llama-3-natsuki-ddlc-8b-v1
 
97
  name: Open LLM Leaderboard
98
  - task:
99
  type: text-generation
@@ -110,8 +115,11 @@ model-index:
110
  value: 41.85
111
  name: accuracy
112
  source:
113
- url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=922-CA/Llama-3-natsuki-ddlc-8b-v1
 
114
  name: Open LLM Leaderboard
 
 
115
  ---
116
 
117
  WIP
@@ -137,5 +145,4 @@ Detailed results can be found [here](https://huggingface.co/datasets/open-llm-le
137
  |MMLU (5-Shot) |64.75|
138
  |TruthfulQA (0-shot) |45.41|
139
  |Winogrande (5-shot) |78.77|
140
- |GSM8k (5-shot) |41.85|
141
-
 
27
  value: 60.32
28
  name: normalized accuracy
29
  source:
30
+ url: >-
31
+ https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=922-CA/Llama-3-natsuki-ddlc-8b-v1
32
  name: Open LLM Leaderboard
33
  - task:
34
  type: text-generation
 
44
  value: 80.99
45
  name: normalized accuracy
46
  source:
47
+ url: >-
48
+ https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=922-CA/Llama-3-natsuki-ddlc-8b-v1
49
  name: Open LLM Leaderboard
50
  - task:
51
  type: text-generation
 
62
  value: 64.75
63
  name: accuracy
64
  source:
65
+ url: >-
66
+ https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=922-CA/Llama-3-natsuki-ddlc-8b-v1
67
  name: Open LLM Leaderboard
68
  - task:
69
  type: text-generation
 
79
  - type: mc2
80
  value: 45.41
81
  source:
82
+ url: >-
83
+ https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=922-CA/Llama-3-natsuki-ddlc-8b-v1
84
  name: Open LLM Leaderboard
85
  - task:
86
  type: text-generation
 
97
  value: 78.77
98
  name: accuracy
99
  source:
100
+ url: >-
101
+ https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=922-CA/Llama-3-natsuki-ddlc-8b-v1
102
  name: Open LLM Leaderboard
103
  - task:
104
  type: text-generation
 
115
  value: 41.85
116
  name: accuracy
117
  source:
118
+ url: >-
119
+ https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=922-CA/Llama-3-natsuki-ddlc-8b-v1
120
  name: Open LLM Leaderboard
121
+ datasets:
122
+ - 922-CA/NaChA_v1
123
  ---
124
 
125
  WIP
 
145
  |MMLU (5-Shot) |64.75|
146
  |TruthfulQA (0-shot) |45.41|
147
  |Winogrande (5-shot) |78.77|
148
+ |GSM8k (5-shot) |41.85|