Q-bert commited on
Commit
5886a58
1 Parent(s): 0793af4

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +26 -1
README.md CHANGED
@@ -14,4 +14,29 @@ tags:
14
 
15
  # MOLAR 10.7B
16
 
17
- <!-- Provide a quick summary of what the model is/does. -->
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
14
 
15
  # MOLAR 10.7B
16
 
17
+ Q-LoRA fine-tuned on **kyujinpy/Sakura-SOLAR-Instruct** with **meta-math/MetaMathQA**
18
+
19
+ Adapter model and normal model is avaible, you can download with both styles.
20
+
21
+ You must use this prompt style.
22
+
23
+ ```yaml
24
+ ### Query: <query>
25
+ ### Response: <response>
26
+ ```
27
+
28
+ # Loss Curve:
29
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/63da3d7ae697e5898cb86854/5OW8k59b_3rlqWlZfYkWx.png)
30
+
31
+ # [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
32
+ Detailed results will be found [Here]()
33
+
34
+ | Metric | Value |
35
+ |-----------------------|---------------------------|
36
+ | Avg. | |
37
+ | ARC (25-shot) | |
38
+ | HellaSwag (10-shot) | |
39
+ | MMLU (5-shot) | |
40
+ | TruthfulQA (0-shot) | |
41
+ | Winogrande (5-shot) | |
42
+ | GSM8K (5-shot) | |