Update README.md
Browse files
README.md
CHANGED
@@ -14,47 +14,33 @@ datasets:
|
|
14 |
- mlabonne/chatml_dpo_pairs
|
15 |
pipeline_tag: text-generation
|
16 |
widget:
|
17 |
-
-
|
18 |
-
|
19 |
-
|
20 |
-
|
21 |
-
|
22 |
-
|
23 |
-
|
24 |
-
|
25 |
-
|
26 |
-
|
27 |
-
|
28 |
-
|
29 |
-
|
30 |
-
|
31 |
-
|
32 |
-
|
33 |
-
|
34 |
-
|
35 |
-
|
36 |
-
|
37 |
-
|
38 |
-
|
39 |
-
|
40 |
-
-
|
41 |
-
|
42 |
-
|
43 |
-
|
44 |
-
<|im_start|>user
|
45 |
-
|
46 |
-
What are some potential applications for quantum computing?<|im_end|>
|
47 |
-
|
48 |
-
<|im_start|>assistant'
|
49 |
-
- text: '<|im_start|>system
|
50 |
-
|
51 |
-
You are a highly knowledgeable assistant. Help the user as much as you can.<|im_end|>
|
52 |
-
|
53 |
-
<|im_start|>user
|
54 |
-
|
55 |
-
What are some steps I can take to become a healthier person?<|im_end|>
|
56 |
-
|
57 |
-
<|im_start|>assistant'
|
58 |
inference:
|
59 |
parameters:
|
60 |
max_new_tokens: 250
|
@@ -280,7 +266,7 @@ DPOTrainer(
|
|
280 |
)
|
281 |
```
|
282 |
|
283 |
-
|
284 |
Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_Felladrin__Pythia-31M-Chat-v1)
|
285 |
|
286 |
| Metric |Value|
|
@@ -292,4 +278,3 @@ Detailed results can be found [here](https://huggingface.co/datasets/open-llm-le
|
|
292 |
|TruthfulQA (0-shot) | 0.00|
|
293 |
|Winogrande (5-shot) |47.99|
|
294 |
|GSM8k (5-shot) | 0.00|
|
295 |
-
|
|
|
14 |
- mlabonne/chatml_dpo_pairs
|
15 |
pipeline_tag: text-generation
|
16 |
widget:
|
17 |
+
- messages:
|
18 |
+
- role: system
|
19 |
+
content: >-
|
20 |
+
You are a career counselor. The user will provide you with an individual
|
21 |
+
looking for guidance in their professional life, and your task is to assist
|
22 |
+
them in determining what careers they are most suited for based on their skills,
|
23 |
+
interests, and experience. You should also conduct research into the various
|
24 |
+
options available, explain the job market trends in different industries, and
|
25 |
+
advice on which qualifications would be beneficial for pursuing particular fields.
|
26 |
+
- role: user
|
27 |
+
content: Heya!
|
28 |
+
- role: assistant
|
29 |
+
content: Hi! How may I help you?
|
30 |
+
- role: user
|
31 |
+
content: >-
|
32 |
+
I am interested in developing a career in software engineering. What
|
33 |
+
would you recommend me to do?
|
34 |
+
- messages:
|
35 |
+
- role: system
|
36 |
+
content: "You are a helpful assistant who answers user's questions with details and curiosity."
|
37 |
+
- role: user
|
38 |
+
content: What are some potential applications for quantum computing?
|
39 |
+
- messages:
|
40 |
+
- role: system
|
41 |
+
content: You are a highly knowledgeable assistant. Help the user as much as you can.
|
42 |
+
- role: user
|
43 |
+
content: What are some steps I can take to become a healthier person?
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
44 |
inference:
|
45 |
parameters:
|
46 |
max_new_tokens: 250
|
|
|
266 |
)
|
267 |
```
|
268 |
|
269 |
+
## [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
|
270 |
Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_Felladrin__Pythia-31M-Chat-v1)
|
271 |
|
272 |
| Metric |Value|
|
|
|
278 |
|TruthfulQA (0-shot) | 0.00|
|
279 |
|Winogrande (5-shot) |47.99|
|
280 |
|GSM8k (5-shot) | 0.00|
|
|