Felladrin commited on
Commit
8ca40a1
β€’
1 Parent(s): 6991572

Add Readme

Browse files
Files changed (1) hide show
  1. README.md +108 -0
README.md ADDED
@@ -0,0 +1,108 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: other
3
+ tags:
4
+ - text-generation
5
+ base_model: JackFram/llama-160m
6
+ datasets:
7
+ - ehartford/wizard_vicuna_70k_unfiltered
8
+ - totally-not-an-llm/EverythingLM-data-V3
9
+ - Open-Orca/SlimOrca-Dedup
10
+ - databricks/databricks-dolly-15k
11
+ - THUDM/webglm-qa
12
+ widget:
13
+ - text: |-
14
+ <|im_start|>system
15
+ You are a helpful assistant, who answers with empathy.<|im_end|>
16
+ <|im_start|>user
17
+ Got a question for you!<|im_end|>
18
+ <|im_start|>assistant
19
+ Sure! What's it?<|im_end|>
20
+ <|im_start|>user
21
+ Why do you love cats so much!? 🐈<|im_end|>
22
+ <|im_start|>assistant
23
+ - text: |-
24
+ <|im_start|>system
25
+ You are a helpful assistant who answers user's questions with empathy.<|im_end|>
26
+ <|im_start|>user
27
+ Who is Mona Lisa?<|im_end|>
28
+ <|im_start|>assistant
29
+ - text: |-
30
+ <|im_start|>system
31
+ You are a helpful assistant who provides concise responses.<|im_end|>
32
+ <|im_start|>user
33
+ Heya!<|im_end|>
34
+ <|im_start|>assistant
35
+ Hi! How may I help you today?<|im_end|>
36
+ <|im_start|>user
37
+ I need to build a simple website. Where should I start learning about web development?<|im_end|>
38
+ <|im_start|>assistant
39
+ - text: |-
40
+ <|im_start|>user
41
+ Invited some friends to come home today. Give me some ideas for games to play with them!<|im_end|>
42
+ <|im_start|>assistant
43
+ - text: |-
44
+ <|im_start|>system
45
+ You are a helpful assistant who answers user's questions with details and curiosity.<|im_end|>
46
+ <|im_start|>user
47
+ What are some potential applications for quantum computing?<|im_end|>
48
+ <|im_start|>assistant
49
+ - text: |-
50
+ <|im_start|>system
51
+ You are a helpful assistant who gives creative responses.<|im_end|>
52
+ <|im_start|>user
53
+ Write the specs of a game about mages in a fantasy world.<|im_end|>
54
+ <|im_start|>assistant
55
+ - text: |-
56
+ <|im_start|>system
57
+ You are a helpful assistant who answers user's questions with details.<|im_end|>
58
+ <|im_start|>user
59
+ Tell me about the pros and cons of social media.<|im_end|>
60
+ <|im_start|>assistant
61
+ - text: |-
62
+ <|im_start|>system
63
+ You are a helpful assistant who answers user's questions with confidence.<|im_end|>
64
+ <|im_start|>user
65
+ What is a dog?<|im_end|>
66
+ <|im_start|>assistant
67
+ A dog is a four-legged, domesticated animal that is a member of the class Mammalia, which includes all mammals. Dogs are known for their loyalty, playfulness, and ability to be trained for various tasks. They are also used for hunting, herding, and as service animals.<|im_end|>
68
+ <|im_start|>user
69
+ What is the color of an apple?<|im_end|>
70
+ <|im_start|>assistant
71
+ inference:
72
+ parameters:
73
+ max_new_tokens: 250
74
+ penalty_alpha: 0.5
75
+ top_k: 5
76
+ repetition_penalty: 1.01
77
+ ---
78
+
79
+ # A Llama Chat Model of 160M Parameters
80
+
81
+ - Base model: [JackFram/llama-160m](https://huggingface.co/JackFram/llama-160m)
82
+ - Datasets:
83
+ - [ehartford/wizard_vicuna_70k_unfiltered](https://huggingface.co/datasets/ehartford/wizard_vicuna_70k_unfiltered)
84
+ - [totally-not-an-llm/EverythingLM-data-V3](https://huggingface.co/datasets/totally-not-an-llm/EverythingLM-data-V3)
85
+ - [Open-Orca/SlimOrca-Dedup](https://huggingface.co/datasets/Open-Orca/SlimOrca-Dedup)
86
+ - [databricks/databricks-dolly-15k](https://huggingface.co/datasets/databricks/databricks-dolly-15k)
87
+ - [THUDM/webglm-qa](https://huggingface.co/datasets/THUDM/webglm-qa)
88
+
89
+ ## Recommended Prompt Format
90
+
91
+ The recommended prompt format is as follows:
92
+
93
+ ```
94
+ <|im_start|>system
95
+ {system_message}<|im_end|>
96
+ <|im_start|>user
97
+ {user_message}<|im_end|>
98
+ <|im_start|>assistant
99
+ ```
100
+
101
+ ## Recommended Inference Parameters
102
+
103
+ To get the best results, prefer using [contrastive search](https://huggingface.co/docs/transformers/main/en/generation_strategies#contrastive-search) for inference:
104
+
105
+ ```yml
106
+ penalty_alpha: 0.5
107
+ top_k: 5
108
+ ```