tjellm commited on
Commit
2e53a73
1 Parent(s): 9bffc21

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +36 -0
README.md CHANGED
@@ -1,3 +1,39 @@
1
  ---
2
  license: apache-2.0
 
 
 
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: apache-2.0
3
+ datasets:
4
+ - cognitivecomputations/dolphin
5
+ - cognitivecomputations/dolphin-coder
6
+ - ise-uiuc/Magicoder-OSS-Instruct-75K
7
+ - teknium/openhermes
8
+ - migtissera/Synthia-v1.3
9
+ language:
10
+ - en
11
  ---
12
+
13
+ # Model Description
14
+ This is fine-tuned model based on EmbeddedLLM/Mistral-7B-Merge-14-v0.3 for 3 epochs.
15
+ The dataset used are:
16
+ * dophin
17
+ * dolphin-coder
18
+ * Magicoder-OSS-Instruct-75K
19
+ * openhermes
20
+ * Synthia-v1.3
21
+
22
+ ## Chat Template
23
+ Prompt format: This model uses ChatML prompt format.
24
+
25
+ ```
26
+ <|im_start|>system
27
+ You are Dolphin, a helpful AI assistant.<|im_end|>
28
+ <|im_start|>user
29
+ {prompt}<|im_end|>
30
+ <|im_start|>assistant
31
+ ```
32
+
33
+ # Training
34
+ The model has been fine-tuned for 3 epochs on 4 A100s using axolotl.
35
+
36
+
37
+ # Shout-Out to OSS
38
+ Thank you to the Open Source AI community for bringing together marvelous code frameworks and datasets.
39
+