rombodawg commited on
Commit
390a136
1 Parent(s): e8fd38f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +70 -0
README.md CHANGED
@@ -1,3 +1,73 @@
1
  ---
2
  license: apache-2.0
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: apache-2.0
3
+ datasets:
4
+ - rombodawg/LosslessMegaCodeTrainingV2_1m_Evol_Uncensored
5
  ---
6
+ This is one of the first models trained on the LosslessMegaCodeTrainingV2_1m_Evol_Uncensored dataset. The version of the dataset used for this model was filtered by removed any data with less than 100 tokens but plans for much more refined filtering are in the works
7
+
8
+ - This model was made as a colaboration between me and andreaskoepf who is an affiliate of Open Assistant.
9
+
10
+ Prompt template:
11
+
12
+ - chatml format is used: "<|im_start|>system\n{system message}<|im_end|>\n<|im_start|>user\n{user prompt}<|im_end|>\n<|im_start|>assistant\n{Assistant answer}<|im_end|>\n"
13
+
14
+ multi-line:
15
+ ```
16
+ <|im_start|>system
17
+ {system message}<|im_end|>
18
+ <|im_start|>user
19
+ {user prompt}<|im_end|>
20
+ <|im_start|>assistant
21
+ {Assistant answer}<|im_end|>
22
+ ```
23
+ Gpt4all template:
24
+
25
+ - System prompt
26
+ ```
27
+ <|im_start|>system
28
+ {system message}
29
+ ```
30
+ - Prompt template
31
+ ```
32
+ <|im_end|>
33
+ <|im_start|>user
34
+ %1<|im_end|>
35
+ <|im_start|>assistant
36
+ ```
37
+
38
+ Oobagooba Text-Generation-Webui Template
39
+ - user:
40
+ ```
41
+ <|im_start|>user
42
+ {User string}<|im_end|>
43
+ ```
44
+ - bot:
45
+ ```
46
+ <|im_start|>assistant
47
+ {Bot string}<|im_end|>
48
+ ```
49
+ - turn_template:
50
+ ```
51
+ <|user|>\n<|user-message|>\n\n<|bot|>\n<|bot-message|>\n\n
52
+ ```
53
+ - context:
54
+ ```
55
+ <|im_start|>system
56
+ Below is an instruction that describes a task. Write a response that appropriately completes the request.<|im_end|>
57
+ ```
58
+
59
+ Current quantizations available:
60
+
61
+ - (COMING SOON)
62
+
63
+ The link for the full dataset is bellow:
64
+
65
+ - https://huggingface.co/datasets/rombodawg/LosslessMegaCodeTrainingV2_1m_Evol_Uncensored
66
+
67
+ Link for the filtered dataset used to make this model are bellow:
68
+
69
+ - https://huggingface.co/datasets/andreaskoepf/megacode2-min100
70
+
71
+ The original posting for this model was uploaded at the link bellow.
72
+
73
+ - https://huggingface.co/andreaskoepf/falcon-40b-megacode2