rombodawg commited on
Commit
1ffd565
1 Parent(s): e5ea755

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +32 -1
README.md CHANGED
@@ -1,4 +1,35 @@
1
  ---
2
  license: other
 
 
3
  ---
4
- - wandb: [run34_megacode2_min100_13b](https://wandb.ai/open-assistant/epfl-mt-sft/runs/run34_megacode2_min100_13b)
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: other
3
+ datesets:
4
+ - rombodawg/LosslessMegaCodeTrainingV2_1m_Evol_Uncensored
5
  ---
6
+ This is one of the first models trained on the LosslessMegaCodeTrainingV2_1m_Evol_Uncensored dataset. The version of the dataset used for this model was poorly filtered on some loose parameters that arent anything to write home about but plans for much more refined filtering are in the works
7
+
8
+ This model was made as a colaboration between me and andreaskoepf who is an affiliate of Open Assistant.
9
+ Prompt template
10
+ chatml format is used: "<|im_start|>system\n{system message}<|im_end|>\n<|im_start|>user\n{user prompt}<|im_end|>\n<|im_start|>assistant\n{Assistant answer}<|im_end|>\n"
11
+
12
+ multi-line:
13
+ ```
14
+ <|im_start|>system
15
+ {system message}<|im_end|>
16
+ <|im_start|>user
17
+ {user prompt}<|im_end|>
18
+ <|im_start|>assistant
19
+ {Assistant answer}<|im_end|>
20
+ ```
21
+ Training data:
22
+
23
+ - https://wandb.ai/open-assistant/epfl-mt-sft/runs/run34_megacode2_min100_13b
24
+
25
+ The link for the full dataset is bellow:
26
+
27
+ - https://huggingface.co/datasets/rombodawg/LosslessMegaCodeTrainingV2_1m_Evol_Uncensored
28
+
29
+ Link for the filtered dataset used to make this model are bellow:
30
+
31
+ - https://huggingface.co/datasets/andreaskoepf/megacode2-min100
32
+
33
+ The original posting for this model was uploaded at the link bellow.
34
+
35
+ - https://huggingface.co/andreaskoepf/llama2-13b-megacode2_min100