SicariusSicariiStuff commited on
Commit
1764de9
1 Parent(s): 7174f18

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -41,7 +41,7 @@ I love you all unconditionally, thanks for all the support and kind words!
41
 
42
 
43
 
44
- The model was trained on ~**50M** tokens (the vast majority- is unique) at **16K** actual context length. Different techniques and experiments were done to achieve various capabilities and to preserve (and even enhance) the smarts while keeping censorship low. More information about this is available on my '[**blog**](https://huggingface.co/SicariusSicariiStuff/Blog_And_Updates)', which serves as a form of archival memoir of the past months.
45
 
46
 
47
  More than **50%** of the data is **human-written**, the major part of the synthetic data is a work-in-progress and will be de-slopped in the future. For **now**, the sacrifice of slop for smarts is acceptable. In the final release, a lot of it will be de-sloped completely.
 
41
 
42
 
43
 
44
+ The model was trained on ~**50M** tokens (the vast majority- is unique) at **16K** actual context length. Different techniques and experiments were done to achieve various capabilities and to preserve (and even enhance) the smarts while keeping censorship low. More information about this is available at my '[**blog**](https://huggingface.co/SicariusSicariiStuff/Blog_And_Updates)', which serves as a form of archival memoir of the past months.
45
 
46
 
47
  More than **50%** of the data is **human-written**, the major part of the synthetic data is a work-in-progress and will be de-slopped in the future. For **now**, the sacrifice of slop for smarts is acceptable. In the final release, a lot of it will be de-sloped completely.