Update README.md

Files changed (1) hide show

README.md CHANGED Viewed

@@ -41,7 +41,7 @@ I love you all unconditionally, thanks for all the support and kind words!
-The model was trained on ~**50M** tokens (the vast majority of it is unique) at **16K** actual context length. Different techniques and experiments were done to achieve various capabilities and to preserve (and even enhance) the smarts while keeping censorship low. More information about this is available on my '[**blog**](https://huggingface.co/SicariusSicariiStuff/Blog_And_Updates)', which serves as a form of archival memoir of the past months.
   More than **50%** of the data is **human-written**, the major part of the synthetic data is a work-in-progress and will be de-slopped in the future. For **now**, the sacrifice of slop for smarts is acceptable. In the final release, a lot of it will be de-sloped completely.


41
42
43
44	+ The model was trained on ~50M tokens (the vast majority- is unique) at 16K actual context length. Different techniques and experiments were done to achieve various capabilities and to preserve (and even enhance) the smarts while keeping censorship low. More information about this is available on my '[blog](https://huggingface.co/SicariusSicariiStuff/Blog_And_Updates)', which serves as a form of archival memoir of the past months.
45
46
47	More than 50% of the data is human-written, the major part of the synthetic data is a work-in-progress and will be de-slopped in the future. For now, the sacrifice of slop for smarts is acceptable. In the final release, a lot of it will be de-sloped completely.