SicariusSicariiStuff
commited on
Commit
•
1764de9
1
Parent(s):
7174f18
Update README.md
Browse files
README.md
CHANGED
@@ -41,7 +41,7 @@ I love you all unconditionally, thanks for all the support and kind words!
|
|
41 |
|
42 |
|
43 |
|
44 |
-
The model was trained on ~**50M** tokens (the vast majority- is unique) at **16K** actual context length. Different techniques and experiments were done to achieve various capabilities and to preserve (and even enhance) the smarts while keeping censorship low. More information about this is available
|
45 |
|
46 |
|
47 |
More than **50%** of the data is **human-written**, the major part of the synthetic data is a work-in-progress and will be de-slopped in the future. For **now**, the sacrifice of slop for smarts is acceptable. In the final release, a lot of it will be de-sloped completely.
|
|
|
41 |
|
42 |
|
43 |
|
44 |
+
The model was trained on ~**50M** tokens (the vast majority- is unique) at **16K** actual context length. Different techniques and experiments were done to achieve various capabilities and to preserve (and even enhance) the smarts while keeping censorship low. More information about this is available at my '[**blog**](https://huggingface.co/SicariusSicariiStuff/Blog_And_Updates)', which serves as a form of archival memoir of the past months.
|
45 |
|
46 |
|
47 |
More than **50%** of the data is **human-written**, the major part of the synthetic data is a work-in-progress and will be de-slopped in the future. For **now**, the sacrifice of slop for smarts is acceptable. In the final release, a lot of it will be de-sloped completely.
|