Safetensors
gemma2
creative-writing
sam-paech commited on
Commit
55f6ba0
·
verified ·
1 Parent(s): 52128a5

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +7 -1
README.md CHANGED
@@ -15,11 +15,17 @@ base_model:
15
 
16
  # Darkest-muse-v1
17
 
 
 
18
  GGUFs here: [https://huggingface.co/mradermacher/Darkest-muse-v1-GGUF](https://huggingface.co/mradermacher/Darkest-muse-v1-GGUF)
19
 
20
  This is a creative writing merge of two very different models that I trained on the brand new [Gutenberg3 dataset](https://huggingface.co/datasets/sam-paech/gutenberg3-generalfiction-scifi-fantasy-romance-adventure-dpo), plus [Ataraxy-v2](https://huggingface.co/lemon07r/Gemma-2-Ataraxy-v2-9B) in the mix.
21
 
22
- It seems to be quite uncensored and low slop. The high creativity is thanks to the overcooked Delirium model, which likes to inject its macabre and viscerally grotesque vibes. Since this source model has been pushed right to the edge during training, the merge may exhibit some of its weirdness and word / concept fixations. This may be mitigated by using custom anti-slop lists.
 
 
 
 
23
 
24
  The payoff is a really creative, stream of consciousness style of writing, with punchy dialogue that I haven't seen in other models. Oh, it also scored around the top of the [EQ-Bench creative writing leaderboard](https://eqbench.com/creative_writing.html)!~
25
 
 
15
 
16
  # Darkest-muse-v1
17
 
18
+ Fine-tuned from Gemma-2-9b-it.
19
+
20
  GGUFs here: [https://huggingface.co/mradermacher/Darkest-muse-v1-GGUF](https://huggingface.co/mradermacher/Darkest-muse-v1-GGUF)
21
 
22
  This is a creative writing merge of two very different models that I trained on the brand new [Gutenberg3 dataset](https://huggingface.co/datasets/sam-paech/gutenberg3-generalfiction-scifi-fantasy-romance-adventure-dpo), plus [Ataraxy-v2](https://huggingface.co/lemon07r/Gemma-2-Ataraxy-v2-9B) in the mix.
23
 
24
+ It's lost much of the slop and tryhard vocab flexing and positivity bias that's typical of these models and writes in its own voice.
25
+
26
+ The main source model in the merge, Quill-v1, inherited a natural, spare prose from the human writing in the gutenberg set. The other source model, Delirium-v1, got overcooked in SIMPO training; it has crazy panache, a really dark flair for the grotesque, and has some mental issues. These two source models balance each other out in the merge, resulting in something pretty unique.
27
+
28
+ It seems to be quite uncensored and creative. Since Delirium was pushed right to the edge during training, the merge may exhibit some of its weirdness and word / concept fixations. This may be mitigated by using custom anti-slop lists.
29
 
30
  The payoff is a really creative, stream of consciousness style of writing, with punchy dialogue that I haven't seen in other models. Oh, it also scored around the top of the [EQ-Bench creative writing leaderboard](https://eqbench.com/creative_writing.html)!~
31