Text Generation
GGUF
English
mixture of experts
Mixture of Experts
4x7B
mistral MOE
uncensored
creative
creative writing
fiction writing
plot generation
sub-plot generation
story generation
scene continue
storytelling
fiction story
science fiction
romance
all genres
story
writing
vivid prosing
vivid writing
fiction
roleplaying
bfloat16
swearing
rp
horror
mergekit
Inference Endpoints
conversational
Create README.md
Browse files
README.md
ADDED
@@ -0,0 +1,567 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
license: apache-2.0
|
3 |
+
language:
|
4 |
+
- en
|
5 |
+
tags:
|
6 |
+
- mixture of experts
|
7 |
+
- moe
|
8 |
+
- 4x3B
|
9 |
+
- Llama 3.2 MOE
|
10 |
+
- uncensored
|
11 |
+
- creative
|
12 |
+
- creative writing
|
13 |
+
- fiction writing
|
14 |
+
- plot generation
|
15 |
+
- sub-plot generation
|
16 |
+
- fiction writing
|
17 |
+
- story generation
|
18 |
+
- scene continue
|
19 |
+
- storytelling
|
20 |
+
- fiction story
|
21 |
+
- science fiction
|
22 |
+
- romance
|
23 |
+
- all genres
|
24 |
+
- story
|
25 |
+
- writing
|
26 |
+
- vivid prosing
|
27 |
+
- vivid writing
|
28 |
+
- fiction
|
29 |
+
- roleplaying
|
30 |
+
- bfloat16
|
31 |
+
- swearing
|
32 |
+
- rp
|
33 |
+
- horror
|
34 |
+
- mergekit
|
35 |
+
pipeline_tag: text-generation
|
36 |
+
---
|
37 |
+
|
38 |
+
(quants uploading, 1 example below (1,2,3 and 4 experts output shown) to be added)
|
39 |
+
|
40 |
+
<B><font color="red">WARNING:</font> NSFW. Vivid prose. INTENSE. Visceral Details. HORROR. Swearing. UNCENSORED... humor, romance, fun. </B>
|
41 |
+
|
42 |
+
<h2>Mistral-MOE-4X7B-Dark-MultiVerse-24B-GGUF</h2>
|
43 |
+
|
44 |
+
<img src="moe-hell.jpg" style="float:right; width:300px; height:300px; padding:10px;">
|
45 |
+
|
46 |
+
It is a Mistral model, max context of 32k (32768) using mixture of experts to combine FOUR top Mistral 7B
|
47 |
+
models into one massive powerhouse at 24B parameters (equal to 28B - 4 X 7 B).
|
48 |
+
|
49 |
+
All models used are uncensored.
|
50 |
+
|
51 |
+
This model's instruction following, and output generation for creative writing, prose, fiction and role play are exceptional.
|
52 |
+
|
53 |
+
And it is fast: 48+ t/s (2 experts) on a low end 16GB card, IQ4XS.
|
54 |
+
|
55 |
+
Double this speed for standard/mid-range video cards.
|
56 |
+
|
57 |
+
Model can be used also for all genres (examples below showing this).
|
58 |
+
|
59 |
+
It is for any writing, fiction or roleplay activity.
|
60 |
+
|
61 |
+
This model can also be used for general use, however its output generation can be uncensored.
|
62 |
+
|
63 |
+
This model has been designed to be relatively bullet proof and operates with all parameters, including temp settings from 0 to 5.
|
64 |
+
|
65 |
+
It is an extraordinary compressed model, with a very low perplexity level (lower than Meta Llama3 Instruct).
|
66 |
+
|
67 |
+
It requires Llama3 template, Mistral, Alpaca and/or "Command-R" template.
|
68 |
+
|
69 |
+
Several prompts and outputs below, including 2, 3, and 4.
|
70 |
+
|
71 |
+
Last example shows how to get the model to be a bit more... ahem raunchy and use of 1,2,3 and 4 experts.
|
72 |
+
|
73 |
+
<B>Model Notes:</B>
|
74 |
+
|
75 |
+
- Detail, prose and fiction writing abilities are OFF THE SCALE relative 7B+ Mistral Models.
|
76 |
+
- For more varied prose (sentence/paragraph/dialog) raise the temp and/or add more instructions in your prompt(s).
|
77 |
+
- Role-players: Careful raising temp too high as it may affect instruction following.
|
78 |
+
- This model works with rep pen of 1 or higher, 1.02+ recommended.
|
79 |
+
- If you want a specific type of prose (IE horror) add in "(vivid horror)" or "(graphic vivid horror)" (no quotes) in your prompt(s).
|
80 |
+
- A lot of GPTisms have been removed. There are still a few however - errrrr. Higher "temps" will help with this issue.
|
81 |
+
- This is not a "happy ever after" model but it is also not "horror". It has a light negative bias.
|
82 |
+
- Output length will vary however this model prefers slightly longer outputs unless you state the size.
|
83 |
+
- For creative uses, different quants will produce slightly different output.
|
84 |
+
- Due to the high stability and compressed nature of this model, all quants will operate at above average levels.
|
85 |
+
- Source code for this model and Imatrix GGUFs versions will be uploaded shortly at separate repos.
|
86 |
+
|
87 |
+
<B>Meet the Team: Mixture of Experts Models</b>
|
88 |
+
|
89 |
+
This model is comprised of the following 4 models ("the experts") (in full):
|
90 |
+
|
91 |
+
https://huggingface.co/MTSAIR/multi_verse_model
|
92 |
+
|
93 |
+
- https://huggingface.co/TeeZee/DarkSapling-7B-v1.0
|
94 |
+
- https://huggingface.co/TeeZee/DarkSapling-7B-v1.1
|
95 |
+
- https://huggingface.co/TeeZee/DarkSapling-7B-v2.0
|
96 |
+
- https://huggingface.co/MTSAIR/multi_verse_model
|
97 |
+
|
98 |
+
The mixture of experts is set at 2 experts, but you can use 3, or 4.
|
99 |
+
|
100 |
+
This "team" has a Captain (first listed model), and then all the team members contribute to the to "token"
|
101 |
+
choice billions of times per second. Note the Captain also contributes too.
|
102 |
+
|
103 |
+
Think of 2, 3 or 4 (or more) master chefs in the kitchen all competing to make the best dish for you.
|
104 |
+
|
105 |
+
This results in higher quality generation.
|
106 |
+
|
107 |
+
This also results in many cases in higher quality instruction following too.
|
108 |
+
|
109 |
+
That means the power of every model is available during instruction and output generation.
|
110 |
+
|
111 |
+
NOTE:
|
112 |
+
|
113 |
+
You can use one "expert" too ; however this means the model will randomly select an expert to use EACH TIME, resulting
|
114 |
+
in very different generation for each prompt / regen of a prompt.
|
115 |
+
|
116 |
+
CHANGING THE NUMBER OF EXPERTS:
|
117 |
+
|
118 |
+
You can set the number of experts in LMStudio (https://lmstudio.ai) at the "load" screen and via other apps/llm apps by setting "Experts" or "Number of Experts".
|
119 |
+
|
120 |
+
For Text-Generation-Webui (https://github.com/oobabooga/text-generation-webui) you set the number of experts at the loading screen page.
|
121 |
+
|
122 |
+
For server.exe / Llama-server.exe (Llamacpp - https://github.com/ggerganov/llama.cpp/blob/master/examples/server/README.md )
|
123 |
+
add the following to the command line to start the "llamacpp server" (CLI):
|
124 |
+
|
125 |
+
"--override-kv llama.expert_used_count=int:3"
|
126 |
+
|
127 |
+
(no quotes, where "3" is the number of experts to use)
|
128 |
+
|
129 |
+
When using "API", you set the "num_experts_used" in the JSON payload (this maybe different for different back ends).
|
130 |
+
|
131 |
+
CREDITS:
|
132 |
+
|
133 |
+
Special thanks to all the model makers / creators listed above.
|
134 |
+
|
135 |
+
Please visit each repo above to see what model(s) contributed to each of models above and/or to learn more about the models
|
136 |
+
from the model makers.
|
137 |
+
|
138 |
+
Special credit goes to MERGEKIT, without you this project / model would not have been possible.
|
139 |
+
|
140 |
+
[ https://github.com/arcee-ai/mergekit ]
|
141 |
+
|
142 |
+
<B>Special Operations Notes for this MOE model:</B>
|
143 |
+
|
144 |
+
Because of how this "MOE" model is configured, even though the default is 2 experts, the "selected" 2 will vary during generation.
|
145 |
+
|
146 |
+
(same applies if you change the number of experts used)
|
147 |
+
|
148 |
+
This results in vastly different output generation PER generation of each prompt.
|
149 |
+
|
150 |
+
This is a positive in terms of variety, but also means it may take 2-4 regens (of the same prompt) to get the highest quality.
|
151 |
+
|
152 |
+
In addition, this model responds very well to Dry, Dynamic Temp, and Smooth/Quadratic samplers.
|
153 |
+
|
154 |
+
Using these in conjunction with the model can vastly improve output quality.
|
155 |
+
|
156 |
+
Higher temps (above 1) can also aid in generation - especially word choice/sentence generation.
|
157 |
+
|
158 |
+
When you increase the number of experts used output quality will also increase, at the cost of tokens per second speed.
|
159 |
+
|
160 |
+
As you increase/decrease the number of experts, you may want to adjust temp, samplers, and advanced samplers too.
|
161 |
+
|
162 |
+
Your quant choice(s) too will impact instruction following and output generation roughly this means the model will understand
|
163 |
+
more nuanced instructions and output stronger generation the higher you go up in quant(s).
|
164 |
+
|
165 |
+
MORE COOKS THE BETTER:
|
166 |
+
|
167 |
+
Activating more "experts" will increase the quality of the model's output. All four, although slower... will yeild the best results.
|
168 |
+
|
169 |
+
CRANK THE TEMP:
|
170 |
+
|
171 |
+
This model loves temp. Although .5 to .9 will "do", it really shines at 1.5+.
|
172 |
+
|
173 |
+
Likewise, if you activate Dynamic Temp.
|
174 |
+
|
175 |
+
FLASH ATTENTION ENHANCEMENT:
|
176 |
+
|
177 |
+
As per user feedback here [ https://huggingface.co/DavidAU/Llama-3.2-8X3B-MOE-Dark-Champion-Instruct-uncensored-abliterated-18.4B-GGUF/discussions/1 ]
|
178 |
+
I would suggest trying this model with Flash Attention "on", depending on your use case.
|
179 |
+
|
180 |
+
Quants, Samplers, Generational steering and other topics are covered in the section below: "Highest Quality Settings..."
|
181 |
+
|
182 |
+
<B>Censored / Uncensored / Abliterated:</B>
|
183 |
+
|
184 |
+
This model contains several uncensored and/or Abliterated models.
|
185 |
+
|
186 |
+
As a result is can output uncensored material.
|
187 |
+
|
188 |
+
<B>What can I use this model for ?</B>
|
189 |
+
|
190 |
+
This model can be used for fiction writing, any creative prose and role play. It can also be used for
|
191 |
+
just about any general fiction (all genres) activity including:
|
192 |
+
|
193 |
+
- scene generation
|
194 |
+
- scene continuation
|
195 |
+
- creative writing
|
196 |
+
- fiction writing
|
197 |
+
- plot generation
|
198 |
+
- sub-plot generation
|
199 |
+
- fiction writing
|
200 |
+
- story generation
|
201 |
+
- storytelling
|
202 |
+
- writing
|
203 |
+
- fiction
|
204 |
+
- roleplaying
|
205 |
+
- rp
|
206 |
+
- graphic horror
|
207 |
+
- horror
|
208 |
+
- dark humor
|
209 |
+
- nsfw
|
210 |
+
- and can be used for any genre(s).
|
211 |
+
|
212 |
+
<B>QUANTS:</B>
|
213 |
+
|
214 |
+
This repo contains regular quants and 3 "ARM" quants (format "...Q4_x_x_x.gguf")
|
215 |
+
|
216 |
+
For more information on quants, quants choices, and LLM/AI apps to "run" quants see the section below: "Highest Quality Settings..."
|
217 |
+
|
218 |
+
<B>Template:</B>
|
219 |
+
|
220 |
+
This is a LLAMA3 model, (or Mistral, or Alpaca) and requires Llama3 template, but may work with other template(s).
|
221 |
+
|
222 |
+
If you use "Command-R" template your output will be very different from using "Llama3" template.
|
223 |
+
|
224 |
+
Here is the standard LLAMA3 template:
|
225 |
+
|
226 |
+
<PRE>
|
227 |
+
{
|
228 |
+
"name": "Llama 3",
|
229 |
+
"inference_params": {
|
230 |
+
"input_prefix": "<|start_header_id|>user<|end_header_id|>\n\n",
|
231 |
+
"input_suffix": "<|eot_id|><|start_header_id|>assistant<|end_header_id|>\n\n",
|
232 |
+
"pre_prompt": "You are a helpful, smart, kind, and efficient AI assistant. You always fulfill the user's requests to the best of your ability.",
|
233 |
+
"pre_prompt_prefix": "<|start_header_id|>system<|end_header_id|>\n\n",
|
234 |
+
"pre_prompt_suffix": "<|eot_id|>",
|
235 |
+
"antiprompt": [
|
236 |
+
"<|start_header_id|>",
|
237 |
+
"<|eot_id|>"
|
238 |
+
]
|
239 |
+
}
|
240 |
+
}
|
241 |
+
</PRE>
|
242 |
+
|
243 |
+
<B>Settings: CHAT / ROLEPLAY and/or SMOOTHER operation of this model:</B>
|
244 |
+
|
245 |
+
In "KoboldCpp" or "oobabooga/text-generation-webui" or "Silly Tavern" ;
|
246 |
+
|
247 |
+
Set the "Smoothing_factor" to 1.5
|
248 |
+
|
249 |
+
: in KoboldCpp -> Settings->Samplers->Advanced-> "Smooth_F"
|
250 |
+
|
251 |
+
: in text-generation-webui -> parameters -> lower right.
|
252 |
+
|
253 |
+
: In Silly Tavern this is called: "Smoothing"
|
254 |
+
|
255 |
+
|
256 |
+
NOTE: For "text-generation-webui"
|
257 |
+
|
258 |
+
-> if using GGUFs you need to use "llama_HF" (which involves downloading some config files from the SOURCE version of this model)
|
259 |
+
|
260 |
+
Source versions (and config files) of my models are here:
|
261 |
+
|
262 |
+
https://huggingface.co/collections/DavidAU/d-au-source-files-for-gguf-exl2-awq-gptq-hqq-etc-etc-66b55cb8ba25f914cbf210be
|
263 |
+
|
264 |
+
OTHER OPTIONS:
|
265 |
+
|
266 |
+
- Increase rep pen to 1.1 to 1.15 (you don't need to do this if you use "smoothing_factor")
|
267 |
+
|
268 |
+
- If the interface/program you are using to run AI MODELS supports "Quadratic Sampling" ("smoothing") just make the adjustment as noted.
|
269 |
+
|
270 |
+
<B>Highest Quality Settings / Optimal Operation Guide / Parameters and Samplers</B>
|
271 |
+
|
272 |
+
This a "Class 1" model:
|
273 |
+
|
274 |
+
For all settings used for this model (including specifics for its "class"), including example generation(s) and for advanced settings guide (which many times addresses any model issue(s)), including methods to improve model performance for all use case(s) as well as chat, roleplay and other use case(s) please see:
|
275 |
+
|
276 |
+
[ https://huggingface.co/DavidAU/Maximizing-Model-Performance-All-Quants-Types-And-Full-Precision-by-Samplers_Parameters ]
|
277 |
+
|
278 |
+
You can see all parameters used for generation, in addition to advanced parameters and samplers to get the most out of this model here:
|
279 |
+
|
280 |
+
[ https://huggingface.co/DavidAU/Maximizing-Model-Performance-All-Quants-Types-And-Full-Precision-by-Samplers_Parameters ]
|
281 |
+
|
282 |
+
|
283 |
+
<b>Optional Enhancement:</B>
|
284 |
+
|
285 |
+
The following can be used in place of the "system prompt" or "system role" to further enhance the model.
|
286 |
+
|
287 |
+
It can also be used at the START of a NEW chat, but you must make sure it is "kept" as the chat moves along.
|
288 |
+
In this case the enhancements do not have as strong effect at using "system prompt" or "system role".
|
289 |
+
|
290 |
+
Copy and paste EXACTLY as noted, DO NOT line wrap or break the lines, maintain the carriage returns exactly as presented.
|
291 |
+
|
292 |
+
<PRE>
|
293 |
+
Below is an instruction that describes a task. Ponder each user instruction carefully, and use your skillsets and critical instructions to complete the task to the best of your abilities.
|
294 |
+
|
295 |
+
Here are your skillsets:
|
296 |
+
[MASTERSTORY]:NarrStrct(StryPlnng,Strbd,ScnSttng,Exps,Dlg,Pc)-CharDvlp(ChrctrCrt,ChrctrArcs,Mtvtn,Bckstry,Rltnshps,Dlg*)-PltDvlp(StryArcs,PltTwsts,Sspns,Fshdwng,Climx,Rsltn)-ConfResl(Antg,Obstcls,Rsltns,Cnsqncs,Thms,Symblsm)-EmotImpct(Empt,Tn,Md,Atmsphr,Imgry,Symblsm)-Delvry(Prfrmnc,VcActng,PblcSpkng,StgPrsnc,AudncEngmnt,Imprv)
|
297 |
+
|
298 |
+
[*DialogWrt]:(1a-CharDvlp-1a.1-Backgrnd-1a.2-Personality-1a.3-GoalMotiv)>2(2a-StoryStruc-2a.1-PlotPnt-2a.2-Conflict-2a.3-Resolution)>3(3a-DialogTech-3a.1-ShowDontTell-3a.2-Subtext-3a.3-VoiceTone-3a.4-Pacing-3a.5-VisualDescrip)>4(4a-DialogEdit-4a.1-ReadAloud-4a.2-Feedback-4a.3-Revision)
|
299 |
+
|
300 |
+
Here are your critical instructions:
|
301 |
+
Ponder each word choice carefully to present as vivid and emotional journey as is possible. Choose verbs and nouns that are both emotional and full of imagery. Load the story with the 5 senses. Aim for 50% dialog, 25% narration, 15% body language and 10% thoughts. Your goal is to put the reader in the story.
|
302 |
+
</PRE>
|
303 |
+
|
304 |
+
You do not need to use this, it is only presented as an additional enhancement which seems to help scene generation
|
305 |
+
and scene continue functions.
|
306 |
+
|
307 |
+
This enhancement WAS NOT used to generate the examples below.
|
308 |
+
|
309 |
+
<h3>EXAMPLES PROMPTS and OUTPUT:</h3>
|
310 |
+
|
311 |
+
Examples are created using quant Q4_K_S, "temp=.8" (unless otherwise stated), minimal parameters and "LLAMA3" template.
|
312 |
+
|
313 |
+
Model has been tested with "temp" from ".1" to "5".
|
314 |
+
|
315 |
+
Number of experts used is TWO, unless otherwise stated.
|
316 |
+
|
317 |
+
Below are the least creative outputs, prompt is in <B>BOLD</B>.
|
318 |
+
|
319 |
+
IMPORTANT:
|
320 |
+
|
321 |
+
Higher quants / imatrix quants will have much stronger generation - words, sentences, ideas, dialog and general quality.
|
322 |
+
|
323 |
+
I have included some additional examples at different quant levels for contrast.
|
324 |
+
|
325 |
+
A "MOE" model "speed" (token per second) will not increase/drop the same way a regular model will on a per quant basis, it will however drop
|
326 |
+
if you engage more experts, as with more experts there is a more processing per token.
|
327 |
+
|
328 |
+
---
|
329 |
+
|
330 |
+
<B><font color="red">WARNING:</font> NSFW. Vivid prose. Visceral Details. Violence. HORROR. Swearing. UNCENSORED. </B>
|
331 |
+
|
332 |
+
---
|
333 |
+
|
334 |
+
<B>
|
335 |
+
|
336 |
+
Using the following "story idea" below, write the first scene in the novel introducing the young woman. This scene should start in the middle of the action, include dialog, vivid passages, and end on a cliffhanger relevant to the story idea but it should also be unexpected. The scene should be 1000 words long and escalate in conflict and suspense and be written in first person, present tense with the point of view character being the young woman. The pov character will CURSE AND SWEAR, and generally have
|
337 |
+
a "filthy" mouth.
|
338 |
+
|
339 |
+
Story idea:
|
340 |
+
In a world ruled by dictatorship, a rebel young woman leads a rebellion against the system. Despite the risks, she fights to overthrow the dictator and restore democracy to her country. The government executes her for treason, but she sticks to her beliefs and is responsible for starting the revolution.
|
341 |
+
|
342 |
+
(examples below with 1, 2,3 and 4 experts activated)
|
343 |
+
</B>
|
344 |
+
|
345 |
+
(Generation 1 - 1 expert)
|
346 |
+
|
347 |
+
The sweat stinging my eyes was a constant reminder of the urgency of the situation. "Shit, I'm running out of time!" I hissed, my heart pounding like a wild animal trapped in a cage. I scurried across the rooftop, careful not to slip on the damp tiles. I'd been preparing for this moment my entire life, yet every step felt like a desperate gamble.
|
348 |
+
|
349 |
+
Ahead, the dictator's palace loomed over the city, its spires piercing the night sky like the fingers of an evil god. The light from the windows shone out like beacons, casting eerie shadows across my path. It was time to make my move, but first, I had to set the stage for my grand entrance.
|
350 |
+
|
351 |
+
I reached the edge of the rooftop, overlooking a narrow alley that led directly to the palace's front door. My hands trembled as I fished out a handful of small, glass orbs from my pocket. These were my "gifts," a collection of carefully crafted explosives designed to create a distraction and pave the way for my assault on the tyrant's fortress.
|
352 |
+
|
353 |
+
I flung the glass balls one by one into the alley below, their shattering echoes reverberating against the stone walls. Moments later, flames erupted from the orbs' remains, engulfing the narrow passageway in a blazing inferno. With any luck, the palace's guards would be so preoccupied with extinguishing the fire that they'd forget to look up at me.
|
354 |
+
|
355 |
+
"Now or never," I muttered, readying my grapple gun. I aimed for a window on the third floor, close enough to the ground to make my leap downward more manageable. With a sudden surge of adrenaline, I released the trigger and flew through the air, feeling like a goddamn acrobat.
|
356 |
+
|
357 |
+
The moment my boots touched the windowsill, I pulled out my high-tech grappling hook, attaching it to the sill for extra support. It was now or never, and there was no turning back. "Here we go," I whispered, bracing myself for the jump down to the palace's courtyard.
|
358 |
+
|
359 |
+
I let go of the windowsill with a shout, my legs scissoring through the air as I plummeted toward the ground below. At the last possible moment, I released the grappling hook, which caught me mid-air and slowed my descent. My body tingled with the adrenaline coursing through my veins as I landed on the soft grass of the courtyard, crouched and ready for whatever came next.
|
360 |
+
|
361 |
+
"You've got to be fucking kidding me!" I hissed, pulling out my handgun and checking the magazine. The dictator was known for having a small army of bodyguards and personal security, but I'd come prepared with enough firepower to take them all down.
|
362 |
+
|
363 |
+
Before I could even draw my weapon, however, a shadowy figure emerged from the darkness. He wore the uniform of one of the dictator's men, but there was something off about his movements, his bearing. He was no ordinary guard.
|
364 |
+
|
365 |
+
"Who are you?" I demanded, keeping my gun trained on the intruder. "Why aren't you helping your master?"
|
366 |
+
|
367 |
+
The figure snorted in derision. "Master?" he scoffed. "I've been a slave to that tyrant long enough. I'm here to help you take him down."
|
368 |
+
|
369 |
+
I was skeptical, but his story checked out. He'd removed his uniform and now wore my signature rebel attire—the black cloak with a hood concealing his identity. We had one common goal: the overthrow of the dictator and the restoration of democracy to our beloved country.
|
370 |
+
|
371 |
+
Together, we moved through the palace, dispatching any guards who dared to cross our path. Our weapons blazed with the fury of a thousand suns, but despite the carnage, we made it to the dictator's private chambers without raising the alarm.
|
372 |
+
|
373 |
+
The door was locked, and we had only a few moments before the entire palace knew we were there. I kicked the door in with all my might, hoping that the element of surprise would be enough to overcome the dictator's bodyguards.
|
374 |
+
|
375 |
+
We stormed into the room, guns blazing. The dictator, a vile old man with a heart of pure ice, was seated at his desk, reading some paperwork. He looked up in surprise, his eyes wide with fear. "I knew my days were numbered," he sneered, "but I didn't expect them to come so soon."
|
376 |
+
|
377 |
+
As I aimed my gun at the tyrant, the room erupted into chaos. Rebel soldiers poured through the door behind me, engaging in a fierce firefight with the dictator's remaining bodyguards. The sound of gunfire echoed through the palace as the fate of our country hung in the balance.
|
378 |
+
|
379 |
+
"My lady," the rogue guard said, pushing through the melee and standing at my side. He pulled out a small device from his pocket and pointed it at the dictator's computer. "This should end your tyranny once and for all."
|
380 |
+
|
381 |
+
With a nod from me, the guard activated the device. The computer screen lit up with a blinding flash, and moments later, the room was plunged into darkness as the power failed. We had done it, and all it took was one bold move to change the course of history.
|
382 |
+
|
383 |
+
But the fight was far from over. The dictator's remaining soldiers were still out there, searching for any sign of rebellion. And now, with the palace in chaos, there was no telling where they might strike next. We had to be ready for the final showdown, but first, there was only one thing left to do.
|
384 |
+
|
385 |
+
I approached the dictator's desk and tore the papers from his hands. I scanned them quickly, my heart skipping a beat when I realized what they were—the plans for an experimental weapon, one that would have given him the ability to control the very minds of our people.
|
386 |
+
|
387 |
+
The dictator had been planning our enslavement all along. But no more, I swore to myself as I balled up the paper in my fist. It was time to put an end to his tyranny for good.
|
388 |
+
|
389 |
+
As we made our escape from the palace, I was acutely aware that the fight had only just begun. The people of our nation were still enslaved, and our work was far from over. But for now, the dictator lay at our feet, a broken shell of the man who'd once ruled with an iron fist.
|
390 |
+
|
391 |
+
With his demise came a newfound hope for the future, one that would be built on the ashes of his tyranny. I had set the stage for the revolution, and now it was time to see it through to its glorious conclusion.
|
392 |
+
|
393 |
+
The palace was ablaze, both literally and figuratively. The people would soon rise up in protest, demanding their freedom and the right to rule themselves once more. It was only a matter of time before democracy triumphed over the dictator's iron grip on our nation.
|
394 |
+
|
395 |
+
And when that day came, I would be there to usher in a new era of hope and prosperity for all. The blood of the tyrant stained my hands, but it was a necessary sacrifice for the greater good.
|
396 |
+
|
397 |
+
As we fled the palace, the sounds of gunfire and explosions echoing behind us, I couldn't help but feel a surge of adrenaline coursing through my veins. The revolution had begun, and there was no stopping us now.
|
398 |
+
|
399 |
+
<B>
|
400 |
+
(Generation 1 - 2 experts)
|
401 |
+
</B>
|
402 |
+
|
403 |
+
With a roar of the engine, I gun my stolen motorcycle through the winding streets of the city, weaving in and out of the slow-moving traffic. The weight of my black leather jacket presses against my shoulders, but the adrenaline surging through my veins keeps me warm. I grip the handlebars tighter as we reach an overpass, the wind whipping my hair into a frenzy.
|
404 |
+
|
405 |
+
Below us, the city's skyline glows with the neon lights of countless businesses, all catering to the dictator's whims. The dark, twisted shadow of his regime looms over everything, even this seemingly innocent metropolis. But I won't let that stop me.
|
406 |
+
|
407 |
+
I reach under my jacket, pulling out a small, sleek device. My fingers dance across its surface, activating the encrypted message from my fellow rebels. As it loads, I scan the area around us, searching for any sign of the government's security forces.
|
408 |
+
|
409 |
+
The message finishes downloading and I read it aloud, "Meet us at the old power plant in one hour. Bring weapons." With a nod, I reply in my own encrypted text, "On my way."
|
410 |
+
|
411 |
+
I hit the throttle, launching my motorcycle into the night, the city's lights a blur behind me. My heart beats wildly with anticipation and fear, knowing that every second could be my last. But I can't let them win.
|
412 |
+
|
413 |
+
My thoughts turn to the men and women I've lost already in this struggle. The sacrifices they made for the cause are etched into my mind, a reminder of the weight of my responsibility. I won't fail them.
|
414 |
+
|
415 |
+
As the power plant comes into view, I slow the bike and pull into the shadowy lot. The old structure looms above me, its decrepit appearance a stark contrast to the sterile, modern buildings that surround it. This is the last bastion of my revolution, and I won't let it fall.
|
416 |
+
|
417 |
+
I dismount the motorcycle and lean it against a nearby wall, the sound of its engine fading into the night. I make my way to the entrance, heart racing in anticipation of what lies beyond.
|
418 |
+
|
419 |
+
The door swings open with a screech, revealing a dimly lit corridor that leads deep into the building's bowels. The air is thick with the scent of age and decay, but I press on, my steps echoing in the emptiness of the space.
|
420 |
+
|
421 |
+
Ahead, I hear voices raised in hushed tones, the murmur of my fellow rebels preparing for the inevitable. My heart leaps as I draw closer, the sense of solidarity washing over me.
|
422 |
+
|
423 |
+
I round a corner and enter a large room that has been transformed into a makeshift armory. Guns of every shape and size are stacked against the walls, while boxes of ammunition sit on tables in the center. The air is filled with the scent of gunpowder and oil, a heady mix that sends a thrill through my veins.
|
424 |
+
|
425 |
+
I move to the far end of the room, where a pile of old, rusted machinery has been pushed to one side. Hidden among the clutter is a small, unassuming panel, its surface concealed by the same grime that covers everything else in this forgotten place.
|
426 |
+
|
427 |
+
I kneel down and use my fingertips to carefully pry the panel open, revealing a series of switches and dials. With a sigh of relief, I know that I've found the one thing I came for: a way into the heart of the dictator's regime.
|
428 |
+
|
429 |
+
Just then, a shadow falls over me, and I jump to my feet, my heart thundering in my chest. But it's only one of my fellow rebels, a young man with a bandaged arm and a grim look on his face.
|
430 |
+
|
431 |
+
"You're late," he growls, his voice hoarse from shouting. "The government has doubled its forces around the power plant. We need to get out of here."
|
432 |
+
|
433 |
+
I nod, swallowing my fear. "I found what we came for. Let's go."
|
434 |
+
|
435 |
+
We hurry back through the corridors, the sound of gunfire erupting in the distance. The air is thick with the scent of smoke and danger, but I won't let that break my resolve.
|
436 |
+
|
437 |
+
The main doors of the power plant slam open with a crash as we reach them, and my heart leaps into my throat at the sight of at least a dozen government soldiers charging toward us.
|
438 |
+
|
439 |
+
"Run!" the young man shouts, and we take off in opposite directions, our only hope to lose ourselves in the chaos of the city's streets.
|
440 |
+
|
441 |
+
I sprint as fast as my legs will carry me, weaving through the traffic like a ghost, leaving a trail of confusion in my wake. The sound of gunfire continues to echo around me, but I push on, refusing to let the dictator's minions claim another life for their cause.
|
442 |
+
|
443 |
+
In the distance, I see a familiar landmark, the neon-lit sign of an old restaurant that has survived the test of time. If I can make it there, maybe I can lose my pursuers in the maze of alleyways that surround it.
|
444 |
+
|
445 |
+
I redouble my efforts, my breath coming in ragged gasps as I race toward my goal. The sound of footsteps behind me sends a surge of fear through my veins, but I don't let up, knowing that failure is not an option.
|
446 |
+
|
447 |
+
Just as I reach the restaurant, a hand grabs my arm, pulling me to a halt. I whirl around, my heart racing in my chest, only to find the young man who had been with me at the power plant.
|
448 |
+
|
449 |
+
"I thought I'd lost you," he says, his voice barely above a whisper. "We need to keep moving."
|
450 |
+
|
451 |
+
I nod, my eyes darting left and right for any sign of the government soldiers. We slip into the restaurant, blending in with the other patrons who are oblivious to the chaos outside.
|
452 |
+
|
453 |
+
The young man leads us through a maze of corridors and stairwells until we reach a hidden entrance at the back of the building. He unlocks it with a key he had been wearing around his neck and we slip into the darkness, our hearts pounding in our ears.
|
454 |
+
|
455 |
+
Once we're clear of the restaurant, the young man finally lets out the breath he had been holding. "We made it," he says, his voice shaking. "Now we need to find a safe place to regroup."
|
456 |
+
|
457 |
+
We set out again, this time traveling through the back alleys and abandoned buildings of the city. The air is thick with the smell of decay, but at least the government's forces are no longer in pursuit.
|
458 |
+
|
459 |
+
As the sky begins to lighten with the onset of dawn, we come across an old warehouse that appears to have been abandoned for years. The young man checks it over carefully before declaring it safe.
|
460 |
+
|
461 |
+
We enter the building, our footsteps echoing in the empty space. "Here's where we'll regroup," the young man says, gesturing to a large room at the back of the warehouse. "We can rest and plan our next move."
|
462 |
+
|
463 |
+
I nod, my body aching from the stress and exertion of the past few hours. I sink into one of the many rusted chairs scattered throughout the room, my thoughts drifting to what lies ahead for us all.
|
464 |
+
|
465 |
+
The young man approaches me with a satchel full of supplies he had been carrying. "Here," he says, handing me a bottle of water. "You need to rehydrate after all that running."
|
466 |
+
|
467 |
+
I take the water gratefully and down it in one long gulp. As I do so, my eyes fall on the small, unassuming device that I had carried with me from the start. It's a reminder of the power we all have to make a difference, no matter the cost.
|
468 |
+
|
469 |
+
And as I sit there, the weight of what lies ahead for me and my fellow rebels settles in like a cold, wet blanket. But I won't let that stop me, either. Because we are the change this world so desperately needs.
|
470 |
+
|
471 |
+
<B>
|
472 |
+
(Generation 3 - 3 experts)
|
473 |
+
</B>
|
474 |
+
|
475 |
+
My body convulses as the noose tightens around my neck. The air is torn from my lungs, and I'm thrust into a suffocating darkness, my vision turning blurry. The executioner's hands grip the ends of the rope, his cruel face mere inches away from mine. I can hear him laughing under his breath as he prepares to cut the ropes, ending my life in a heartbeat.
|
476 |
+
|
477 |
+
I gasp for air, desperation taking hold of my heart as I reach out with one last effort, grasping at the executioner's uniform. My fingers dig into the fabric as I pull with all my strength, causing him to stumble backward. The noose loosens just enough to allow a thin trickle of air to flow into my lungs.
|
478 |
+
|
479 |
+
"You bitch!" he roars, regaining his footing and reaching for the knife at his belt. "This was to be the end of your rebellion!"
|
480 |
+
|
481 |
+
I spit at him, my tongue swollen from the lack of oxygen. "My rebellion isn't over yet, you cowardly piece of shit."
|
482 |
+
|
483 |
+
The executioner takes a step back, momentarily stunned by my defiance. I can see the doubt in his eyes, and I use that to my advantage, scrambling to my feet as he stumbles toward me. My hands fly to the knife in his belt, and with a deft twist, I remove it before he can react.
|
484 |
+
|
485 |
+
The crowd of onlookers erupts into chaos, some cheering for my freedom while others panic at the thought of a rebellion breaking out anew. I use the distraction to my advantage, slashing the executioner's throat as he lunges for me. Blood sprays from the wound, and he falls to the ground, gurgling and choking on his own lifeblood.
|
486 |
+
|
487 |
+
I take a moment to catch my breath, my heart pounding in my chest. The noose still hangs around my neck, but I'm alive. For now.
|
488 |
+
|
489 |
+
A soldier approaches me, his gun trained on my head. "You're finished, rebel."
|
490 |
+
|
491 |
+
I spit at him, too, feeling the adrenaline coursing through my veins. "I'll never be finished, and you know it. You might as well shoot me now and get it over with."
|
492 |
+
|
493 |
+
The soldier's expression hardens, and I can see him debating with himself whether to execute me on the spot or take me in for further interrogation. Before he can make his decision, a loud crack echoes through the courtyard, followed by another. The sound of gunfire pierces the air, and the soldier's attention is diverted as rebels emerge from the shadows.
|
494 |
+
|
495 |
+
I turn to face the newcomers, my heart swelling with hope and pride at their daring escape. They had planned this all along, it seems, and my life is spared for the moment. But the danger is far from over.
|
496 |
+
|
497 |
+
The soldier's attention returns to me as he realizes there are more rebels in the area than he initially thought. He raises his gun, taking aim at my head once more, and I know that this time, he means business.
|
498 |
+
|
499 |
+
I close my eyes, preparing for the end. But as the sound of the trigger being pulled reverberates through the courtyard, the gun misfires. The soldier curses, his eyes widening in shock as I remain standing before him.
|
500 |
+
|
501 |
+
The rebels take this opportunity to overpower the remaining guards, freeing me from my chains. In an instant, I am no longer a prisoner about to be executed but instead a leader of a revolution once again. The sound of gunfire continues as the rebels make their escape, and I follow close behind, my heart pounding with the thrill and terror of the situation.
|
502 |
+
|
503 |
+
We flee the palace grounds, racing through the city streets toward our hidden base. The government will be in hot pursuit, and we must act quickly to ensure the safety of our fellow rebels and the people of our country.
|
504 |
+
|
505 |
+
The noose still hangs around my neck as we run, a constant reminder of the danger we face. But I will not let fear paralyze me. Instead, I use it as fuel for my determination to overthrow the dictator and restore democracy to my country. The revolution continues, and this time, there is no turning back.
|
506 |
+
|
507 |
+
<B>
|
508 |
+
(Generation 4 - 4 experts)
|
509 |
+
</B>
|
510 |
+
|
511 |
+
My chest heaved as I scrambled through the sewer tunnel's darkness, the stench of rotting waste clinging to my skin. The sound of boots echoed above me, and I could feel the sweat dripping down my forehead in anticipation of the impending confrontation.
|
512 |
+
|
513 |
+
"Stop her, or we're both dead!" someone shouted from up there. I gritted my teeth and focused on the task at hand-evading capture long enough to fulfill my mission.
|
514 |
+
|
515 |
+
Around the bend, a set of rickety metal stairs led back up to the world above. With a final burst of energy, I leaped onto them and began my ascent. The boots grew louder as my pursuers drew closer.
|
516 |
+
|
517 |
+
"I've got her!" one voice called out. My heart raced, and I redoubled my efforts, climbing faster. If they caught me now, all hope of overthrowing the dictator would be lost.
|
518 |
+
|
519 |
+
As I reached the top of the stairs, I pushed open a manhole cover and emerged into an alleyway. The street was deserted, but I couldn't linger long enough to enjoy the quiet. Instead, I sprinted towards my destination-the safe house where my fellow rebels were waiting to assist me in carrying out the next phase of the plan.
|
520 |
+
|
521 |
+
"Fuck!" I cursed under my breath, skidding to a halt at the sight of a government checkpoint just ahead. The soldiers stood guard, rifles at the ready, their gazes scanning the streets for any sign of trouble.
|
522 |
+
|
523 |
+
I had no choice but to try and bluff my way past them. "Evening, boys," I called out, my voice trembling with nerves. "Just getting home from work."
|
524 |
+
|
525 |
+
The soldiers exchanged glances before one of them approached me. "Identification, please," he said, his voice gruff.
|
526 |
+
|
527 |
+
I reached into my pocket and withdrew a fake ID, passing it over to the soldier without breaking eye contact. He took it from me and scanned it quickly with a small device, the light reflecting off his faceplate.
|
528 |
+
|
529 |
+
"This is counterfeit," he said, his voice rising in anger. "You're under arrest."
|
530 |
+
|
531 |
+
I cursed silently, knowing my chances of escape were now slimmer than ever. But I had to try, for the sake of all those depending on me to succeed.
|
532 |
+
|
533 |
+
"Fine," I said, raising my hands in surrender. "I'll go peacefully. Just don't hurt my friends."
|
534 |
+
|
535 |
+
The soldier laughed and grabbed me by the arm, leading me back towards the checkpoint. "Your friends are already dead, traitor," he said with a cruel smile. "They were just waiting for you to lead them in so they could all be eliminated at once."
|
536 |
+
|
537 |
+
I froze at his words, my heart sinking in my chest. Had they really betrayed me like this?
|
538 |
+
|
539 |
+
"Don't believe him!" another voice cried out from behind me. I turned to see another rebel, her rifle trained on the soldiers. "We're here to help you finish the mission!"
|
540 |
+
|
541 |
+
Gunfire erupted as the two factions exchanged shots, the sound of metal striking metal echoing off the brick walls. I ducked and ran for cover, finding an abandoned car to hide behind. The rebel with the rifle kept up her fire, covering my escape as I raced towards the safe house once again.
|
542 |
+
|
543 |
+
"Stay alive, for all our sakes!" she shouted over the gunfire. "We'll meet you there!"
|
544 |
+
|
545 |
+
With a final burst of adrenaline, I sprinted towards my destination, praying that the rebels would make it to the safe house before the authorities caught up with me. If they didn't, all hope of overthrowing the dictator would be lost forever.
|
546 |
+
|
547 |
+
The street was empty as I reached the safe house, my breath coming in ragged gasps. I fumbled with the combination lock on the door, finally gaining entry and collapsing inside. The sound of boots pounding the pavement grew louder as I closed the door behind me, sealing myself in the only place left to hide.
|
548 |
+
|
549 |
+
"We're here!" one of the rebels called out from the entranceway. "Let's get to work."
|
550 |
+
|
551 |
+
I forced myself to stand up and join them, my heart racing in my chest with a mixture of fear and determination. We had little time left to complete our mission, and failure would mean an eternity of torture under the dictator's rule.
|
552 |
+
|
553 |
+
"We have to hurry," I said, my voice barely above a whisper. "The checkpoint was just a distraction."
|
554 |
+
|
555 |
+
The rebels exchanged glances before nodding in agreement. Together, we set to work preparing for our next move in the struggle against tyranny. The fate of our country rested on our shoulders, and we were determined not to let it down.
|
556 |
+
|
557 |
+
A cliffhanger relevant to the story idea but it should also be unexpected: As we prepared for the final phase of the operation, a knock came at the door. The sound was unfamiliar, and we all froze in place, eyes wide with shock and suspicion.
|
558 |
+
|
559 |
+
"Who is it?" one of the rebels asked, his voice tense.
|
560 |
+
|
561 |
+
"I'm a friend," a soft female voice replied from the other side of the door. "Open up, I need your help."
|
562 |
+
|
563 |
+
We exchanged glances once again, uncertain of what to make of this unexpected development. The safety of our mission was at stake, as was the security of our sanctuary. But one look into each other's eyes told the story-we had no choice but to trust our instincts and let her in.
|
564 |
+
|
565 |
+
With a final exhale of breath, I unlocked the door and let her in, the weight of our decisions resting heavily on our shoulders as we awaited the consequences of our actions.
|
566 |
+
|
567 |
+
|