Text Generation
GGUF
English
Chinese
MOE
Qwen 2.5 MOE
Mixture of Experts
6X1.5B
deepseek
reasoning
thinking
creative
128k context
general usage
problem solving
brainstorming
solve riddles
story generation
plot generation
storytelling
fiction story
story
writing
fiction
Qwen 2.5
mergekit
Inference Endpoints
conversational
Update README.md
Browse files
README.md
CHANGED
@@ -95,6 +95,28 @@ Quants uploaded: Q4_K_S, Q8_0
|
|
95 |
|
96 |
---
|
97 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
98 |
Example Generation:
|
99 |
|
100 |
Q8_0 Quant, Temp 1.5, rep pen 1.1, topp: .95, minp: .05, topk: 40
|
|
|
95 |
|
96 |
---
|
97 |
|
98 |
+
<B> Additional Support / Documents for this model to assist with generation / performance: </b>
|
99 |
+
|
100 |
+
Document #1:
|
101 |
+
|
102 |
+
Details how to use reasoning/thinking models and get maximum performance from them, and includes links to all reasoning/thinking models - GGUF and source, as well as adapters to turn any "regular" model into a "reasoning/thinking" model.
|
103 |
+
|
104 |
+
[ https://huggingface.co/DavidAU/How-To-Use-Reasoning-Thinking-Models-and-Create-Them ]
|
105 |
+
|
106 |
+
Document #2:
|
107 |
+
|
108 |
+
Document detailing all parameters, settings, samplers and advanced samplers to use not only my models to their maximum potential - but all models (and quants) online (regardless of the repo) to their maximum potential. Included quick start and detailed notes, include AI / LLM apps and other critical information and references too. A must read if you are using any AI/LLM right now.
|
109 |
+
|
110 |
+
[ https://huggingface.co/DavidAU/Maximizing-Model-Performance-All-Quants-Types-And-Full-Precision-by-Samplers_Parameters ]
|
111 |
+
|
112 |
+
Software:
|
113 |
+
|
114 |
+
SOFTWARE patch (by me) for Silly Tavern (front end to connect to multiple AI apps / connect to AIs- like Koboldcpp, Lmstudio, Text Gen Web UI and other APIs) to control and improve output generation of ANY AI model. Also designed to control/wrangle some of my more "creative" models and make them perform perfectly with little to no parameter/samplers adjustments too.
|
115 |
+
|
116 |
+
[ https://huggingface.co/DavidAU/AI_Autocorrect__Auto-Creative-Enhancement__Auto-Low-Quant-Optimization__gguf-exl2-hqq-SOFTWARE ]
|
117 |
+
|
118 |
+
---
|
119 |
+
|
120 |
Example Generation:
|
121 |
|
122 |
Q8_0 Quant, Temp 1.5, rep pen 1.1, topp: .95, minp: .05, topk: 40
|