Text Generation
GGUF
English
creative
creative writing
fiction writing
plot generation
sub-plot generation
story generation
scene continue
storytelling
fiction story
story
writing
fiction
roleplaying
horror
general usage
roleplay
neo quant
fantasy
story telling
ultra high precision
Inference Endpoints
imatrix
conversational
Update README.md
Browse files
README.md
CHANGED
|
@@ -85,11 +85,17 @@ One version is not stronger than the other, they are different and result in dif
|
|
| 85 |
This chart shows the order in terms of "BPW" for each quant with "IQ1_S" with the least, and Q8_0 with the most:
|
| 86 |
|
| 87 |
IQ1_S | IQ1_M
|
|
|
|
| 88 |
IQ2_XXS | IQ2_XS | Q2_K_S | IQ2_S | Q2_K | IQ2_M
|
|
|
|
| 89 |
IQ3_XXS | Q3_K_S | IQ3_XS | IQ3_S | IQ3_M | Q3_K_M | Q3_K_L
|
|
|
|
| 90 |
Q4_K_S | IQ4_XS | IQ4_NL | Q4_K_M
|
|
|
|
| 91 |
Q5_K_S | Q5_K_M
|
|
|
|
| 92 |
Q6_K
|
|
|
|
| 93 |
Q8_0
|
| 94 |
|
| 95 |
(not all quants may be at this repo)
|
|
|
|
| 85 |
This chart shows the order in terms of "BPW" for each quant with "IQ1_S" with the least, and Q8_0 with the most:
|
| 86 |
|
| 87 |
IQ1_S | IQ1_M
|
| 88 |
+
|
| 89 |
IQ2_XXS | IQ2_XS | Q2_K_S | IQ2_S | Q2_K | IQ2_M
|
| 90 |
+
|
| 91 |
IQ3_XXS | Q3_K_S | IQ3_XS | IQ3_S | IQ3_M | Q3_K_M | Q3_K_L
|
| 92 |
+
|
| 93 |
Q4_K_S | IQ4_XS | IQ4_NL | Q4_K_M
|
| 94 |
+
|
| 95 |
Q5_K_S | Q5_K_M
|
| 96 |
+
|
| 97 |
Q6_K
|
| 98 |
+
|
| 99 |
Q8_0
|
| 100 |
|
| 101 |
(not all quants may be at this repo)
|