Update README.md
Browse files
README.md
CHANGED
@@ -11,6 +11,8 @@ base_model: []
|
|
11 |
This repo contains the full precision source code, in "safe tensors" format to generate GGUFs, GPTQ, EXL2, AWQ, HQQ and other formats.
|
12 |
The source code can also be used directly.
|
13 |
|
|
|
|
|
14 |
<B>IMPORTANT: Highest Quality Settings / Optimal Operation Guide / Parameters and Samplers</B>
|
15 |
|
16 |
If you are going to use this model, (source, GGUF or a different quant), please review this document for critical parameter, sampler and advance sampler settings (for multiple AI/LLM aps).
|
@@ -49,4 +51,22 @@ For full information about this model, including:
|
|
49 |
|
50 |
Please go to:
|
51 |
|
52 |
-
[ https://huggingface.co/DavidAU/L3.1-RP-Hero-BigTalker-8B-gguf ]
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
11 |
This repo contains the full precision source code, in "safe tensors" format to generate GGUFs, GPTQ, EXL2, AWQ, HQQ and other formats.
|
12 |
The source code can also be used directly.
|
13 |
|
14 |
+
NOTE: Links to GGUF, and EXL2 quants below.
|
15 |
+
|
16 |
<B>IMPORTANT: Highest Quality Settings / Optimal Operation Guide / Parameters and Samplers</B>
|
17 |
|
18 |
If you are going to use this model, (source, GGUF or a different quant), please review this document for critical parameter, sampler and advance sampler settings (for multiple AI/LLM aps).
|
|
|
51 |
|
52 |
Please go to:
|
53 |
|
54 |
+
[ https://huggingface.co/DavidAU/L3.1-RP-Hero-BigTalker-8B-gguf ]
|
55 |
+
|
56 |
+
<h3>EXL2 Quants</h3>
|
57 |
+
|
58 |
+
Special thanks to "James2313123" for the EXL2 quants:
|
59 |
+
|
60 |
+
https://huggingface.co/James2313123
|
61 |
+
|
62 |
+
8bpw:
|
63 |
+
|
64 |
+
[ https://huggingface.co/James2313123/L3.1-RP-Hero-BigTalker-8B_8bpw-h8-exl2 ]
|
65 |
+
|
66 |
+
6.75bpw:
|
67 |
+
|
68 |
+
[ https://huggingface.co/James2313123/L3.1-RP-Hero-BigTalker-8B_6.75bpw-h8-exl2 ]
|
69 |
+
|
70 |
+
5bpw:
|
71 |
+
|
72 |
+
[ https://huggingface.co/James2313123/L3.1-RP-Hero-BigTalker-8B_5bpw-h6-exl2 ]
|