DavidAU commited on
Commit
e8d480a
1 Parent(s): 3e61759

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +21 -1
README.md CHANGED
@@ -11,6 +11,8 @@ base_model: []
11
  This repo contains the full precision source code, in "safe tensors" format to generate GGUFs, GPTQ, EXL2, AWQ, HQQ and other formats.
12
  The source code can also be used directly.
13
 
 
 
14
  <B>IMPORTANT: Highest Quality Settings / Optimal Operation Guide / Parameters and Samplers</B>
15
 
16
  If you are going to use this model, (source, GGUF or a different quant), please review this document for critical parameter, sampler and advance sampler settings (for multiple AI/LLM aps).
@@ -49,4 +51,22 @@ For full information about this model, including:
49
 
50
  Please go to:
51
 
52
- [ https://huggingface.co/DavidAU/L3.1-RP-Hero-BigTalker-8B-gguf ]
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
11
  This repo contains the full precision source code, in "safe tensors" format to generate GGUFs, GPTQ, EXL2, AWQ, HQQ and other formats.
12
  The source code can also be used directly.
13
 
14
+ NOTE: Links to GGUF, and EXL2 quants below.
15
+
16
  <B>IMPORTANT: Highest Quality Settings / Optimal Operation Guide / Parameters and Samplers</B>
17
 
18
  If you are going to use this model, (source, GGUF or a different quant), please review this document for critical parameter, sampler and advance sampler settings (for multiple AI/LLM aps).
 
51
 
52
  Please go to:
53
 
54
+ [ https://huggingface.co/DavidAU/L3.1-RP-Hero-BigTalker-8B-gguf ]
55
+
56
+ <h3>EXL2 Quants</h3>
57
+
58
+ Special thanks to "James2313123" for the EXL2 quants:
59
+
60
+ https://huggingface.co/James2313123
61
+
62
+ 8bpw:
63
+
64
+ [ https://huggingface.co/James2313123/L3.1-RP-Hero-BigTalker-8B_8bpw-h8-exl2 ]
65
+
66
+ 6.75bpw:
67
+
68
+ [ https://huggingface.co/James2313123/L3.1-RP-Hero-BigTalker-8B_6.75bpw-h8-exl2 ]
69
+
70
+ 5bpw:
71
+
72
+ [ https://huggingface.co/James2313123/L3.1-RP-Hero-BigTalker-8B_5bpw-h6-exl2 ]