Hugging Face's logo

tachyphylaxis
/
Merged-Vicuna-RP-Stew-34B-GGUF

GGUF
Inference Endpoints
Model card Files Community
tachyphylaxis commited on
Commit
0dbcd7f
•
1 Parent(s): f1786b8

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -0
README.md CHANGED
@@ -3,7 +3,11 @@
3
  See original model card for information. I generally don't go lower than 4-bit myself, but if you REALLY need one and can't get one any other way, let me know.
4
 
5
  19G Merged-Vicuna-RP-Stew-34B.IQ4_NL.gguf
 
6
  20G Merged-Vicuna-RP-Stew-34B.Q4_K_M.gguf
 
7
  23G Merged-Vicuna-RP-Stew-34B.Q5_K_M.gguf
 
8
  27G Merged-Vicuna-RP-Stew-34B.Q6_K.gguf
 
9
  35G Merged-Vicuna-RP-Stew-34B.Q8_0.gguf
 
3
  See original model card for information. I generally don't go lower than 4-bit myself, but if you REALLY need one and can't get one any other way, let me know.
4
 
5
  19G Merged-Vicuna-RP-Stew-34B.IQ4_NL.gguf
6
+
7
  20G Merged-Vicuna-RP-Stew-34B.Q4_K_M.gguf
8
+
9
  23G Merged-Vicuna-RP-Stew-34B.Q5_K_M.gguf
10
+
11
  27G Merged-Vicuna-RP-Stew-34B.Q6_K.gguf
12
+
13
  35G Merged-Vicuna-RP-Stew-34B.Q8_0.gguf