File size: 449 Bytes
04d4c39 0dbcd7f 04d4c39 0dbcd7f 04d4c39 0dbcd7f 04d4c39 0dbcd7f 3540903 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 |
# Some GGUF quants of ParasiticRogue/Merged-Vicuna-RP-Stew-34B-GGUF
See original model card for information. I generally don't go lower than 4-bit myself, but if you REALLY need one and can't get one any other way, let me know.
19G Merged-Vicuna-RP-Stew-34B.IQ4_NL.gguf
20G Merged-Vicuna-RP-Stew-34B.Q4_K_M.gguf
23G Merged-Vicuna-RP-Stew-34B.Q5_K_M.gguf
27G Merged-Vicuna-RP-Stew-34B.Q6_K.gguf
35G Merged-Vicuna-RP-Stew-34B.Q8_0.gguf
|