1 contributor

History: 32 commits

TheBloke

Upload new k-quant GGML quantised models.

18c48a2 10 months ago

.gitattributes

1.48 kB

initial commit 12 months ago
README.md
9.07 kB

Upload new k-quant GGML quantised models. 10 months ago
wizard-vicuna-13B.ggmlv3.q2_K.bin
5.43 GB
LFS

Upload new k-quant GGML quantised models. 10 months ago
wizard-vicuna-13B.ggmlv3.q3_K_L.bin
6.87 GB
LFS

Upload new k-quant GGML quantised models. 10 months ago
wizard-vicuna-13B.ggmlv3.q3_K_M.bin
6.25 GB
LFS

Upload new k-quant GGML quantised models. 10 months ago
wizard-vicuna-13B.ggmlv3.q3_K_S.bin
5.59 GB
LFS

Upload new k-quant GGML quantised models. 10 months ago
wizard-vicuna-13B.ggmlv3.q4_0.bin
7.32 GB
LFS

New GGMLv3 format for breaking llama.cpp change May 19th commit 2d5db48 11 months ago
wizard-vicuna-13B.ggmlv3.q4_1.bin
8.14 GB
LFS

New GGMLv3 format for breaking llama.cpp change May 19th commit 2d5db48 11 months ago
wizard-vicuna-13B.ggmlv3.q4_K_M.bin
7.82 GB
LFS

Upload new k-quant GGML quantised models. 10 months ago
wizard-vicuna-13B.ggmlv3.q4_K_S.bin
7.32 GB
LFS

Upload new k-quant GGML quantised models. 10 months ago
wizard-vicuna-13B.ggmlv3.q5_0.bin
8.95 GB
LFS

New GGMLv3 format for breaking llama.cpp change May 19th commit 2d5db48 11 months ago
wizard-vicuna-13B.ggmlv3.q5_1.bin
9.76 GB
LFS

New GGMLv3 format for breaking llama.cpp change May 19th commit 2d5db48 11 months ago
wizard-vicuna-13B.ggmlv3.q5_K_M.bin
9.21 GB
LFS

Upload new k-quant GGML quantised models. 10 months ago
wizard-vicuna-13B.ggmlv3.q5_K_S.bin
8.95 GB
LFS

Upload new k-quant GGML quantised models. 10 months ago
wizard-vicuna-13B.ggmlv3.q6_K.bin
10.7 GB
LFS

Upload new k-quant GGML quantised models. 10 months ago
wizard-vicuna-13B.ggmlv3.q8_0.bin
13.8 GB
LFS

New GGMLv3 format for breaking llama.cpp change May 19th commit 2d5db48 11 months ago