venketh
/

gpt4-x-vicuna-13b-gguf-imatrix

Model card Files Files and versions Community

gpt4-x-vicuna-13b-gguf-imatrix

2 contributors

History: 21 commits

venketh's picture

Import updated Q5_K_M quantization

6dd9de3 9 months ago

.gitattributes

1.57 kB

Import importance matrix and source data 9 months ago
README.md

160 Bytes

Import importance matrix and source data 9 months ago
gpt4-x-vicuna-13B.gguf.q3_K_L.bin

6.93 GB
LFS

Import updated Q3_K_L quantization 9 months ago
gpt4-x-vicuna-13B.gguf.q4_K_M.bin

7.87 GB
LFS

Update Q4_K_M quantization to imatrix version 9 months ago
gpt4-x-vicuna-13B.gguf.q4_K_S.bin

7.42 GB
LFS

Update Q4_K_S quantization to imatrix version 9 months ago
gpt4-x-vicuna-13B.gguf.q5_K_M.bin

9.23 GB
LFS

Import updated Q5_K_M quantization 9 months ago
gpt4-x-vicuna-13B.gguf.q5_K_S.bin

8.97 GB
LFS

Import updated Q5_K_S quantization 9 months ago
gpt4-x-vicuna-13B.gguf.q6_K.bin

10.7 GB
LFS

Update Q6_K quantization to imatrix version (take 2) 9 months ago
group_10_merged.txt

162 kB

Import importance matrix and source data 9 months ago
imatrix.dat

7.14 MB
LFS

Import importance matrix and source data 9 months ago