TheBloke
/

vicuna-13B-v1.5-16K-GGML

text-generation-inference

Model card Files Files and versions Community

vicuna-13B-v1.5-16K-GGML

1 contributor

History: 20 commits

TheBloke's picture

Initial GGML model commit

deb3e7e 11 months ago

.gitattributes

1.52 kB

initial commit 11 months ago
README.md

14.5 kB

Initial GGML model commit 11 months ago
config.json

29 Bytes

Initial GGML model commit 11 months ago
vicuna-13b-v1.5-16k.ggmlv3.q2_K.bin

5.51 GB
LFS

Initial GGML model commit 11 months ago
vicuna-13b-v1.5-16k.ggmlv3.q3_K_L.bin

6.93 GB
LFS

Initial GGML model commit 11 months ago
vicuna-13b-v1.5-16k.ggmlv3.q3_K_M.bin

6.31 GB
LFS

Initial GGML model commit 11 months ago
vicuna-13b-v1.5-16k.ggmlv3.q3_K_S.bin

5.66 GB
LFS

Initial GGML model commit 11 months ago
vicuna-13b-v1.5-16k.ggmlv3.q4_0.bin

7.37 GB
LFS

Initial GGML model commit 11 months ago
vicuna-13b-v1.5-16k.ggmlv3.q4_1.bin

8.17 GB
LFS

Initial GGML model commit 11 months ago
vicuna-13b-v1.5-16k.ggmlv3.q4_K_M.bin

7.87 GB
LFS

Initial GGML model commit 11 months ago
vicuna-13b-v1.5-16k.ggmlv3.q4_K_S.bin

7.37 GB
LFS

Initial GGML model commit 11 months ago
vicuna-13b-v1.5-16k.ggmlv3.q5_0.bin

8.97 GB
LFS

Initial GGML model commit 11 months ago
vicuna-13b-v1.5-16k.ggmlv3.q5_1.bin

9.78 GB
LFS

Initial GGML model commit 11 months ago
vicuna-13b-v1.5-16k.ggmlv3.q5_K_M.bin

9.23 GB
LFS

Initial GGML model commit 11 months ago
vicuna-13b-v1.5-16k.ggmlv3.q5_K_S.bin

8.97 GB
LFS

Initial GGML model commit 11 months ago
vicuna-13b-v1.5-16k.ggmlv3.q6_K.bin

10.7 GB
LFS

Initial GGML model commit 11 months ago
vicuna-13b-v1.5-16k.ggmlv3.q8_0.bin

13.8 GB
LFS

Initial GGML model commit 11 months ago