TheBloke
/

vicuna-7B-v1.5-16K-GGML

text-generation-inference

Model card Files Files and versions Community

vicuna-7B-v1.5-16K-GGML

1 contributor

History: 22 commits

TheBloke's picture

Update base_model formatting

f860b70 9 months ago

.gitattributes

1.52 kB

initial commit 11 months ago
README.md

16.2 kB

Update base_model formatting 9 months ago
config.json

29 Bytes

Initial GGML model commit 11 months ago
vicuna-7b-v1.5-16k.ggmlv3.q2_K.bin

2.87 GB
LFS

Initial GGML model commit 11 months ago
vicuna-7b-v1.5-16k.ggmlv3.q3_K_L.bin

3.6 GB
LFS

Initial GGML model commit 11 months ago
vicuna-7b-v1.5-16k.ggmlv3.q3_K_M.bin

3.28 GB
LFS

Initial GGML model commit 11 months ago
vicuna-7b-v1.5-16k.ggmlv3.q3_K_S.bin

2.95 GB
LFS

Initial GGML model commit 11 months ago
vicuna-7b-v1.5-16k.ggmlv3.q4_0.bin

3.83 GB
LFS

Initial GGML model commit 11 months ago
vicuna-7b-v1.5-16k.ggmlv3.q4_1.bin

4.24 GB
LFS

Initial GGML model commit 11 months ago
vicuna-7b-v1.5-16k.ggmlv3.q4_K_M.bin

4.08 GB
LFS

Initial GGML model commit 11 months ago
vicuna-7b-v1.5-16k.ggmlv3.q4_K_S.bin

3.83 GB
LFS

Initial GGML model commit 11 months ago
vicuna-7b-v1.5-16k.ggmlv3.q5_0.bin

4.65 GB
LFS

Initial GGML model commit 11 months ago
vicuna-7b-v1.5-16k.ggmlv3.q5_1.bin

5.06 GB
LFS

Initial GGML model commit 11 months ago
vicuna-7b-v1.5-16k.ggmlv3.q5_K_M.bin

4.78 GB
LFS

Initial GGML model commit 11 months ago
vicuna-7b-v1.5-16k.ggmlv3.q5_K_S.bin

4.65 GB
LFS

Initial GGML model commit 11 months ago
vicuna-7b-v1.5-16k.ggmlv3.q6_K.bin

5.53 GB
LFS

Initial GGML model commit 11 months ago
vicuna-7b-v1.5-16k.ggmlv3.q8_0.bin

7.13 GB
LFS

Initial GGML model commit 11 months ago