Hugging Face
Models
Datasets
Spaces
Docs
Solutions
Pricing
Log In
Sign Up
TheBloke
/
koala-7B-GGML
like
33
License:
other
Model card
Files
Files and versions
Community
1
Use with library
main
koala-7B-GGML
1 contributor
History:
35 commits
TheBloke
Upload new k-quant GGML quantised models.
7dfc015
4 months ago
.gitattributes
1.48 kB
initial commit
6 months ago
README.md
9.91 kB
Upload new k-quant GGML quantised models.
4 months ago
koala-7B.ggmlv3.q2_K.bin
2.8 GB
LFS
Upload new k-quant GGML quantised models.
4 months ago
koala-7B.ggmlv3.q3_K_L.bin
3.55 GB
LFS
Upload new k-quant GGML quantised models.
4 months ago
koala-7B.ggmlv3.q3_K_M.bin
3.23 GB
LFS
Upload new k-quant GGML quantised models.
4 months ago
koala-7B.ggmlv3.q3_K_S.bin
2.9 GB
LFS
Upload new k-quant GGML quantised models.
4 months ago
koala-7B.ggmlv3.q4_0.bin
3.79 GB
LFS
New GGMLv3 format for breaking llama.cpp change May 19th commit 2d5db48
4 months ago
koala-7B.ggmlv3.q4_1.bin
4.21 GB
LFS
New GGMLv3 format for breaking llama.cpp change May 19th commit 2d5db48
4 months ago
koala-7B.ggmlv3.q4_K_M.bin
4.05 GB
LFS
Upload new k-quant GGML quantised models.
4 months ago
koala-7B.ggmlv3.q4_K_S.bin
3.79 GB
LFS
Upload new k-quant GGML quantised models.
4 months ago
koala-7B.ggmlv3.q5_0.bin
4.63 GB
LFS
New GGMLv3 format for breaking llama.cpp change May 19th commit 2d5db48
4 months ago
koala-7B.ggmlv3.q5_1.bin
5.06 GB
LFS
New GGMLv3 format for breaking llama.cpp change May 19th commit 2d5db48
4 months ago
koala-7B.ggmlv3.q5_K_M.bin
4.77 GB
LFS
Upload new k-quant GGML quantised models.
4 months ago
koala-7B.ggmlv3.q5_K_S.bin
4.63 GB
LFS
Upload new k-quant GGML quantised models.
4 months ago
koala-7B.ggmlv3.q6_K.bin
5.53 GB
LFS
Upload new k-quant GGML quantised models.
4 months ago
koala-7B.ggmlv3.q8_0.bin
7.16 GB
LFS
New GGMLv3 format for breaking llama.cpp change May 19th commit 2d5db48
4 months ago