Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
TheBloke
/
vicuna-7B-v1.5-GGUF
like
15
Transformers
GGUF
llama
text-generation-inference
arxiv:
2307.09288
arxiv:
2306.05685
License:
llama2
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
4c2c04f
vicuna-7B-v1.5-GGUF
1 contributor
History:
13 commits
TheBloke
Initial GGUF model commit (model made with llama.cpp commit 2ba85c8)
4c2c04f
11 months ago
.gitattributes
2.27 kB
Initial GGUF model commit (model made with llama.cpp commit 2ba85c8)
11 months ago
vicuna-7b-v1.5.Q2_K.gguf
2.83 GB
LFS
Initial GGUF model commit (model made with llama.cpp commit 2ba85c8)
11 months ago
vicuna-7b-v1.5.Q3_K_L.gguf
3.6 GB
LFS
Initial GGUF model commit (model made with llama.cpp commit 2ba85c8)
11 months ago
vicuna-7b-v1.5.Q3_K_M.gguf
3.3 GB
LFS
Initial GGUF model commit (model made with llama.cpp commit 2ba85c8)
11 months ago
vicuna-7b-v1.5.Q3_K_S.gguf
2.95 GB
LFS
Initial GGUF model commit (model made with llama.cpp commit 2ba85c8)
11 months ago
vicuna-7b-v1.5.Q4_0.gguf
3.83 GB
LFS
Initial GGUF model commit (model made with llama.cpp commit 2ba85c8)
11 months ago
vicuna-7b-v1.5.Q4_K_M.gguf
4.08 GB
LFS
Initial GGUF model commit (model made with llama.cpp commit 2ba85c8)
11 months ago
vicuna-7b-v1.5.Q4_K_S.gguf
3.86 GB
LFS
Initial GGUF model commit (model made with llama.cpp commit 2ba85c8)
11 months ago
vicuna-7b-v1.5.Q5_0.gguf
4.65 GB
LFS
Initial GGUF model commit (model made with llama.cpp commit 2ba85c8)
11 months ago
vicuna-7b-v1.5.Q5_K_M.gguf
4.78 GB
LFS
Initial GGUF model commit (model made with llama.cpp commit 2ba85c8)
11 months ago
vicuna-7b-v1.5.Q5_K_S.gguf
4.65 GB
LFS
Initial GGUF model commit (model made with llama.cpp commit 2ba85c8)
11 months ago
vicuna-7b-v1.5.Q6_K.gguf
5.53 GB
LFS
Initial GGUF model commit (model made with llama.cpp commit 2ba85c8)
11 months ago
vicuna-7b-v1.5.Q8_0.gguf
7.16 GB
LFS
Initial GGUF model commit (model made with llama.cpp commit 2ba85c8)
11 months ago