Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
TheBloke
/
LLaMA-30b-GGUF
like
3
Transformers
GGUF
llama
text-generation-inference
License:
other
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
main
LLaMA-30b-GGUF
1 contributor
History:
20 commits
TheBloke
Upload README.md
fd6b601
10 months ago
.gitattributes
2.21 kB
GGUF model commit (made with llama.cpp commit d119c04)
10 months ago
README.md
16.2 kB
Upload README.md
10 months ago
config.json
29 Bytes
GGUF model commit (made with llama.cpp commit d119c04)
10 months ago
llama-30b.Q2_K.gguf
13.5 GB
LFS
GGUF model commit (made with llama.cpp commit d119c04)
10 months ago
llama-30b.Q3_K_L.gguf
17.3 GB
LFS
GGUF model commit (made with llama.cpp commit d119c04)
10 months ago
llama-30b.Q3_K_M.gguf
15.8 GB
LFS
GGUF model commit (made with llama.cpp commit d119c04)
10 months ago
llama-30b.Q3_K_S.gguf
14.1 GB
LFS
GGUF model commit (made with llama.cpp commit d119c04)
10 months ago
llama-30b.Q4_0.gguf
18.4 GB
LFS
GGUF model commit (made with llama.cpp commit d119c04)
10 months ago
llama-30b.Q4_K_M.gguf
19.6 GB
LFS
GGUF model commit (made with llama.cpp commit d119c04)
10 months ago
llama-30b.Q4_K_S.gguf
18.4 GB
LFS
GGUF model commit (made with llama.cpp commit d119c04)
10 months ago
llama-30b.Q5_0.gguf
22.4 GB
LFS
GGUF model commit (made with llama.cpp commit d119c04)
10 months ago
llama-30b.Q5_K_M.gguf
23 GB
LFS
GGUF model commit (made with llama.cpp commit d119c04)
10 months ago
llama-30b.Q5_K_S.gguf
22.4 GB
LFS
GGUF model commit (made with llama.cpp commit d119c04)
10 months ago
llama-30b.Q6_K.gguf
26.7 GB
LFS
GGUF model commit (made with llama.cpp commit d119c04)
10 months ago
llama-30b.Q8_0.gguf
34.6 GB
LFS
GGUF model commit (made with llama.cpp commit d119c04)
10 months ago