Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
ThomasBaruzier
/
Llama-3.2-3B-Instruct-GGUF
like
0
Text Generation
Transformers
GGUF
PyTorch
8 languages
facebook
meta
llama
llama-3
Inference Endpoints
imatrix
conversational
arxiv:
2204.05149
License:
llama3.2
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
8574e18
Llama-3.2-3B-Instruct-GGUF
1 contributor
History:
24 commits
ThomasBaruzier
Upload Llama-3.2-3B-Instruct-Q5_K_M.gguf
8574e18
verified
26 days ago
.gitattributes
Safe
2.96 kB
Upload Llama-3.2-3B-Instruct-Q5_K_M.gguf
26 days ago
Llama-3.2-3B-Instruct-IQ1_M.gguf
Safe
924 MB
LFS
Upload Llama-3.2-3B-Instruct-IQ1_M.gguf
26 days ago
Llama-3.2-3B-Instruct-IQ1_S.gguf
Safe
868 MB
LFS
Upload Llama-3.2-3B-Instruct-IQ1_S.gguf
26 days ago
Llama-3.2-3B-Instruct-IQ2_M.gguf
Safe
1.23 GB
LFS
Upload Llama-3.2-3B-Instruct-IQ2_M.gguf
26 days ago
Llama-3.2-3B-Instruct-IQ2_S.gguf
Safe
1.15 GB
LFS
Upload Llama-3.2-3B-Instruct-IQ2_S.gguf
26 days ago
Llama-3.2-3B-Instruct-IQ2_XS.gguf
Safe
1.1 GB
LFS
Upload Llama-3.2-3B-Instruct-IQ2_XS.gguf
26 days ago
Llama-3.2-3B-Instruct-IQ2_XXS.gguf
Safe
1.02 GB
LFS
Upload Llama-3.2-3B-Instruct-IQ2_XXS.gguf
26 days ago
Llama-3.2-3B-Instruct-IQ3_M.gguf
Safe
1.6 GB
LFS
Upload Llama-3.2-3B-Instruct-IQ3_M.gguf
26 days ago
Llama-3.2-3B-Instruct-IQ3_S.gguf
Safe
1.54 GB
LFS
Upload Llama-3.2-3B-Instruct-IQ3_S.gguf
26 days ago
Llama-3.2-3B-Instruct-IQ3_XS.gguf
Safe
1.48 GB
LFS
Upload Llama-3.2-3B-Instruct-IQ3_XS.gguf
26 days ago
Llama-3.2-3B-Instruct-IQ3_XXS.gguf
Safe
1.35 GB
LFS
Upload Llama-3.2-3B-Instruct-IQ3_XXS.gguf
26 days ago
Llama-3.2-3B-Instruct-IQ4_NL.gguf
Safe
1.92 GB
LFS
Upload Llama-3.2-3B-Instruct-IQ4_NL.gguf
26 days ago
Llama-3.2-3B-Instruct-IQ4_XS.gguf
Safe
1.83 GB
LFS
Upload Llama-3.2-3B-Instruct-IQ4_XS.gguf
26 days ago
Llama-3.2-3B-Instruct-Q2_K.gguf
Safe
1.36 GB
LFS
Upload Llama-3.2-3B-Instruct-Q2_K.gguf
26 days ago
Llama-3.2-3B-Instruct-Q2_K_S.gguf
Safe
1.27 GB
LFS
Upload Llama-3.2-3B-Instruct-Q2_K_S.gguf
26 days ago
Llama-3.2-3B-Instruct-Q3_K_L.gguf
Safe
1.82 GB
LFS
Upload Llama-3.2-3B-Instruct-Q3_K_L.gguf
26 days ago
Llama-3.2-3B-Instruct-Q3_K_M.gguf
Safe
1.69 GB
LFS
Upload Llama-3.2-3B-Instruct-Q3_K_M.gguf
26 days ago
Llama-3.2-3B-Instruct-Q3_K_S.gguf
Safe
1.54 GB
LFS
Upload Llama-3.2-3B-Instruct-Q3_K_S.gguf
26 days ago
Llama-3.2-3B-Instruct-Q4_K_M.gguf
Safe
2.02 GB
LFS
Upload Llama-3.2-3B-Instruct-Q4_K_M.gguf
26 days ago
Llama-3.2-3B-Instruct-Q4_K_S.gguf
Safe
1.93 GB
LFS
Upload Llama-3.2-3B-Instruct-Q4_K_S.gguf
26 days ago
Llama-3.2-3B-Instruct-Q5_K_M.gguf
2.32 GB
LFS
Upload Llama-3.2-3B-Instruct-Q5_K_M.gguf
26 days ago
README.md
Safe
38.8 kB
Create README.md
26 days ago
imatrix.dat
2.99 MB
LFS
Upload imatrix.dat
26 days ago
perplexity.md
Safe
697 Bytes
Upload perplexity.md
26 days ago