Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
mradermacher
/
granite-3.0-2b-instruct-i1-GGUF
like
0
Transformers
GGUF
English
language
granite-3.0
Inference Endpoints
imatrix
conversational
License:
apache-2.0
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
f1d7e7e
granite-3.0-2b-instruct-i1-GGUF
1 contributor
History:
22 commits
mradermacher
uploaded from backup1
f1d7e7e
verified
28 days ago
.gitattributes
Safe
2.91 kB
uploaded from backup1
28 days ago
README.md
Safe
243 Bytes
uploaded from backup1
28 days ago
granite-3.0-2b-instruct.i1-IQ1_M.gguf
Safe
667 MB
LFS
uploaded from backup1
28 days ago
granite-3.0-2b-instruct.i1-IQ1_S.gguf
Safe
617 MB
LFS
uploaded from backup1
28 days ago
granite-3.0-2b-instruct.i1-IQ2_M.gguf
Safe
932 MB
LFS
uploaded from backup1
28 days ago
granite-3.0-2b-instruct.i1-IQ2_S.gguf
Safe
865 MB
LFS
uploaded from backup1
28 days ago
granite-3.0-2b-instruct.i1-IQ2_XS.gguf
Safe
823 MB
LFS
uploaded from backup1
28 days ago
granite-3.0-2b-instruct.i1-IQ2_XXS.gguf
Safe
751 MB
LFS
uploaded from backup1
28 days ago
granite-3.0-2b-instruct.i1-IQ3_M.gguf
Safe
1.21 GB
LFS
uploaded from backup1
28 days ago
granite-3.0-2b-instruct.i1-IQ3_XXS.gguf
Safe
1.05 GB
LFS
uploaded from backup1
28 days ago
granite-3.0-2b-instruct.i1-IQ4_XS.gguf
Safe
1.44 GB
LFS
uploaded from backup1
28 days ago
granite-3.0-2b-instruct.i1-Q2_K.gguf
Safe
1.01 GB
LFS
uploaded from backup1
28 days ago
granite-3.0-2b-instruct.i1-Q3_K_L.gguf
Safe
1.4 GB
LFS
uploaded from backup1
28 days ago
granite-3.0-2b-instruct.i1-Q3_K_M.gguf
Safe
1.29 GB
LFS
uploaded from backup1
28 days ago
granite-3.0-2b-instruct.i1-Q3_K_S.gguf
Safe
1.17 GB
LFS
uploaded from backup1
28 days ago
granite-3.0-2b-instruct.i1-Q4_0_4_4.gguf
Safe
1.51 GB
LFS
uploaded from backup1
28 days ago
granite-3.0-2b-instruct.i1-Q4_K_M.gguf
Safe
1.6 GB
LFS
uploaded from backup1
28 days ago
granite-3.0-2b-instruct.i1-Q4_K_S.gguf
Safe
1.52 GB
LFS
uploaded from backup1
28 days ago
granite-3.0-2b-instruct.i1-Q5_K_S.gguf
Safe
1.83 GB
LFS
uploaded from backup1
28 days ago
granite-3.0-2b-instruct.i1-Q6_K.gguf
Safe
2.16 GB
LFS
uploaded from backup1
28 days ago
imatrix.dat
3.29 MB
LFS
uploaded from backup1
28 days ago