Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Log In
Sign Up
unsloth
/
granite-4.0-350m-GGUF
like
8
Follow
Unsloth AI
18.5k
Transformers
GGUF
language
unsloth
granite-4.0
conversational
arxiv:
0000.00000
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
main
granite-4.0-350m-GGUF
5.45 GB
Ctrl+K
Ctrl+K
1 contributor
History:
37 commits
danielhanchen
Delete granite-4.0-350m-UD-IQ2_XXS.gguf
d6a88cd
verified
6 months ago
.gitattributes
Safe
2.91 kB
Upload folder using huggingface_hub
6 months ago
README.md
Safe
33.9 kB
Upload folder using huggingface_hub
6 months ago
granite-4.0-350m-BF16.gguf
Safe
708 MB
xet
Upload folder using huggingface_hub
6 months ago
granite-4.0-350m-IQ4_NL.gguf
Safe
229 MB
xet
Upload folder using huggingface_hub
6 months ago
granite-4.0-350m-IQ4_XS.gguf
Safe
222 MB
xet
Upload folder using huggingface_hub
6 months ago
granite-4.0-350m-Q3_K_M.gguf
Safe
208 MB
xet
Upload folder using huggingface_hub
6 months ago
granite-4.0-350m-Q3_K_S.gguf
Safe
195 MB
xet
Upload folder using huggingface_hub
6 months ago
granite-4.0-350m-Q4_0.gguf
Safe
229 MB
xet
Upload folder using huggingface_hub
6 months ago
granite-4.0-350m-Q4_1.gguf
Safe
244 MB
xet
Upload folder using huggingface_hub
6 months ago
granite-4.0-350m-Q4_K_M.gguf
Safe
237 MB
xet
Upload folder using huggingface_hub
6 months ago
granite-4.0-350m-Q4_K_S.gguf
Safe
229 MB
xet
Upload folder using huggingface_hub
6 months ago
granite-4.0-350m-Q5_K_M.gguf
Safe
264 MB
xet
Upload folder using huggingface_hub
6 months ago
granite-4.0-350m-Q5_K_S.gguf
Safe
260 MB
xet
Upload folder using huggingface_hub
6 months ago
granite-4.0-350m-Q6_K.gguf
Safe
293 MB
xet
Upload folder using huggingface_hub
6 months ago
granite-4.0-350m-Q8_0.gguf
Safe
378 MB
xet
Upload folder using huggingface_hub
6 months ago
granite-4.0-350m-UD-IQ3_XXS.gguf
Safe
172 MB
xet
Upload folder using huggingface_hub
6 months ago
granite-4.0-350m-UD-Q3_K_XL.gguf
Safe
213 MB
xet
Upload folder using huggingface_hub
6 months ago
granite-4.0-350m-UD-Q4_K_XL.gguf
Safe
241 MB
xet
Upload folder using huggingface_hub
6 months ago
granite-4.0-350m-UD-Q5_K_XL.gguf
Safe
265 MB
xet
Upload folder using huggingface_hub
6 months ago
granite-4.0-350m-UD-Q6_K_XL.gguf
Safe
339 MB
xet
Upload folder using huggingface_hub
6 months ago
granite-4.0-350m-UD-Q8_K_XL.gguf
Safe
517 MB
xet
Upload folder using huggingface_hub
6 months ago
imatrix_unsloth.gguf_file
Safe
948 kB
xet
Upload folder using huggingface_hub
6 months ago
