Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
neopolita
/
granite-3.0-8b-base-gguf
like
0
GGUF
Inference Endpoints
Model card
Files
Files and versions
Community
Deploy
Use this model
main
granite-3.0-8b-base-gguf
1 contributor
History:
9 commits
neopolita
Upload granite-3.0-8b-base_q6_k.gguf with huggingface_hub
a320b1d
verified
about 1 month ago
.gitattributes
1.98 kB
Upload granite-3.0-8b-base_q6_k.gguf with huggingface_hub
about 1 month ago
README.md
1.44 kB
Upload README.md with huggingface_hub
about 1 month ago
ggml-model-f16.gguf
16.3 GB
LFS
Upload ggml-model-f16.gguf with huggingface_hub
about 1 month ago
granite-3.0-8b-base_q2_k.gguf
3.1 GB
LFS
Upload granite-3.0-8b-base_q2_k.gguf with huggingface_hub
about 1 month ago
granite-3.0-8b-base_q3_k_m.gguf
4 GB
LFS
Upload granite-3.0-8b-base_q3_k_m.gguf with huggingface_hub
about 1 month ago
granite-3.0-8b-base_q4_k_m.gguf
4.94 GB
LFS
Upload granite-3.0-8b-base_q4_k_m.gguf with huggingface_hub
about 1 month ago
granite-3.0-8b-base_q5_k_m.gguf
5.8 GB
LFS
Upload granite-3.0-8b-base_q5_k_m.gguf with huggingface_hub
about 1 month ago
granite-3.0-8b-base_q6_k.gguf
6.71 GB
LFS
Upload granite-3.0-8b-base_q6_k.gguf with huggingface_hub
about 1 month ago
granite-3.0-8b-base_q8_0.gguf
8.68 GB
LFS
Upload granite-3.0-8b-base_q8_0.gguf with huggingface_hub
about 1 month ago
