Edit Models filters

Model Tree

ibm-granite/granite-3.2-8b-instruct

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

24

Full-text search

Active filters: ibm-granite/granite-3.2-8b-instruct

ibm-research/granite-3.2-8b-instruct-GGUF

Text Generation • 8B • Updated Mar 3, 2025 • 1.2k • 7

bartowski/ibm-granite_granite-3.2-8b-instruct-GGUF

Text Generation • 8B • Updated Feb 26, 2025 • 183 • 5

lmstudio-community/granite-3.2-8b-instruct-GGUF

Text Generation • 8B • Updated Feb 26, 2025 • 1.65k • 3

CISCai/granite-3.2-8b-instruct-SOTA-GGUF

Text Generation • 8B • Updated Feb 27, 2025 • 118

NikolayKozloff/granite-3.2-8b-instruct-Q8_0-GGUF

Text Generation • 8B • Updated Feb 26, 2025 • 3 • 1

cgus/granite-3.2-8b-instruct-exl2

Text Generation • Updated Feb 27, 2025

DevQuasar/ibm-granite.granite-3.2-8b-instruct-GGUF

Text Generation • 8B • Updated Feb 27, 2025 • 3

BernTheCreator/Granite-3.2-8b-Instruct-Q4_0-GGUF

Text Generation • 8B • Updated Feb 28, 2025 • 5

EasierAI/Granite-3.2-8B

Text Generation • 8B • Updated Feb 28, 2025 • 218

Triangle104/granite-3.2-8b-instruct-Q4_K_S-GGUF

Text Generation • 8B • Updated Feb 28, 2025 • 6

Triangle104/granite-3.2-8b-instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Feb 28, 2025 • 6

Triangle104/granite-3.2-8b-instruct-Q5_K_S-GGUF

Text Generation • 8B • Updated Feb 28, 2025 • 10

Triangle104/granite-3.2-8b-instruct-Q5_K_M-GGUF

Text Generation • 8B • Updated Feb 28, 2025

Triangle104/granite-3.2-8b-instruct-Q6_K-GGUF

Text Generation • 8B • Updated Feb 28, 2025 • 9

Triangle104/granite-3.2-8b-instruct-Q8_0-GGUF

Text Generation • 8B • Updated Feb 28, 2025 • 2

ObeJ/granite-3.2-8b-instruct-Q8_0-GGUF

Text Generation • 8B • Updated Mar 3, 2025 • 1

unsloth/granite-3.2-8b-instruct-unsloth-bnb-4bit

Text Generation • 8B • Updated Jun 3, 2025 • 15

unsloth/granite-3.2-8b-instruct-bnb-4bit

Text Generation • 8B • Updated Jun 3, 2025 • 209 • 3

bchen-snp/granite-3.2-8b-instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Mar 9, 2025 • 3

mradermacher/granite-3.2-8b-instruct-GGUF

8B • Updated Mar 11, 2025 • 229 • 1

mradermacher/granite-3.2-8b-instruct-i1-GGUF

8B • Updated Jul 11, 2025 • 104 • 1

cobrakenji/granite-3.2-8b-instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Mar 18, 2025 • 5

fedora-copr/granite-3.2-8b-instruct-GGUF

Text Generation • 8B • Updated Apr 9, 2025 • 26

ikarius/Granite-3.2-8b-instruct-Abliterated-NF4

Text Generation • 8B • Updated Nov 17, 2025 • 5 • 1