Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

Inference Endpoints

8-bit precision

Misc with no match

text-generation-inference

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

102

Full-text search

Active filters: granite-3.2

Mungert/granite-3.2-2b-instruct-GGUF

Text Generation • Updated 10 days ago • 421 • 6

Mungert/granite-3.2-8b-instruct-GGUF

Text Generation • Updated 10 days ago • 492 • 4

ibm-granite/granite-3.2-8b-instruct-preview

Text Generation • Updated Feb 26 • 576 • 69

mlx-community/granite-3.2-8b-instruct-preview-4bit

Text Generation • Updated Feb 8 • 17 • 1

mlx-community/granite-3.2-8b-instruct-preview-8bit

Text Generation • Updated Feb 8 • 4

cgus/granite-3.2-8b-instruct-preview-exl2

Text Generation • Updated Feb 9 • 2

AaronFeng753/granite-3.2-8b-instruct-preview-Q8_0-GGUF

Text Generation • Updated Feb 9 • 2

LucyxDQ/granite-3.2-8b-instruct-preview-IQ4_NL-GGUF

Text Generation • Updated Feb 9 • 12

mradermacher/granite-3.2-8b-instruct-preview-GGUF

Updated Feb 19 • 57 • 2

cgus/granite-3.2-8b-instruct-preview-iMat-GGUF

Text Generation • Updated Feb 9 • 86

NikolayKozloff/granite-3.2-8b-instruct-preview-Q8_0-GGUF

Text Generation • Updated Feb 9 • 1 • 1

Cran-May/granite-3.2-8b-instruct-preview-IQ4_NL-GGUF

Text Generation • Updated Feb 11 • 12

ibm-granite/granite-3.2-2b-instruct

Text Generation • Updated 29 days ago • 50.9k • 47

ibm-granite/granite-3.2-8b-instruct

Text Generation • Updated 29 days ago • 41.8k • 83

mradermacher/granite-3.2-8b-instruct-preview-i1-GGUF

Updated Feb 19 • 106 • 1

ibm-research/granite-3.2-8b-instruct-GGUF

Text Generation • Updated Mar 3 • 1.63k • 4

ibm-research/granite-3.2-2b-instruct-GGUF

Text Generation • Updated Mar 28 • 849 • 8

Mdubbya/granite-3.2-8b-instruct-preview-Q5_K_M-GGUF

Text Generation • Updated Feb 26 • 7

Mdubbya/granite-3.2-8b-instruct-preview-Q4_K_M-GGUF

Text Generation • Updated Feb 26 • 6

bartowski/ibm-granite_granite-3.2-8b-instruct-GGUF

Text Generation • Updated Feb 26 • 687 • 5

lmstudio-community/granite-3.2-8b-instruct-GGUF

Text Generation • Updated Feb 26 • 4.52k • 3

bartowski/ibm-granite_granite-3.2-2b-instruct-GGUF

Text Generation • Updated Feb 26 • 351 • 4

lmstudio-community/granite-3.2-2b-instruct-GGUF

Text Generation • Updated Feb 26 • 46 • 1

Mdubbya/granite-3.2-8b-instruct-preview-IQ4_NL-GGUF

Text Generation • Updated Feb 26 • 7

CISCai/granite-3.2-8b-instruct-SOTA-GGUF

Text Generation • Updated Feb 27 • 82

NikolayKozloff/granite-3.2-8b-instruct-Q8_0-GGUF

Text Generation • Updated Feb 26 • 4 • 1

NikolayKozloff/granite-3.2-2b-instruct-Q8_0-GGUF

Text Generation • Updated Feb 26 • 6 • 1

alexgusevski/granite-3.2-2b-instruct-q3-mlx

Text Generation • Updated Feb 26 • 3

alexgusevski/granite-3.2-2b-instruct-q4-mlx

Text Generation • Updated Feb 26 • 12 • 1

alexgusevski/granite-3.2-2b-instruct-q6-mlx

Text Generation • Updated Feb 26 • 2