Edit Models filters

Model Tree

ibm-granite/granite-3.0-2b-instruct

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

23

Full-text search

Active filters: ibm-granite/granite-3.0-2b-instruct

bartowski/granite-3.0-2b-instruct-GGUF

Text Generation • Updated Oct 21 • 2.2k • 5

lmstudio-community/granite-3.0-2b-instruct-GGUF

Text Generation • Updated Oct 21 • 348 • 1

aashish1904/granite-3.0-2b-instruct-Q4_K_M-GGUF

Text Generation • Updated Oct 21 • 15 • 1

aashish1904/granite-3.0-2b-instruct-Q2_K-GGUF

Text Generation • Updated Oct 21 • 21 • 1

osllmai-community/granite-3.0-2b-instruct-GGUF

Text Generation • Updated 26 days ago • 194 • 1

davelsphere/granite-3.0-2b-instruct-Q4_K_M-GGUF

Text Generation • Updated Oct 21 • 12

Triangle104/granite-3.0-2b-instruct-Q4_K_S-GGUF

Text Generation • Updated Oct 21 • 10

Triangle104/granite-3.0-2b-instruct-Q4_K_M-GGUF

Text Generation • Updated Oct 21 • 8

Triangle104/granite-3.0-2b-instruct-Q5_K_S-GGUF

Text Generation • Updated Oct 21 • 5

Triangle104/granite-3.0-2b-instruct-Q5_K_M-GGUF

Text Generation • Updated Oct 21 • 13

Triangle104/granite-3.0-2b-instruct-Q6_K-GGUF

Text Generation • Updated Oct 21 • 15

Triangle104/granite-3.0-2b-instruct-Q8_0-GGUF

Text Generation • Updated Oct 21 • 8

MCZK/granite-3.0-2b-instruct-GGUF

Text Generation • Updated Oct 21 • 82

Felladrin/gguf-q5_k_m-granite-3.0-2b-instruct

Updated Oct 21 • 110

aashish1904/granite-3.0-2b-instruct-Q8_0-GGUF

Text Generation • Updated Oct 21 • 9

onnx-community/granite-3.0-2b-instruct

Text Generation • Updated Oct 22 • 35

DevQuasar/ibm-granite.granite-3.0-2b-instruct-GGUF

Updated Oct 23 • 49

MaziyarPanahi/granite-3.0-2b-instruct-GGUF

Text Generation • Updated about 1 month ago • 317

Esperanto/granite-3.0-2b-instruct-fp16-onnx

Text Generation • Updated 30 days ago • 17

osllmai/granite-3.0-2b-instruct-GGUF

Text Generation • Updated 29 days ago • 129

psolarvi/granite-3.0-2b-instruct-Q4_K_M-GGUF

Text Generation • Updated 26 days ago • 22

mradermacher/granite-3.0-2b-instruct-GGUF

Updated 3 days ago • 241

mradermacher/granite-3.0-2b-instruct-i1-GGUF

Updated 3 days ago • 459