Edit Models filters

Model Tree

google/gemma-2-2b-it

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

185

Base only

Active filters: google/gemma-2-2b-it

google/gemma-2-2b-it-GGUF

3B • Updated Aug 27, 2024 • 150 • 92

Fizzarolli/gemma-2-2b-it-Q8_0-GGUF

Text Generation • 3B • Updated Jul 31, 2024 • 11

kaetemi/gemma-2-2b-it-Q4_0-GGUF

Text Generation • 3B • Updated Jul 31, 2024 • 39

Wusul/gemma-2-2b-it-Q8_0-GGUF

Text Generation • Updated Jul 31, 2024 • 17

bartowski/gemma-2-2b-it-GGUF

Text Generation • 3B • Updated Aug 5, 2024 • 243k • 100

BafS/gemma-2-2b-it-Q4_K_M-GGUF

Text Generation • 3B • Updated Jul 31, 2024 • 1.93k • 6

lmstudio-community/gemma-2-2b-it-GGUF

Text Generation • 3B • Updated Jul 31, 2024 • 5.74k • 22

legraphista/gemma-2-2b-it-IMat-GGUF

Text Generation • 3B • Updated Jul 31, 2024 • 915 • 2

newsletter/gemma-2-2b-it-Q6_K-GGUF

Text Generation • 3B • Updated Jul 31, 2024 • 89

roshanai/gemma-2-2b-it-Q6_K-GGUF

Text Generation • 3B • Updated Jul 31, 2024 • 83 • 2

mlc-ai/gemma-2-2b-it-q0f32-MLC

Updated Sep 7, 2025

mlc-ai/gemma-2-2b-it-q4f16_1-MLC

Updated Sep 7, 2025 • 8.82k • 6

mlc-ai/gemma-2-2b-it-q4f32_1-MLC

Updated Sep 7, 2025 • 418

mlc-ai/gemma-2-2b-it-q0f16-MLC

Updated Sep 7, 2025

NikolayKozloff/gemma-2-2b-it-Q8_0-GGUF

Text Generation • 3B • Updated Jul 31, 2024 • 11 • 1

ac3xx/gemma-2-2b-it-Q4_K_M-GGUF

Text Generation • 3B • Updated Aug 1, 2024 • 22

ac3xx/gemma-2-2b-it-Q6_K-GGUF

Text Generation • 3B • Updated Aug 1, 2024 • 8

Kondara/gemma-2-2b-it-Q8_0-GGUF

Text Generation • 3B • Updated Aug 1, 2024 • 4

Kondara/gemma-2-2b-it-Q4_K_M-GGUF

Text Generation • 3B • Updated Aug 1, 2024 • 14

ironlanderl/gemma-2-2b-it-Q5_K_M-GGUF

Text Generation • 3B • Updated Aug 1, 2024 • 42

polyverse/gemma-2-2b-it-Q4_K_M-GGUF

Text Generation • 3B • Updated Aug 1, 2024 • 292

second-state/gemma-2-2b-it-GGUF

Text Generation • 3B • Updated Aug 6, 2024 • 241 • 1

gaianet/gemma-2-2b-it-GGUF

Text Generation • 3B • Updated Aug 1, 2024 • 58

MaziyarPanahi/gemma-2-2b-it-GGUF

Text Generation • 3B • Updated Aug 1, 2024 • 105k • 14

mrmage/gemma-2-2b-it-Q4_K_M-GGUF

Text Generation • 3B • Updated Aug 1, 2024 • 11

joehirstdev/gemma-2-2b-it-Q4_K_M-GGUF

Text Generation • 3B • Updated Aug 1, 2024 • 17 • 1

mrmage/gemma-2-2b-it-Q3_K_M-GGUF

Text Generation • 3B • Updated Aug 1, 2024 • 45

qnixsynapse/Gemma-V2-2B-Instruct-GGUF

Text Generation • 3B • Updated Aug 13, 2024 • 15

cha9ro/gemma-2-2b-it-Q4_K_M-GGUF

Text Generation • 3B • Updated Aug 1, 2024 • 15

wiktorwojcik112/gemma-2-2b-it-Q4_K_M-GGUF

Text Generation • 3B • Updated Aug 1, 2024 • 37