Edit Models filters

Model Tree

google/gemma-2-9b-it

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

104

Full-text search

Active filters: google/gemma-2-9b-it

KingsonHO/gemma-2-9b-it-Q4_0-GGUF

Text Generation • Updated Jul 2 • 14

chenghenry/gemma-2-9b-it-GGUF

Updated Jul 4 • 14

e2jhiubyiiyvw/gemma-2-9b-it-Q5_K_M-GGUF

Text Generation • Updated Jul 3 • 6

zhezhe/gemma-2-9b-it-Q4_K_M-GGUF

Text Generation • Updated Jul 8 • 12

martintomov/gemma-2-9b-it-Q8_0-GGUF

Text Generation • Updated Jul 8 • 2

qnixsynapse/gemma-2-9b-it-IQ4_XS-GGUF

Text Generation • Updated Jul 16 • 4

SanctumAI/gemma-2-9b-it-GGUF

Text Generation • Updated Sep 11 • 104k • 4

AI-Engine/gemma-2-9b-it-GGUF

Updated Jul 22 • 34

QuantFactory/gemma-2-9b-it-DPO-GGUF

Text Generation • Updated Jul 21 • 206 • 3

QuantFactory/gemma-2-9b-it-SimPO-GGUF

Updated Jul 27 • 535 • 2

QuantFactory/gemma-2-9b-it-SimPO-GGUF-v2

Updated Jul 21 • 701 • 3

backyardai/gemma-2-9b-it-GGUF

Text Generation • Updated Jul 22 • 71

newsletter/gemma-2-9b-it-Q6_K-GGUF

Text Generation • Updated Jul 30 • 60

mlc-ai/gemma-2-9b-it-q0f16-MLC

Updated Aug 1 • 3

mlc-ai/gemma-2-9b-it-q3f16_1-MLC

Updated Aug 1 • 2 • 1

mlc-ai/gemma-2-9b-it-q4f32_1-MLC

Updated Aug 1 • 269

mlc-ai/gemma-2-9b-it-q4f16_1-MLC

Updated Aug 1 • 131

Kondara/gemma-2-9b-it-Q4_K_M-GGUF

Text Generation • Updated Aug 1 • 2

joe-hirst/gemma-2-9b-it-Q4_K_M-GGUF

Text Generation • Updated Aug 1 • 7

Xusilak/gemma-2-9b-it-Q8_0-GGUF

Text Generation • Updated Aug 2 • 4

dotsnangles/gemma-2-9b-it-Q4_K_M-GGUF

Text Generation • Updated Aug 3 • 2

GPT4All-Community/gemma-2-9b-it-GGUF

Text Generation • Updated Aug 20 • 1.22k

illeatmyhat/gemma-2-9b-it-Q6_K-GGUF

Text Generation • Updated Aug 5 • 2

blogcncom/gemma-2-9b-it-Q4_0-GGUF

Text Generation • Updated Aug 6 • 14

neuralmagic/gemma-2-9b-it-quantized.w8a16

Text Generation • Updated Oct 9 • 244 • 1

neuralmagic/gemma-2-9b-it-quantized.w8a8

Text Generation • Updated Oct 9 • 475 • 2

Sunny0624/gemma-2-9b-it-Q4_K_M-GGUF

Text Generation • Updated Aug 19 • 4

NickTsaizer/gemma-2-9b-it-Q4_K_M-GGUF

Text Generation • Updated Aug 22 • 4

jacobcarajo/gemma-2-9b-it-Q5_K_M-GGUF

Text Generation • Updated Aug 22 • 3

QuantFactory/WoonaV1.2-9b-GGUF

Updated Aug 28 • 108 • 4