GGUF llama.cpp quantized version of:

Recommended Prompt Format (Gemma)

<start_of_turn>model
Provide some context and/or instructions to the model.<end_of_turn>model
<start_of_turn>user
The user’s message goes here<end_of_turn> 
<start_of_turn>model
AI message goes here<end_of_turn>model

Quant Version: b3405 with imatrix

Downloads last month: 23

GGUF

Model size

9.24B params

Architecture

gemma2

Hardware compatibility

2-bit

5-bit

8-bit

16-bit

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for AI-Engine/gemma-2-9b-it-GGUF

Base model

google/gemma-2-9b

Finetuned

google/gemma-2-9b-it

Quantized

(146)

this model