gemma-2-2b-it - GGUF
Quantized GGUF versions of Srivatsormylord/mafia-model
Quantization Methods
Q3_K_M- N/A
Usage
With llama.cpp:
llama-cli -m gemma-2-2b-it-Q4_K_M.gguf -p "Your prompt here"
With Ollama:
Create a Modelfile:
FROM ./gemma-2-2b-it-Q4_K_M.gguf
Then: ollama create my-gemma -f Modelfile
With LM Studio:
Download the GGUF file and import it directly.
- Downloads last month
- 10
Hardware compatibility
Log In to add your hardware
We're not able to determine the quantization variants.
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Model tree for Srivatsormylord/mafia-model-q4
Base model
Srivatsormylord/mafia-model