Rose : GGUF

This model was converted to GGUF format using Unsloth.

Example usage:

  • For text only LLMs: llama-cli -hf gesusprod/Rose --jinja
  • For multimodal models: llama-mtmd-cli -hf gesusprod/Rose --jinja

Available model files:

  • Vikhr-Gemma-2B-instruct.F16.gguf
Downloads last month
25
GGUF
Model size
3B params
Architecture
gemma2
Hardware compatibility
Log In to add your hardware

16-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support