DeepSeek-R1-Distill-Qwen-1.5B GGUF

This repo contains a GGUF version of DeepSeek-R1-Distill-Qwen-1.5B.

  • Quantization: Q5_K_M (Medium, 5-bit)
  • Architecture: Qwen2.5-Math-1.5B
  • Context Window: Up to 128k tokens

Usage

You can run this model using llama.cpp or other GGUF-compatible tools like LM Studio.

Downloads last month
12
GGUF
Model size
2B params
Architecture
qwen2
Hardware compatibility
Log In to add your hardware

5-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for nozdev/ollama

Quantized
(265)
this model