---
license: apache-2.0
---
## Model Summary

This repository hosts quantized versions of the Qwen2.5-7B-Instruct model.

**Format:** GGUF  
**Converter:** llama.cpp 70392f1f81470607ba3afef04aa56c9f65587664  
**Quantizer:** LM-Kit.NET 2024.8.4

For more detailed information on the base model, please visit the following link:
- [Qwen2.5-7B-Instruct](https://huggingface.co/Qwen/Qwen2.5-7B-Instruct)