| license: apache-2.0 | |
| ## Model Summary | |
| This repository hosts quantized versions of the Qwen2.5-7B-Instruct model. | |
| **Format:** GGUF | |
| **Converter:** llama.cpp 70392f1f81470607ba3afef04aa56c9f65587664 | |
| **Quantizer:** LM-Kit.NET 2024.8.4 | |
| For more detailed information on the base model, please visit the following link: | |
| - [Qwen2.5-7B-Instruct](https://huggingface.co/Qwen/Qwen2.5-7B-Instruct) |