File size: 667 Bytes
a0d4ad9 8e58cc3 a0d4ad9 93d15d9 8e18576 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 |
---
license: other
license_name: deepseek-license
license_link: LICENSE
quantized_by: bartowski
pipeline_tag: text-generation
base_model: deepseek-ai/DeepSeek-Coder-V2-Instruct
---
Slowly creating, with imatrix, will add my usual details later
So far IQ1_M is up with an eyewatering size of 52.7GB
[IQ1_M](https://huggingface.co/bartowski/DeepSeek-Coder-V2-Instruct-GGUF/tree/main/DeepSeek-Coder-V2-Instruct-IQ1_M.gguf)
[IQ2_XS](https://huggingface.co/bartowski/DeepSeek-Coder-V2-Instruct-GGUF/tree/main/DeepSeek-Coder-V2-Instruct-IQ2_XS.gguf)
[Q2_K](https://huggingface.co/bartowski/DeepSeek-Coder-V2-Instruct-GGUF/tree/main/DeepSeek-Coder-V2-Instruct-Q2_K.gguf) |