--- license: other license_name: deepseek library_name: gguf license_link: >- https://huggingface.co/deepseek-ai/deepseek-coder-33b-instruct/blob/main/LICENSE pipeline_tag: text-generation --- GGUF importance matrix (imatrix) quants for https://huggingface.co/deepseek-ai/deepseek-coder-33b-instruct The importance matrix was trained for 100K tokens (200 batches of 512 tokens) using wiki.train.raw. | Layers | Context | Template | | --- | --- | --- | |
62
|
16384
|
{instructions}
### Instruction:
{prompt}
### Response:
{response}
|