dranger003's picture
Update README.md
c755775 verified
metadata
license: other
license_name: deepseek
library_name: gguf
license_link: >-
  https://huggingface.co/deepseek-ai/deepseek-coder-33b-instruct/blob/main/LICENSE
pipeline_tag: text-generation

GGUF importance matrix (imatrix) quants for https://huggingface.co/deepseek-ai/deepseek-coder-33b-instruct
The importance matrix was trained for 100K tokens (200 batches of 512 tokens) using wiki.train.raw.

2024-03-13: Updated IQ1_S using latest commit 19885d20. More info here and here.

Layers Context Template
62
16384
{instructions}
### Instruction:
{prompt}
### Response:
{response}