dranger003
/

deepseek-coder-33b-instruct-iMat.GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

dranger003 commited on Mar 13

Commit

148b711

•

1 Parent(s): 85828da

Update README.md

Files changed (1) hide show

README.md +2 -0

README.md CHANGED Viewed

@@ -9,6 +9,8 @@ pipeline_tag: text-generation
 GGUF importance matrix (imatrix) quants for https://huggingface.co/deepseek-ai/deepseek-coder-33b-instruct
 The importance matrix was trained for 100K tokens (200 batches of 512 tokens) using wiki.train.raw.
 | Layers | Context | Template |
 | --- | --- | --- |
 | <pre>62</pre> | <pre>16384</pre> | <pre>{instructions}<br>### Instruction:<br>{prompt}<br>### Response:<br>{response}</pre> |

 GGUF importance matrix (imatrix) quants for https://huggingface.co/deepseek-ai/deepseek-coder-33b-instruct
 The importance matrix was trained for 100K tokens (200 batches of 512 tokens) using wiki.train.raw.
+**2024-03-13**: Updated IQ1_S using latest commit `19885d20`.
 | Layers | Context | Template |
 | --- | --- | --- |
 | <pre>62</pre> | <pre>16384</pre> | <pre>{instructions}<br>### Instruction:<br>{prompt}<br>### Response:<br>{response}</pre> |