dranger003
/

Qwen1.5-72B-Chat-iMat.GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

dranger003 commited on Feb 18

Commit

811aa0b

•

1 Parent(s): bf1d3d4

Update README.md

Files changed (1) hide show

README.md +5 -1

README.md CHANGED Viewed

@@ -5,4 +5,8 @@ license_link: https://huggingface.co/Qwen/Qwen1.5-72B-Chat/blob/main/LICENSE
 library_name: gguf
 pipeline_tag: text-generation
 ---
-GGUF importance matrix (imatrix) quants for https://huggingface.co/Qwen/Qwen1.5-72B-Chat

 library_name: gguf
 pipeline_tag: text-generation
 ---
+GGUF importance matrix (imatrix) quants for https://huggingface.co/Qwen/Qwen1.5-72B-Chat
+| Layers | Context | Template |
+| --- | --- | --- |
+| <pre>80</pre> | <pre>32768</pre> | <pre><\|im_start\|>system<br>{instructions}<\|im_end\|><br><\|im_start\|>user<br>{prompt}<\|im_end\|><br><\|im_start\|>assistant<br>{response}</pre> |