Hugging Face's logo

dranger003
/
labradorite-13b-iMat.GGUF

Text Generation
GGUF
Inference Endpoints
Model card Files Community
dranger003 commited on
Commit
e3be4c7
•
1 Parent(s): fa6fac3

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -12,4 +12,4 @@ GGUF importance matrix (imatrix) quants for https://huggingface.co/ibm/labradori
12
 
13
  | Layers | Context | [Template](https://huggingface.co/ibm/labradorite-13b#prompt-template) |
14
  | --- | --- | --- |
15
- | <pre>40</pre> | <pre>32768</pre> | <pre>\<\|system\|\><br>{sys_prompt}<br>\<\|user\|\><br>{inputs}<br>\<\|assistant\|\><br>{response}\<\|endoftext\|\></pre> |
 
12
 
13
  | Layers | Context | [Template](https://huggingface.co/ibm/labradorite-13b#prompt-template) |
14
  | --- | --- | --- |
15
+ | <pre>40</pre> | <pre>4096</pre> | <pre>\<\|system\|\><br>{sys_prompt}<br>\<\|user\|\><br>{inputs}<br>\<\|assistant\|\><br>{response}\<\|endoftext\|\></pre> |