Kquant03
/

Hippolyta-7B-GGUF

Inference Endpoints

Model card Files Files and versions Community

Kquant03 commited on Jan 11

Commit

edac662

•

1 Parent(s): 4cdcbe7

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -32,4 +32,4 @@ I spoke to it personally for about an hour, and I believe we need to work on our
 | [Q6 XL](https://huggingface.co/Kquant03/Medusa-7B-GGUF/blob/main/ggml-model-q6_k.gguf) | Q6_K | 6 | 5.94 GB| 7.94 GB | very large, extremely low quality loss |
 | [Q8 XXL](https://huggingface.co/Kquant03/Medusa-7B-GGUF/blob/main/ggml-model-q8_0.gguf) | Q8_0 | 8 | 7.7 GB| 9.7 GB | very large, extremely low quality loss - not recommended |
-- Uses Mistral prompt template.

 | [Q6 XL](https://huggingface.co/Kquant03/Medusa-7B-GGUF/blob/main/ggml-model-q6_k.gguf) | Q6_K | 6 | 5.94 GB| 7.94 GB | very large, extremely low quality loss |
 | [Q8 XXL](https://huggingface.co/Kquant03/Medusa-7B-GGUF/blob/main/ggml-model-q8_0.gguf) | Q8_0 | 8 | 7.7 GB| 9.7 GB | very large, extremely low quality loss - not recommended |
+- Uses Mistral prompt template with chat-instruct.