Locutusque bartowski commited on
Commit
7e063fb
1 Parent(s): 1f3258d

Add quant links (#2)

Browse files

- Add quant links (562f5b75087416f398c9a27e337958e1f0a58d12)


Co-authored-by: Bartowski <bartowski@users.noreply.huggingface.co>

Files changed (1) hide show
  1. README.md +7 -1
README.md CHANGED
@@ -11,4 +11,10 @@ Further fine-tuned Locutusque/Hyperion-2.0-Mistral-7B at a higher learning rate.
11
 
12
  # Disclaimer
13
 
14
- This model is very compliant. It will respond to any request without refusal. If you intend to deploy this model at an enterprise level, I would recommend aligning this model using DPO.
 
 
 
 
 
 
 
11
 
12
  # Disclaimer
13
 
14
+ This model is very compliant. It will respond to any request without refusal. If you intend to deploy this model at an enterprise level, I would recommend aligning this model using DPO.
15
+
16
+ ## Quants
17
+
18
+ ExLlamaV2: https://huggingface.co/bartowski/Hyperion-2.1-Mistral-7B-exl2
19
+
20
+ GGUF: https://huggingface.co/bartowski/Hyperion-2.1-Mistral-7B-GGUF