ParmyJack commited on
Commit
3cf097b
1 Parent(s): 9e02bc8

Adding AWQ Quant

Browse files

Thank-you for another great model. We have made an AWQ quant for it.

Files changed (1) hide show
  1. README.md +2 -0
README.md CHANGED
@@ -42,6 +42,8 @@ ExLlamaV2: https://huggingface.co/bartowski/Hyperion-2.0-Mistral-7B-exl2
42
 
43
  GGUF: https://huggingface.co/bartowski/Hyperion-2.0-Mistral-7B-GGUF
44
 
 
 
45
  ## Evaluation Results
46
  0-shot AGIEval
47
  | Tasks |Version|Filter|n-shot| Metric |Value | |Stderr|
 
42
 
43
  GGUF: https://huggingface.co/bartowski/Hyperion-2.0-Mistral-7B-GGUF
44
 
45
+ AWQ: https://huggingface.co/solidrust/Hyperion-2.0-Mistral-7B-AWQ
46
+
47
  ## Evaluation Results
48
  0-shot AGIEval
49
  | Tasks |Version|Filter|n-shot| Metric |Value | |Stderr|