Locutusque ParmyJack commited on
Commit
90e310e
1 Parent(s): 9e02bc8

Adding AWQ Quant (#3)

Browse files

- Adding AWQ Quant (3cf097b068114e9c920f3b3596d559800d1e8242)


Co-authored-by: ParmyJack <ParmyJack@users.noreply.huggingface.co>

Files changed (1) hide show
  1. README.md +2 -0
README.md CHANGED
@@ -42,6 +42,8 @@ ExLlamaV2: https://huggingface.co/bartowski/Hyperion-2.0-Mistral-7B-exl2
42
 
43
  GGUF: https://huggingface.co/bartowski/Hyperion-2.0-Mistral-7B-GGUF
44
 
 
 
45
  ## Evaluation Results
46
  0-shot AGIEval
47
  | Tasks |Version|Filter|n-shot| Metric |Value | |Stderr|
 
42
 
43
  GGUF: https://huggingface.co/bartowski/Hyperion-2.0-Mistral-7B-GGUF
44
 
45
+ AWQ: https://huggingface.co/solidrust/Hyperion-2.0-Mistral-7B-AWQ
46
+
47
  ## Evaluation Results
48
  0-shot AGIEval
49
  | Tasks |Version|Filter|n-shot| Metric |Value | |Stderr|