Hugging Face's logo

Crataco
/
Nous-Hermes-2-Mistral-7B-DPO-imatrix-GGUF

GGUF
English
Mistral
instruct
finetune
chatml
DPO
RLHF
gpt4
synthetic data
distillation
Model card Files Community
1
Crataco commited on
Commit
9d48d41
•
1 Parent(s): 6e868d9

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -0
README.md CHANGED
@@ -33,6 +33,7 @@ Here's a chart that provides an approximation of the HellaSwag score (out of 1,0
33
  |Quantization|HellaSwag|256 ctx RAM|512 ctx|1024 ctx|2048 ctx|4096 ctx|8192 ctx
34
  |--------|--------|--------|--------|--------|--------|--------|--------|
35
  |IQ1_S |51.7% |1.6 GiB |1.6 GiB |1.7 GiB |1.8 GiB |2.0 GiB |2.5 GiB |
 
36
  |IQ2_XXS |72.5% |1.9 GiB |1.9 GiB |2.0 GiB |2.1 GiB |2.4 GiB |2.9 GiB |
37
  |IQ2_XS |74.2% |2.1 GiB |2.1 GiB |2.2 GiB |2.3 GiB |2.6 GiB |3.1 GiB |
38
  |IQ2_S |76.8% |2.2 GiB |2.2 GiB |2.3 GiB |2.4 GiB |2.7 GiB |3.2 GiB |
 
33
  |Quantization|HellaSwag|256 ctx RAM|512 ctx|1024 ctx|2048 ctx|4096 ctx|8192 ctx
34
  |--------|--------|--------|--------|--------|--------|--------|--------|
35
  |IQ1_S |51.7% |1.6 GiB |1.6 GiB |1.7 GiB |1.8 GiB |2.0 GiB |2.5 GiB |
36
+ |IQ1_M |60.5% |
37
  |IQ2_XXS |72.5% |1.9 GiB |1.9 GiB |2.0 GiB |2.1 GiB |2.4 GiB |2.9 GiB |
38
  |IQ2_XS |74.2% |2.1 GiB |2.1 GiB |2.2 GiB |2.3 GiB |2.6 GiB |3.1 GiB |
39
  |IQ2_S |76.8% |2.2 GiB |2.2 GiB |2.3 GiB |2.4 GiB |2.7 GiB |3.2 GiB |