Upload README.md

README.md

@@ -13,6 +13,26 @@ license: other
 
 ![Dark-Miqu.png](Dark-Miqu.png)
 
+# Dark-Miqu-70B - EXL2 2.4bpw
+
+This is a 2.4bpw EXL2 quant of [jukofyork/Dark-Miqu-70B](https://huggingface.co/jukofyork/Dark-Miqu-70B)
+
+This quant was made using exllamav2-0.0.21 with default dataset and settings.
+
+This quant fits around 24k context on 24GB VRAM on Windows in my local testing (with exl2 Q4 cache), you might be able to get more depending on other things taking VRAM.
+
+I tested this quant shortly in some random RPs (including ones over 8k and 20k context) and it seems to work fine.
+
+## Prompt Templates
+
+This model uses Mistral, Alpaca and Vicuna formats.
+
+For more details see original readme below
+
+### Original readme below
+
+---
+
 A "dark" creative writing model with 32k context. Based off [miqu-1-70b](https://huggingface.co/miqudev/miqu-1-70b) but with greatly reduced "positivity" and "-isms". If you want happy endings, look elsewhere! 
 
 This model **excels** at writing Dark/Grimdark fantasy (see examples below).