Kooten commited on
Commit
7dbdfe9
1 Parent(s): 80edea4

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +27 -0
README.md ADDED
@@ -0,0 +1,27 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # MiquMaid-v1-70B 3.5bpw
2
+
3
+ ## Description
4
+ Exllama quant of [NeverSleep/MiquMaid-v1-70B](https://huggingface.co/NeverSleep/MiquMaid-v1-70B)
5
+
6
+ ## Other quants:
7
+ EXL2: [3.5bpw](https://huggingface.co/Kooten/MiquMaid-v1-70B-3.5bpw-exl2), [3bpw](https://huggingface.co/Kooten/MiquMaid-v1-70B-3.5bpw-exl2), [2.4bpw](https://huggingface.co/Kooten/MiquMaid-v1-70B-2.4bpw-exl2)
8
+
9
+ GGUF:
10
+
11
+ [2bit Imatrix GGUF](https://huggingface.co/Kooten/MiquMaid-v1-70B-IQ2-GGUF)
12
+
13
+ [NeverSleeps Official Quants](https://huggingface.co/NeverSleep/MiquMaid-v1-70B-GGUF)
14
+
15
+ ### Custom format:
16
+ ```
17
+ ### Instruction:
18
+ {system prompt}
19
+
20
+ ### Input:
21
+ {input}
22
+
23
+ ### Response:
24
+ {reply}
25
+ ```
26
+ ## Contact
27
+ Kooten on discord