Create README.md
Browse files
README.md
ADDED
@@ -0,0 +1,27 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
# MiquMaid-v1-70B 3.5bpw
|
2 |
+
|
3 |
+
## Description
|
4 |
+
Exllama quant of [NeverSleep/MiquMaid-v1-70B](https://huggingface.co/NeverSleep/MiquMaid-v1-70B)
|
5 |
+
|
6 |
+
## Other quants:
|
7 |
+
EXL2: [3.5bpw](https://huggingface.co/Kooten/MiquMaid-v1-70B-3.5bpw-exl2), [3bpw](https://huggingface.co/Kooten/MiquMaid-v1-70B-3.5bpw-exl2), [2.4bpw](https://huggingface.co/Kooten/MiquMaid-v1-70B-2.4bpw-exl2)
|
8 |
+
|
9 |
+
GGUF:
|
10 |
+
|
11 |
+
[2bit Imatrix GGUF](https://huggingface.co/Kooten/MiquMaid-v1-70B-IQ2-GGUF)
|
12 |
+
|
13 |
+
[NeverSleeps Official Quants](https://huggingface.co/NeverSleep/MiquMaid-v1-70B-GGUF)
|
14 |
+
|
15 |
+
### Custom format:
|
16 |
+
```
|
17 |
+
### Instruction:
|
18 |
+
{system prompt}
|
19 |
+
|
20 |
+
### Input:
|
21 |
+
{input}
|
22 |
+
|
23 |
+
### Response:
|
24 |
+
{reply}
|
25 |
+
```
|
26 |
+
## Contact
|
27 |
+
Kooten on discord
|