Not-For-All-Audiences
nsfw
IHaBiS commited on
Commit
9cee5ae
1 Parent(s): 7165e51

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +65 -0
README.md ADDED
@@ -0,0 +1,65 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: cc-by-nc-4.0
3
+ tags:
4
+ - not-for-all-audiences
5
+ - nsfw
6
+ ---
7
+ ## Exl2 version of [Undi95/SolarMaid-v0.1.1](https://huggingface.co/Undi95/SolarMaid-v0.1.1)
8
+
9
+ ## branch
10
+ 3bh8 : 3bpw h8
11
+ 3.5bh8 : 3.5bpw h8
12
+ 3.8bh8 : 3.8bpw h8
13
+ 4bh8 : 4bpw h8
14
+ 6bh8 : 6bpw h8
15
+ 8bh8 : 8bpw h8
16
+
17
+ Using ThePile [0007.parquet](https://huggingface.co/datasets/EleutherAI/the_pile_deduplicated/resolve/refs%2Fconvert%2Fparquet/default/train/0007.parquet) as dataset
18
+
19
+ Quantization settings : ```python convert.py -i models/Undi95_SolarMaid-v0.1.1 -o SolarMaid-v0.1.1-temp -cf SolarMaid-v0.1.1-8bpw-h8-exl2 -c 0007.parquet -l 8192 -b 8 -hb 8 -ml 8192```
20
+ ```python convert.py -i models/Undi95_SolarMaid-v0.1.1 -o SolarMaid-v0.1.1-temp2 -cf SolarMaid-v0.1.1-6bpw-h8-exl2 -c 0007.parquet -l 8192 -b 6 -hb 8 -m SolarMaid-v0.1.1-temp/measurement.json -ml 8192```
21
+ ```python convert.py -i models/Undi95_SolarMaid-v0.1.1 -o SolarMaid-v0.1.1-temp3 -cf SolarMaid-v0.1.1-4bpw-h8-exl2 -c 0007.parquet -l 8192 -b 4 -hb 8 -m SolarMaid-v0.1.1-temp/measurement.json -ml 8192```
22
+ ```python convert.py -i models/Undi95_SolarMaid-v0.1.1 -o SolarMaid-v0.1.1-temp4 -cf SolarMaid-v0.1.1-3bpw-h8-exl2 -c 0007.parquet -l 8192 -b 3 -hb 8 -m SolarMaid-v0.1.1-temp/measurement.json -ml 8192```
23
+ ```python convert.py -i models/Undi95_SolarMaid-v0.1.1 -o SolarMaid-v0.1.1-temp5 -cf SolarMaid-v0.1.1-2.4bpw-h8-exl2 -c 0007.parquet -l 8192 -b 2.4 -hb 8 -m SolarMaid-v0.1.1-temp/measurement.json -ml 8192```
24
+ ### below this line is original readme
25
+ SolarMaid is a model made primarely for ERP (Erotic Roleplay) without being too dumb, it use 40 out of 48 layers of "SOLAR Instruct 10.7B", and 32 out of 32 layers of "Noromaid 7B v0.1.1".
26
+
27
+ Despite being a little unstable, [benchmark stay high](https://huggingface.co/Undi95/SolarMaid-v0.1.1/blob/main/SolarMaid-v0.1.1.json), and can output some hot sh*t.
28
+
29
+ I'm working on making it more stable.
30
+
31
+ <!-- description start -->
32
+ ## Description
33
+
34
+ This repo contains fp16 files of SolarMaid v0.1.1.
35
+
36
+ <!-- description end -->
37
+ <!-- description start -->
38
+ ## Models used
39
+
40
+ - upstage/SOLAR-10.7B-Instruct-v1.0
41
+ - NeverSleep/Noromaid-7b-v0.1.1
42
+
43
+ <!-- description end -->
44
+ <!-- prompt-template start -->
45
+ ## Prompt template: Alpaca
46
+
47
+ ```
48
+ Below is an instruction that describes a task. Write a response that appropriately completes the request.
49
+
50
+ ### Instruction:
51
+ {prompt}
52
+
53
+ ### Response:
54
+ ```
55
+ ## Prompt template: Custom (SOLAR)
56
+
57
+ ```
58
+ ### User:
59
+ {prompt}
60
+
61
+ ### Assistant:
62
+ ```
63
+
64
+
65
+ If you want to support me, you can [here](https://ko-fi.com/undiai).