Undi95 commited on
Commit
b8cf9ba
1 Parent(s): 631a357

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +81 -0
README.md ADDED
@@ -0,0 +1,81 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: other
3
+ ---
4
+
5
+ MLewd is a model created to be... Lewd. That's all. Based on ReMM.
6
+
7
+ There was so much attempt on this model that I can't count them all. Bear with me lmao.
8
+
9
+ Command useds and explaination :
10
+ ```shell
11
+ Due to hardware limitation, some merge was done in 2 part.
12
+
13
+ Last mix :
14
+ - ReMM (Base) (0.57)
15
+ - Doctor-Shotgun/llama-2-13b-chat-limarp-v2-merged (Llama Chat Uncensored) (0.35)
16
+ - KoboldAI/LLAMA2-13B-Holodeck-1 (0.08)
17
+
18
+ Part 1: python ties_merge.py TheBloke/Llama-2-13B-fp16 ./MLewdBase-L2-13B-part1 --merge Undi95/ReMM-L2-13B --density 0.88 --merge KoboldAI/LLAMA2-13B-Holodeck-1 --density 0.12 --cuda
19
+
20
+ Part 2: python ties_merge.py TheBloke/Llama-2-13B-fp16 ./MLewdBase-L2-13B --merge Undi95/MLewdBase-L2-13B-part1 --density 0.65 --merge Doctor-Shotgun/llama-2-13b-chat-limarp-v2-merged --density 0.35 --cuda
21
+
22
+ (MLewd-L2-13B-v1-2 got disqualified)
23
+
24
+ - Applying LoRA: nRuaif/Kimiko-v2-13B at (0.24) weight on MLewd-L2-13B-v1-1
25
+ => Result: MLewd-L2-13B-v1-3
26
+
27
+ ================== ERP RANKING TEST ===========================
28
+
29
+ 19.42 | MLewd-L2-13B-v1-3.q5_K_M.gguf (-> Best)
30
+ 19.25 | MLewd-L2-13B-v1-1.q5_K_M.gguf
31
+ 18.25 | MLewd-L2-13B-v1-2.q5 K M.gguf
32
+
33
+ ================== RETRY ===========================
34
+
35
+ Mix:
36
+ - Undi95/MLewd-L2-13B-v1-3 (0.82)
37
+ - Sao10K/Stheno-Inverted-L2-13B (0.18)
38
+
39
+ !python ties_merge.py TheBloke/Llama-2-13B-fp16 ./MLewd-L2-13B-v1-7 --merge Undi95/MLewd-L2-13B-v1-3 --density 0.82 --merge Sao10K/Stheno-Inverted-L2-13B --density 0.18 --cuda
40
+ => Result: MLewd-L2-13B-v1-7
41
+
42
+
43
+ Final touch (trying my best here) :
44
+ MLewd-L2-13B-v1-7 (0.77) + zarakiquemparte/PIPPA-ShareGPT-Subset-QLora-13b (LoRA 0.23)
45
+ => MLewd-L2-13B-v1-7-TRY2
46
+
47
+ FINAL : MLewd-L2-13B-v1-7-TRY2 (0.82) + BluemoonRP (0.18)
48
+ => MLewd-L2-13B-v1-8-3
49
+
50
+ RIP to all the version that got trashed.
51
+ ```
52
+
53
+ <!-- description start -->
54
+ ## Description
55
+
56
+ This repo contains quantized files (Q4_K_S and Q5_K_M) files of MLewd-L2-13B, a trying-to-be lewd LLM model.
57
+ <!-- description end -->
58
+ <!-- description start -->
59
+ ## Models used
60
+ - Undi95/ReMM (Base)
61
+ - Doctor-Shotgun/llama-2-13b-chat-limarp-v2-merged (Llama Chat Uncensored)
62
+ - KoboldAI/LLAMA2-13B-Holodeck-1
63
+ - Sao10K/Stheno-Inverted-L2-13B
64
+ ## Loras used
65
+ - nRuaif/BluemoonRP-L2-13B-This-time-will-be-better/tree/main/lora-out-13b-final-BM/checkpoint-15/adapter_model
66
+ - zarakiquemparte/PIPPA-ShareGPT-Subset-QLora-13b
67
+ <!-- description end -->
68
+ <!-- prompt-template start -->
69
+ ## Prompt template: Alpaca
70
+
71
+ ```
72
+ Below is an instruction that describes a task. Write a response that appropriately completes the request.
73
+
74
+ ### Instruction:
75
+ {prompt}
76
+
77
+ ### Response:
78
+
79
+ ```
80
+
81
+ Special thanks to Sushi kek