Kooten commited on
Commit
7493047
1 Parent(s): 51e157a

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +33 -0
README.md ADDED
@@ -0,0 +1,33 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: cc-by-4.0
3
+ language:
4
+ - en
5
+ library_name: transformers
6
+ pipeline_tag: text-generation
7
+ tags:
8
+ - roleplay
9
+ ---
10
+
11
+ # LemonadeRP-4.5.3 5bpw
12
+ Exllama quant of [KatyTheCutie/LemonadeRP-4.5.3](https://huggingface.co/KatyTheCutie/LemonadeRP-4.5.3)
13
+ > 7B roleplay focused model, creativity and less cliché is the focus of this merge.
14
+
15
+ ## Other quants:
16
+ EXL2: [8bpw](https://huggingface.co/Kooten/LemonadeRP-4.5.3-8bpw-exl2), [6bpw](https://huggingface.co/Kooten/LemonadeRP-4.5.3-6bpw-exl2), [5bpw](https://huggingface.co/Kooten/LemonadeRP-4.5.3-5bpw-exl2), [4bpw](https://huggingface.co/Kooten/LemonadeRP-4.5.3-4bpw-exl2)
17
+
18
+
19
+ ## Prompt format: Chatml
20
+ Based on the models going in to this I would assume Chatml is the appropriate format.
21
+ ```
22
+ <|im_start|>system
23
+ {sysprompt}<|im_end|>
24
+ <|im_start|>user
25
+ {input}<|im_end|>
26
+ <|im_start|>assistant
27
+ {output}<|im_end|>
28
+ ```
29
+
30
+ ## Contact
31
+ Kooten on discord
32
+
33
+ [ko-fi.com/kooten](https://ko-fi.com/kooten) if you would like to support me