Undi95 commited on
Commit
c3dcae7
1 Parent(s): f8262c8

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +32 -0
README.md ADDED
@@ -0,0 +1,32 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: cc-by-nc-4.0
3
+ tags:
4
+ - not-for-all-audiences
5
+ - nsfw
6
+ ---
7
+
8
+ Mixtral-8x7B-MoE-RP-Story is a model made primarely for chatting, RP (Roleplay) and storywriting.
9
+ 2 RP model, 2 chat model, 1 occult model, 1 storywritting model, 1 mathematic model and 1 DPO model was used for a MoE. Bagel was the base.
10
+
11
+ The DPO chat model is here to help get more human reply.
12
+
13
+ This is my first try at doing this, so don't hesitate to give feedback!
14
+
15
+ <!-- description start -->
16
+ ## Description
17
+
18
+ This repo contains fp16 files of Mixtral-8x7B-MoE-RP-Story.
19
+
20
+ <!-- description end -->
21
+ <!-- description start -->
22
+ ## Models used
23
+
24
+ The list of model used and their activator/theme can be found [here](https://huggingface.co/Undi95/Mixtral-8x7B-MoE-RP-Story/blob/main/config.yaml)
25
+
26
+ <!-- description end -->
27
+ <!-- prompt-template start -->
28
+ ## Prompt template: Custom
29
+
30
+ Using Bagel as a base let us a lot of different prompting system theorically, you can see all the prompting available [here](jondurbin/bagel-7b-v0.1).
31
+
32
+ If you want to support me, you can [here](https://ko-fi.com/undiai).