Envoid commited on
Commit
a381e25
1 Parent(s): 3798112

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +29 -0
README.md CHANGED
@@ -1,3 +1,32 @@
1
  ---
2
  license: cc-by-nc-4.0
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: cc-by-nc-4.0
3
+ tags:
4
+ - not-for-all-audiences
5
  ---
6
+ # Caution:
7
+
8
+ This model may produce adult content.
9
+
10
+ This model first puts together:
11
+
12
+ [Sao10K/Sensualize-Mixtral-bf16](https://huggingface.co/Sao10K/Sensualize-Mixtral-bf16)
13
+
14
+ [NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO](https://huggingface.co/NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO)
15
+
16
+ and
17
+
18
+ [mistralai/Mixtral-8x7B-Instruct-v0.1](https://huggingface.co/mistralai/Mixtral-8x7B-Instruct-v0.1)
19
+
20
+ In a DARE TIES merge utilizing [mistralai/Mixtral-8x7B-v0.1](https://huggingface.co/mistralai/Mixtral-8x7B-v0.1) as a base model.
21
+
22
+ The resulting model can now respond decently to both ChatML and Mixtral formatting. Unfortunately the warmer assistant personality of Nous Hermes is lost in the process. However much of Nous Hermes' excellent attention to detail and prose is carried forward when used for role play.
23
+
24
+ It was then merged together with
25
+
26
+ [Envoid/CATA-LimaRP-Zloss-DT-TaskArithmetic-8x7B](https://huggingface.co/Envoid/CATA-LimaRP-Zloss-DT-TaskArithmetic-8x7B) Utilizing the SLERP method.
27
+
28
+ Both merges were done using relatively normalized weights and densities without any gradients.
29
+
30
+ The end result is a fairly solid model for all of your SillyTavern needs, responding to either Mixtral Instruct or ChatML formatting.
31
+
32
+ Enjoy!