BlueNipples commited on
Commit
6ec972b
1 Parent(s): 297f691

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +29 -1
README.md CHANGED
@@ -10,4 +10,32 @@ tags:
10
 
11
  I did a more aggressive gradient SLERP on the base model with a medical lora added to Frostwind preserving more of the prose model and the prose seemed better without degredation in coherency. So then I redid the dares ties merge of it, with it's parent models, but with a slightly lower weight to FrostWind.
12
 
13
- It's possible it will be slightly noisier than the last revision, but it also should have the strongest prose in theory of the variants. Brief testing seems to back this up. If you want to maximize prose and don't mind some regens you may prefer this model.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
10
 
11
  I did a more aggressive gradient SLERP on the base model with a medical lora added to Frostwind preserving more of the prose model and the prose seemed better without degredation in coherency. So then I redid the dares ties merge of it, with it's parent models, but with a slightly lower weight to FrostWind.
12
 
13
+ Prose is a bit stronger, coherency slightly weaker with this variant. It's excellent if you are prepared to regen. Really happy with both these models.
14
+
15
+ Formula for the DARE TIES merge is as follows (FrostMed is Frostwind with Solarmed at 0.15 weight):
16
+
17
+ - model: ./Frostmaid
18
+ parameters:
19
+ density: [0.45] # density gradient
20
+ weight: 0.23
21
+ - model: ./FrostMed
22
+ parameters:
23
+ density: [0.35] # density gradient
24
+ weight: 0.18
25
+ - model: ./SnowLotus-10.7B-v2
26
+ parameters:
27
+ density: [1] # density gradient
28
+ weight: 1
29
+
30
+
31
+ Resources used:
32
+
33
+ https://huggingface.co/BlueNipples/SnowLotus-v2-10.7B
34
+
35
+ https://huggingface.co/NyxKrage/FrostMaid-10.7B-TESTING-pt
36
+
37
+ https://huggingface.co/Sao10K/Frostwind-10.7B-v1
38
+
39
+ https://huggingface.co/NyxKrage/Solar-Doc-10.7B-Lora
40
+
41
+ https://github.com/cg123/mergekit/tree/main