LilyWinter
commited on
Commit
•
965b8d7
1
Parent(s):
36f1fca
Update README.md
Browse files
README.md
CHANGED
@@ -117,12 +117,13 @@ A merge using a custom algorithm of:
|
|
117 |
|
118 |
This merge retains most of the weights of Miqu, but when a weight is similar between the two, it is interpolated to the WinterGoddess value. A parameter *t* specifies the sameness threshold. When the distance between two values is below *t*, the weight from WinterGoddess is used.
|
119 |
|
120 |
-
This version of the model uses *t* = 0.001. *t
|
121 |
|
122 |
-
- *t* = 0.
|
123 |
-
- *t* = 0.
|
124 |
-
- *t* = 0.
|
125 |
-
- *t* = 0.
|
|
|
126 |
|
127 |
```
|
128 |
t: Union[float, np.ndarray],
|
|
|
117 |
|
118 |
This merge retains most of the weights of Miqu, but when a weight is similar between the two, it is interpolated to the WinterGoddess value. A parameter *t* specifies the sameness threshold. When the distance between two values is below *t*, the weight from WinterGoddess is used.
|
119 |
|
120 |
+
This version of the model uses *t* = 0.001. At this *t*, about 10% of weights are fully switched to WinterGoddess. Model quality rapidly degrades above *t* = 0.0025:
|
121 |
|
122 |
+
- *t* = 0.0003 (~2% full swap)
|
123 |
+
- *t* = 0.001 (~10% full swap): This model
|
124 |
+
- *t* = 0.0025 (~18% full swap): Generates one paragraph okay, but then reverts to garbage
|
125 |
+
- *t* = 0.005 (~35% full swap): Garbage; semi-related word lists
|
126 |
+
- *t* = 0.01 (~55% full swap): Garbage; pseudorandom tokens output
|
127 |
|
128 |
```
|
129 |
t: Union[float, np.ndarray],
|