Commit
•
e337740
1
Parent(s):
1ea50bd
Update README.md
Browse files
README.md
CHANGED
|
@@ -7,7 +7,7 @@ After I put down the joint and [RTFM](https://arxiv.org/pdf/2311.03099.pdf), I h
|
|
| 7 |
|
| 8 |
### Hypothesis
|
| 9 |
|
| 10 |
-
By lowering the density, I hit closer to the sweet-spot shown in the paper. Also, I'm using my fixed base model, so hopefully that helps too.
|
| 11 |
|
| 12 |
### Recipe
|
| 13 |
merge_method: dare_ties
|
|
|
|
| 7 |
|
| 8 |
### Hypothesis
|
| 9 |
|
| 10 |
+
By lowering the density, I hit closer to the sweet-spot shown in the paper. Also, I'm using my fixed base model, so hopefully that helps too. Weights are adjusted to make the later layers more aligned with ORCA 2.
|
| 11 |
|
| 12 |
### Recipe
|
| 13 |
merge_method: dare_ties
|