Update README.md
Browse files
README.md
CHANGED
@@ -7,7 +7,7 @@ license: cc-by-nc-4.0
|
|
7 |
|
8 |
# Badger Mushroom 4x8b
|
9 |
|
10 |
-
I've been really impressed with how well these frankenmoe models quant compared to the base llama 8b, but with far better speed than the 70b. 8x8b seemed a bit unneccessary for how much additonal value it brougt, so I dialed it back to a
|
11 |
|
12 |
```
|
13 |
base_model: ./maldv/badger
|
|
|
7 |
|
8 |
# Badger Mushroom 4x8b
|
9 |
|
10 |
+
I've been really impressed with how well these frankenmoe models quant compared to the base llama 8b, but with far better speed than the 70b. 8x8b seemed a bit unneccessary for how much additonal value it brougt, so I dialed it back to a 4x8b version. This model feels pretty good out of the gate, which considering how I used a non-standard merge; is a bit surprising.
|
11 |
|
12 |
```
|
13 |
base_model: ./maldv/badger
|