Update README.md
Browse files
README.md
CHANGED
|
@@ -1,3 +1,22 @@
|
|
| 1 |
---
|
| 2 |
license: other
|
|
|
|
|
|
|
|
|
|
| 3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
license: other
|
| 3 |
+
language:
|
| 4 |
+
- en
|
| 5 |
+
inference: false
|
| 6 |
---
|
| 7 |
+
|
| 8 |
+
# OPT-6.7B-Nerybus-Mix
|
| 9 |
+
|
| 10 |
+
This is an experimental model containing a ***parameter-wise 50/50 blend (weighted average)*** of the weights of *NerysV2-6.7B* and *ErebusV1-6.7B*
|
| 11 |
+
Preliminary testing produces pretty coherent outputs, however, it seems less impressive than the 2.7B variant of Nerybus, as both 6.7B source models appear more similar than their 2.7B counterparts.
|
| 12 |
+
|
| 13 |
+
# License
|
| 14 |
+
The two models used for this blend, *NerysV2-6.7B* and *ErebusV1-6.7B* are made by **Mr. Seeker**.
|
| 15 |
+
- https://huggingface.co/KoboldAI/OPT-6.7B-Erebus
|
| 16 |
+
- https://huggingface.co/KoboldAI/OPT-6B-nerys-v2
|
| 17 |
+
The base OPT-6.7B model is licensed under the OPT-175B license, Copyright (c) Meta Platforms, Inc. All Rights Reserved.
|
| 18 |
+
|
| 19 |
+
# Evaluation Results
|
| 20 |
+
No formal evaluation is available for this model at this time. This blend was created in FP16, due to available memory constraints.
|
| 21 |
+
|
| 22 |
+
It is recommend to use this model with the KoboldAI software. All feedback and comments can be directed to Concedo on the KoboldAI discord.
|