File size: 694 Bytes
a0eb984 6abc50a |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 |
---
license: cc-by-nc-4.0
---
This is several GGUF quants of Hestia-20b.
Hestia-20b is a task_arithmetic merge of Harmonia (my 20b faux base model) with Noromaid and my LORA-glued Nethena. The results aren't quite what I expected, though they are far from disappointing. The jury is out on whether this merge outperforms Harmonia.
merge_method: task_arithmetic
base_model: athirdpath/Harmonia-20b
models:
- model: athirdpath/Harmonia-20b
- model: NeverSleep/Noromaid-20b-v0.1.1
- parameters: weight: 0.25
- model: athirdpath/Nethena-20b-Glued
- parameters: weight: 0.2
dtype: float16
Thanks to Undi95 for pioneering the 20B recipe, and for most of the models involved. |