Hestia-20b-GGUF / README.md
athirdpath's picture
Update README.md
6abc50a
|
raw
history blame
No virus
694 Bytes
metadata
license: cc-by-nc-4.0

This is several GGUF quants of Hestia-20b.

Hestia-20b is a task_arithmetic merge of Harmonia (my 20b faux base model) with Noromaid and my LORA-glued Nethena. The results aren't quite what I expected, though they are far from disappointing. The jury is out on whether this merge outperforms Harmonia.

merge_method: task_arithmetic

base_model: athirdpath/Harmonia-20b

models:

  • model: athirdpath/Harmonia-20b

  • model: NeverSleep/Noromaid-20b-v0.1.1

    • parameters: weight: 0.25
  • model: athirdpath/Nethena-20b-Glued

    • parameters: weight: 0.2

dtype: float16

Thanks to Undi95 for pioneering the 20B recipe, and for most of the models involved.