File size: 694 Bytes
a0eb984
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
6abc50a
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
---
license: cc-by-nc-4.0
---
This is several GGUF quants of Hestia-20b.

Hestia-20b is a task_arithmetic merge of Harmonia (my 20b faux base model) with Noromaid and my LORA-glued Nethena. The results aren't quite what I expected, though they are far from disappointing. The jury is out on whether this merge outperforms Harmonia.

merge_method: task_arithmetic

base_model: athirdpath/Harmonia-20b

models:

  - model: athirdpath/Harmonia-20b
  - model: NeverSleep/Noromaid-20b-v0.1.1

    - parameters: weight: 0.25
  - model: athirdpath/Nethena-20b-Glued
    - parameters: weight: 0.2
    
dtype: float16

Thanks to Undi95 for pioneering the 20B recipe, and for most of the models involved.