merge_method: dare_ties
base_model: athirdpath/BigLlama-20B
models:
model: athirdpath/BigLlama-20B
model: NeverSleep/Noromaid-20b-v0.1.1
parameters:
weight: 0.41
density: 0.50
model: athirdpath/Eileithyia-20b
parameters:
weight: 0.18
density: 0.30
model: athirdpath/CleverGirl-20b-Blended
parameters:
weight: 0.41
density: 0.50
int8_mask: true
dtype: bfloat16
Thanks to brucethemoose for the recipe.