Magnolia-v4-Gemma2-8k-9B / mergekit_config.yml
grimjim's picture
Initial release
28040ff
base_model: google/gemma-2-9b-it
dtype: bfloat16
merge_method: task_arithmetic
parameters:
normalize: true
models:
- model: google/gemma-2-9b-it
- model: grimjim/Magnolia-v2-Gemma2-8k-9B
parameters:
weight: 0.5
- model: grimjim/lemon07r_Gemma-2-Ataraxy-v4c-9B_fixed
parameters:
weight: 0.15
- model: AXCXEPT/EZO-Humanities-9B-gemma-2-it
parameters:
weight: 0.3