mergekit yml
#6
by
ehartford
- opened
can i see the mergekit yml please?
Absolutely!
models:
- model: WizardLM/WizardLM-70B-V1.0
# no parameters necessary for base model
- model: WizardLM/WizardMath-70B-V1.0
parameters:
density: 0.5
weight: 0.5
- model: WizardLM/WizardLM-70B-V1.0
parameters:
density: 0.5
weight: 0.3
merge_method: ties
tokenizer_source: union
base_model: WizardLM/WizardLM-70B-V1.0
parameters:
normalize: true
dtype: float16
But, I don't remember which version of MergeKit I used to do this merge.