MaziyarPanahi

/

WizardLM-Math-70B-TIES-v0.1

like 3

Absolutely!

models:
  - model: WizardLM/WizardLM-70B-V1.0
    # no parameters necessary for base model
  - model: WizardLM/WizardMath-70B-V1.0
    parameters:
      density: 0.5
      weight: 0.5
  - model: WizardLM/WizardLM-70B-V1.0
    parameters:
      density: 0.5
      weight: 0.3
merge_method: ties
tokenizer_source: union
base_model: WizardLM/WizardLM-70B-V1.0
parameters:
  normalize: true
dtype: float16

But, I don't remember which version of MergeKit I used to do this merge.