Undi95

/

Mistral-11B-OmniMix9

like 2

Hi!
Yes it's not public, I have made a lot of model just for that merge and try different thing haha.
Here is the recipe:

slices:
  - sources:
    - model: Open-Orca/Mistral-7B-OpenOrca
      layer_range: [0, 24]
  - sources:
    - model: akjindal53244/Mistral-7B-v0.1-Open-Platypus
      layer_range: [8, 32]
merge_method: passthrough
dtype: bfloat16

Tools : https://github.com/cg123/mergekit