Openchat-ORCAMistral-Passtrough

Openchat-ORCAMistral-Passtrough is a merge of the following models using mergekit:

• openchat/openchat-3.5-1210
• Open-Orca/Mistral-7B-OpenOrca

🧩 Configuration

slices:
  - sources:
    - model: openchat/openchat-3.5-1210
      layer_range: [0, 24]
  - sources:
    - model: Open-Orca/Mistral-7B-OpenOrca
      layer_range: [8, 32]
merge_method: passthrough
dtype: bfloat16