README.md

metadata

license: apache-2.0
tags:
  - merge
  - mergekit
  - mistralai/Mistral-7B-v0.1
  - NousResearch/Hermes-2-Pro-Mistral-7B

Mistmes-slerp

Mistmes-slerp is a merge of the following models using mergekit:

• mistralai/Mistral-7B-v0.1
• NousResearch/Hermes-2-Pro-Mistral-7B

🧩 Configuration

```yaml slices:

• sources:
  • model: mistralai/Mistral-7B-v0.1
  • model: NousResearch/Hermes-2-Pro-Mistral-7B merge_method: slerp base_model: mistralai/Mistral-7B-v0.1 parameters: t:
  • filter: self_attn value: [0, 0.5, 0.3, 0.7, 1]
  • filter: mlp value: [1, 0.5, 0.7, 0.3, 0]
  • value: 0.5 dtype: float16 ```