README.md

metadata

license: apache-2.0
tags:
  - merge
  - mergekit
  - lazymergekit
  - mistralai/Mistral-7B-Instruct-v0.2
  - Viet-Mistral/Vistral-7B-Chat

Vistral-bilingual-merge

Vistral-bilingual-merge is a merge of the following models using mergekit:

• mistralai/Mistral-7B-Instruct-v0.2
• Viet-Mistral/Vistral-7B-Chat

🧩 Configuration

```yaml models:

• model: mistralai/Mistral-7B-v0.1

  no parameters necessary for base model

• model: mistralai/Mistral-7B-Instruct-v0.2 parameters: density: 0.5 weight: 0.5
• model: Viet-Mistral/Vistral-7B-Chat parameters: density: 0.5 weight: 0.3 merge_method: ties base_model: mistralai/Mistral-7B-v0.1 parameters: normalize: true dtype: float16 ```