--- tags: - not-for-all-audiences - merge - mergekit base_model: - Sao10K/Fimbulvetr-11B-v2 - KoboldAI/Mistral-7B-Holodeck-1 - KoboldAI/Mistral-7B-Erebus-v3 - senseable/WestLake-7B-v2 --- Refer to the original models for best usage. - [Sao10K/Fimbulvetr-11B-v2](https://huggingface.co/Sao10K/Fimbulvetr-11B-v2) - [KoboldAI/Mistral-7B-Holodeck-1](https://huggingface.co/KoboldAI/Mistral-7B-Holodeck-1) - [KoboldAI/Mistral-7B-Erebus-v3](https://huggingface.co/KoboldAI/Mistral-7B-Erebus-v3) - [senseable/WestLake-7B-v2](https://huggingface.co/senseable/WestLake-7B-v2) --- # Mergekit Recipe ```yaml # Mistral Merging merge_method: linear dtype: float16 models: - model: KoboldAI/Mistral-7B-Holodeck-1 parameters: weight: 0.45 - model: KoboldAI/Mistral-7B-Erebus-v3 parameters: weight: 0.45 - model: senseable/WestLake-7B-v2 parameters: weight: 0.1 name: MV01-Holodeck-Erebus-Westlake-7B --- # Mistral Stacking merge_method: passthrough dtype: float16 slices: - sources: - model: MV01-Holodeck-Erebus-Westlake-7B layer_range: [0, 24] - sources: - model: MV01-Holodeck-Erebus-Westlake-7B layer_range: [8, 32] name: MV01-Stacked-Holodeck-Erebus-Westlake-Unhealed-10.7B --- # Mistral Stack Healing merge_method: task_arithmetic dtype: float16 base_model: Undi95/Mistral-11B-v0.1 models: - model: Sao10K/Fimbulvetr-11B-v2 parameters: weight: 1.0 - model: MV01-Stacked-Holodeck-Erebus-Westlake-Unhealed-10.7B parameters: weight: 1.0 ```