--- license: apache-2.0 tags: - merge - mergekit - lazymergekit - danish-foundation-models/munin-7b-alpha - timpal0l/Mistral-7B-v0.1-flashback-v2 - NbAiLab/nb-sau-7b-4k-step100k --- # NordicMIS-v1.0-dareties NordicMIS-v1.0-dareties is a merge of the following models using [mergekit](https://github.com/cg123/mergekit): * [danish-foundation-models/munin-7b-alpha](https://huggingface.co/danish-foundation-models/munin-7b-alpha) * [timpal0l/Mistral-7B-v0.1-flashback-v2](https://huggingface.co/timpal0l/Mistral-7B-v0.1-flashback-v2) * [NbAiLab/nb-sau-7b-4k-step100k](https://huggingface.co/NbAiLab/nb-sau-7b-4k-step100k) ## 🧩 Configuration \```yaml models: - model: mistralai/Mistral-7B-v0.1 # No parameters necessary for base model - model: danish-foundation-models/munin-7b-alpha parameters: density: 0.53 weight: 0.5 - model: timpal0l/Mistral-7B-v0.1-flashback-v2 parameters: density: 0.53 weight: 0.3 - model: NbAiLab/nb-sau-7b-4k-step100k parameters: density: 0.53 weight: 0.2 merge_method: dare_ties base_model: mistralai/Mistral-7B-v0.1 parameters: int8_mask: true dtype: bfloat16 \```