--- base_model: - K00B404/Merged_Beowolx-CodePro_Medusa2-14X-7B-Mistral-I-v0-2 - Nexusflow/Starling-LM-7B-beta - beowolx/CodeNinja-1.0-OpenChat-7B library_name: transformers tags: - mergekit - merge --- # merge This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). ## Merge Details ### Merge Method This model was merged using the [TIES](https://arxiv.org/abs/2306.01708) merge method using [K00B404/Merged_Beowolx-CodePro_Medusa2-14X-7B-Mistral-I-v0-2](https://huggingface.co/K00B404/Merged_Beowolx-CodePro_Medusa2-14X-7B-Mistral-I-v0-2) as a base. ### Models Merged The following models were included in the merge: * [Nexusflow/Starling-LM-7B-beta](https://huggingface.co/Nexusflow/Starling-LM-7B-beta) * [beowolx/CodeNinja-1.0-OpenChat-7B](https://huggingface.co/beowolx/CodeNinja-1.0-OpenChat-7B) ### Configuration The following YAML configuration was used to produce this model: ```yaml models: - model: K00B404/Merged_Beowolx-CodePro_Medusa2-14X-7B-Mistral-I-v0-2 # # no parameters necessary for base model - model: Nexusflow/Starling-LM-7B-beta parameters: density: 0.5 weight: 0.5 - model: beowolx/CodeNinja-1.0-OpenChat-7B parameters: density: 0.5 weight: 0.3 merge_method: ties base_model: K00B404/Merged_Beowolx-CodePro_Medusa2-14X-7B-Mistral-I-v0-2 parameters: normalize: true dtype: float16 ```