--- base_model: - openaccess-ai-collective/dpopenhermes-alpha-v0 - simonveitner/Math-OpenHermes-2.5-Mistral-7B tags: - mergekit - merge --- # merged This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). ## Merge Details ### Merge Method This model was merged using the SLERP merge method. ### Models Merged The following models were included in the merge: * [openaccess-ai-collective/dpopenhermes-alpha-v0](https://huggingface.co/openaccess-ai-collective/dpopenhermes-alpha-v0) * [simonveitner/Math-OpenHermes-2.5-Mistral-7B](https://huggingface.co/simonveitner/Math-OpenHermes-2.5-Mistral-7B) ### Configuration The following YAML configuration was used to produce this model: ```yaml base_model: simonveitner/Math-OpenHermes-2.5-Mistral-7B dtype: float16 merge_method: slerp parameters: t: - value: 0.5 slices: - sources: - layer_range: [0, 32] model: simonveitner/Math-OpenHermes-2.5-Mistral-7B - layer_range: [0, 32] model: openaccess-ai-collective/dpopenhermes-alpha-v0 ```