--- base_model: - MrRobotoAI/Odin-v2-8b-NOVELIST-128K - MrRobotoAI/Hel-v4-8b-DARK-FICTION-128K - MrRobotoAI/Heimdall-v2.1-8b-MANCHESTER-WRITER-128K library_name: transformers tags: - mergekit - merge --- # merge This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). ## Merge Details ### Merge Method This model was merged using the [Linear](https://arxiv.org/abs/2203.05482) merge method. ### Models Merged The following models were included in the merge: * [MrRobotoAI/Odin-v2-8b-NOVELIST-128K](https://huggingface.co/MrRobotoAI/Odin-v2-8b-NOVELIST-128K) * [MrRobotoAI/Hel-v4-8b-DARK-FICTION-128K](https://huggingface.co/MrRobotoAI/Hel-v4-8b-DARK-FICTION-128K) * [MrRobotoAI/Heimdall-v2.1-8b-MANCHESTER-WRITER-128K](https://huggingface.co/MrRobotoAI/Heimdall-v2.1-8b-MANCHESTER-WRITER-128K) ### Configuration The following YAML configuration was used to produce this model: ```yaml models: - model: MrRobotoAI/Heimdall-v2.1-8b-MANCHESTER-WRITER-128K - model: MrRobotoAI/Hel-v4-8b-DARK-FICTION-128K - model: MrRobotoAI/Odin-v2-8b-NOVELIST-128K parameters: weight: 1.0 merge_method: linear dtype: float16 ```