metadata
license: apache-2.0
tags:
- merge
- mergekit
- lazymergekit
- KoboldAI/LLaMA2-13B-Psyfighter2
- NeverSleep/Noromaid-13b-v0.2
NoroFighter-13B-v0.1a
Our very first attempt at merging models!
NoroFighter-13B-v0.1a is a merge of the following models using mergekit:
🧩 Configuration
merge_method: dare_ties
dtype: float16
base_model: TheBloke/Llama-2-13B-fp16
models:
- model: TheBloke/Llama-2-13B-fp16
- model: KoboldAI/LLaMA2-13B-Psyfighter2
parameters:
weight: 0.3
density: 0.53
- model: NeverSleep/Noromaid-13b-v0.2
parameters:
weight: 0.7
density: 0.53