2 identical copies of sonya-7b merged into one 11B model using mergekit.
Config:
slices:
- sources:
- model: SanjiWatsuki/Sonya-7B
layer_range: [0, 24]
- sources:
- model: SanjiWatsuki/Sonya-7B
layer_range: [8, 32]
merge_method: passthrough
dtype: float16