metadata
base_model:
- jondurbin/nontoxic-bagel-34b-v0.2
tags:
- mergekit
- frankenstein
merged
Meow, picked these two models specifically to compliment each others strengths. mergekit.
Merge Details
Merge Method
This model was merged using the Undi95 style passthrough merge method.
Models Merged
The following models were included in the merge:
- NousResearch/Nous-Hermes-2-Yi-34B
- jondurbin/nontoxic-bagel-34b-v0.2
Configuration
The following YAML configuration was used to produce this model:
dtype: bfloat16
merge_method: passthrough
slices:
- sources:
- layer_range: [0, 52]
model: /home/admin/nv1/nontoxic-bagel-34b-v0.2
- sources:
- layer_range: [8, 60]
model: /home/admin/nv1/Nous-Hermes-2-Yi-34B