MM-SL / mergekit_config.yml
confettiwap's picture
Upload folder using huggingface_hub
1012662 verified
slices:
- sources:
- model: meta-math/MetaMath-Mistral-7B
layer_range: [0, 32]
- sources:
- model: EleutherAI/llemma_7b
layer_range: [24, 32]
merge_method: passthrough
dtype: bfloat16