Meta-Llama-3-12B / mergekit_config.yml
mlabonne's picture
Upload folder using huggingface_hub
d741b13 verified
slices:
- sources:
- model: NousResearch/Meta-Llama-3-8B
layer_range: [0,9]
- sources:
- model: NousResearch/Meta-Llama-3-8B
layer_range: [5,14]
- sources:
- model: NousResearch/Meta-Llama-3-8B
layer_range: [10,19]
- sources:
- model: NousResearch/Meta-Llama-3-8B
layer_range: [15,24]
- sources:
- model: NousResearch/Meta-Llama-3-8B
layer_range: [20,32]
merge_method: passthrough
dtype: bfloat16