metadata
license: mit
tags:
- merge
- mergekit
- HuggingFaceH4/zephyr-7b-beta
- mlabonne/NeuralHermes-2.5-Mistral-7B
language:
- en
pipeline_tag: text-generation
zephyr-7b-beta-passthrough
zephyr-7b-beta-passthrough is a merge of the following models using mergekit:
🧩 Configuration
slices:
- sources:
- model: HuggingFaceH4/zephyr-7b-beta
layer_range: [0, 32]
- sources:
- model: mlabonne/NeuralHermes-2.5-Mistral-7B
layer_range: [16, 32]
base_model: HuggingFaceH4/zephyr-7b-beta
merge_method: passthrough
dtype: bfloat16