zephyr-7b-beta-passthrough
zephyr-7b-beta-passthrough is a merge of the following models using mergekit:
🧩 Configuration
slices:
- sources:
- model: HuggingFaceH4/zephyr-7b-beta
layer_range: [0, 32]
- sources:
- model: mlabonne/NeuralHermes-2.5-Mistral-7B
layer_range: [16, 32]
base_model: HuggingFaceH4/zephyr-7b-beta
merge_method: passthrough
dtype: bfloat16
- Downloads last month
- 638