CodeLlemur-3.5B-Instruct-line / mergekit_config.yml
JoPmt's picture
Upload folder using huggingface_hub
126efad verified
dtype: bfloat16
merge_method: linear
slices:
- sources:
- layer_range: [0, 16]
model: codellama/CodeLlama-7b-Instruct-hf
parameters:
weight: 0.25
- layer_range: [16, 32]
model: codellama/CodeLlama-7b-Instruct-hf
parameters:
weight: 0.25