Llama-3.1-Bonsaikraft-8B-Instruct / mergekit_config.yml
grimjim's picture
Initial release
3291a83
raw
history blame contribute delete
320 Bytes
base_model: VAGOsolutions/Llama-3.1-SauerkrautLM-8b-Instruct
dtype: bfloat16
merge_method: slerp
slices:
- sources:
- model: VAGOsolutions/Llama-3.1-SauerkrautLM-8b-Instruct
layer_range: [0, 32]
- model: tokyotech-llm/Llama-3.1-Swallow-8B-Instruct-v0.2
layer_range: [0, 32]
parameters:
t:
- value: 0.5