goniii
/

Llama-3-Ko-8B-passthrough-merge-test

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Llama-3-Ko-8B-passthrough-merge-test / mergekit_config.yml

goniii's picture

Upload folder using huggingface_hub

6ff667b verified 6 months ago

222 Bytes

	slices:
	- sources:
	- model: beomi/Llama-3-Open-Ko-8B-Instruct-preview
	layer_range: [0, 24]
	- sources:
	- model: beomi/Llama-3-Open-Ko-8B
	layer_range: [8, 32]
	merge_method: passthrough
	dtype: bfloat16