babybirdprd
/

Experiment26-7B-passthrough-6slice

Text Generation

yam-peleg/Experiment26-7B

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

Experiment26-7B-passthrough-6slice / mergekit_config.yml

babybirdprd's picture

Upload folder using huggingface_hub

9ddf2a9 verified 4 months ago

raw history blame contribute delete

No virus

528 Bytes


	slices:
	- sources:
	- model: yam-peleg/Experiment26-7B
	layer_range: [0, 7]
	- sources:
	- model: yam-peleg/Experiment26-7B
	layer_range: [5, 12]
	- sources:
	- model: yam-peleg/Experiment26-7B
	layer_range: [10, 17]
	- sources:
	- model: yam-peleg/Experiment26-7B
	layer_range: [15, 22]
	- sources:
	- model: yam-peleg/Experiment26-7B
	layer_range: [20, 27]
	- sources:
	- model: yam-peleg/Experiment26-7B
	layer_range: [25, 32]
	merge_method: passthrough
	dtype: bfloat16