mlabonne
/

FrankenMonarch-11b

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

FrankenMonarch-11b / mergekit_config.yml

mlabonne's picture

Upload folder using huggingface_hub

8d6d645 verified 9 months ago

history blame contribute delete

223 Bytes


	slices:
	- sources:
	- model: mlabonne/NeuralMonarch-7B
	layer_range: [0, 24]
	- sources:
	- model: mlabonne/AlphaMonarch-7B
	layer_range: [8, 32]
	merge_method: passthrough
	dtype: bfloat16
	random_seed: 0