ehristoforu
/

Mistral-22B-2x

Text Generation

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

Mistral-22B-2x / mergekit_config.yml

ehristoforu's picture

Upload folder using huggingface_hub

7c51d23 verified about 2 months ago

raw history blame contribute delete

No virus

204 Bytes

	slices:
	- sources:
	- model: Vezora/Mistral-22B-v0.2
	layer_range: [0, 24]
	- sources:
	- model: Vezora/Mistral-22B-v0.1
	layer_range: [8, 32]
	merge_method: passthrough
	dtype: bfloat16