Zoyd
/

giannisan_Mistral-10.7B-Instruct-v0.3-depth-upscaling-6_5bpw_exl2

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

giannisan_Mistral-10.7B-Instruct-v0.3-depth-upscaling-6_5bpw_exl2 / mergekit_config.yml

Zoyd's picture

Upload folder using huggingface_hub

ce7ceaa verified 2 months ago

history blame contribute delete

No virus

233 Bytes

	slices:
	- sources:
	- model: mistralai/Mistral-7B-Instruct-v0.3
	layer_range: [0, 24]
	- sources:
	- model: mistralai/Mistral-7B-Instruct-v0.3
	layer_range: [8, 32]
	merge_method: passthrough
	dtype: bfloat16