wolfram
/

miqu-1-103b-5.0bpw-h6-exl2

Text Generation

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

miqu-1-103b-5.0bpw-h6-exl2 / mergekit_config.yml

wolfram's picture

Upload folder using huggingface_hub

c92c12b verified 3 months ago

raw history blame contribute delete

No virus

258 Bytes

	dtype: float16
	merge_method: passthrough
	slices:
	- sources:
	- layer_range: [0, 40]
	model: 152334H/miqu-1-70b-sf
	- sources:
	- layer_range: [20, 60]
	model: 152334H/miqu-1-70b-sf
	- sources:
	- layer_range: [40, 80]
	model: 152334H/miqu-1-70b-sf