JayhC
/

Miqu-MS-70B-3.2bpw-h6-exl2

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Miqu-MS-70B-3.2bpw-h6-exl2 / mergekit_config.yml

JayhC's picture

Upload folder using huggingface_hub

1ede4f3 verified 7 months ago

history blame contribute delete

240 Bytes

	models:
	- model: NeverSleep/MiquMaid-v2-70B
	- model: sophosympatheia/Midnight-Miqu-70B-v1.0
	- model: migtissera/Tess-70B-v1.6
	- model: 152334H/miqu-1-70b-sf
	merge_method: model_stock
	base_model: 152334H/miqu-1-70b-sf
	dtype: bfloat16