LoneStriker
/

Air-Striker-Mixtral-8x7B-Instruct-ZLoss-3.0bpw-h6-exl2

Text Generation

text-generation-inference

Model card Files Files and versions Community

Air-Striker-Mixtral-8x7B-Instruct-ZLoss-3.0bpw-h6-exl2 / mergekit_config.yml

LoneStriker's picture

Upload folder using huggingface_hub

fa02de4 verified 6 months ago

No virus

216 Bytes

	models:
	- model: mistralai/Mixtral-8x7B-Instruct-v0.1
	parameters:
	weight: 0.5
	- model: LoneStriker/Air-Striker-Mixtral-8x7B-ZLoss
	parameters:
	weight: 0.5
	merge_method: linear
	dtype: bfloat16