sandmanbuzz
/

Air-Striker-Mixtral-8x7B-ZLoss-Instruct

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Air-Striker-Mixtral-8x7B-ZLoss-Instruct / mergekit_config.yml

sandmanbuzz's picture

We kinda don't have an fp16 of this anywhere do we?

115e05d verified 9 months ago

224 Bytes

	models:
	- model: mistralai/Mixtral-8x7B-Instruct-v0.1
	parameters:
	weight: 0.5
	- model: ./Air-Striker-Mixtral-8x7B-ZLoss-noninstruct/merged
	parameters:
	weight: 0.5
	merge_method: linear
	dtype: bfloat16