osanseviero
/

mistral-instruct-moe-experimental

Text Generation

Mixture of Experts

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

mistral-instruct-moe-experimental / mergekit_moe_config.yml

osanseviero's picture

osanseviero HF staff

Upload folder using huggingface_hub

71788ee 5 months ago

raw history blame contribute delete

No virus

249 Bytes

	base_model: mistralai/Mistral-7B-Instruct-v0.2
	gate_mode: random
	dtype: bfloat16
	experts:
	- source_model: mistralai/Mistral-7B-Instruct-v0.2
	positive_prompts: [""]
	- source_model: mistralai/Mistral-7B-Instruct-v0.1
	positive_prompts: [""]