Skylaude
/

WizardLM-2-4x7B-MoE

Text Generation

Microsoft/WizardLM-2-7B

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

WizardLM-2-4x7B-MoE / mergekit_moe_config.yml

Skylaude's picture

Upload 8 files

266dd35 verified 7 months ago

251 Bytes

	base_model: models/WizardLM-2-7B
	gate_mode: random
	dtype: float16
	experts_per_token: 4
	experts:
	- source_model: models/WizardLM-2-7B
	- source_model: models/WizardLM-2-7B
	- source_model: models/WizardLM-2-7B
	- source_model: models/WizardLM-2-7B