babybirdprd
/

moe-minicpm-x4-base

Text Generation

Mixture of Experts

NurtureAI/minicpm-2b-sft-bf16-llamafied-16k

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

moe-minicpm-x4-base / mergekit_moe_config.yml

babybirdprd's picture

Upload folder using huggingface_hub

6316cb1 verified 4 months ago

raw history blame contribute delete

No virus

461 Bytes


	base_model: NurtureAI/minicpm-2b-sft-bf16-llamafied-16k
	gate_mode: random
	experts_per_token: 2
	experts:
	- source_model: NurtureAI/minicpm-2b-sft-bf16-llamafied-16k
	positive_prompts: [""]
	- source_model: NurtureAI/minicpm-2b-sft-bf16-llamafied-16k
	positive_prompts: [""]
	- source_model: NurtureAI/minicpm-2b-sft-bf16-llamafied-16k
	positive_prompts: [""]
	- source_model: NurtureAI/minicpm-2b-sft-bf16-llamafied-16k
	positive_prompts: [""]