MergedExpert-2x8b / mergekit_moe_config.yml
bhavnah's picture
Upload folder using huggingface_hub
17e2d09 verified
raw
history blame contribute delete
No virus
347 Bytes
base_model: mistralai/Mistral-7B-Instruct-v0.2
dtype: float16
gate_mode: cheap_embed
experts:
- source_model: HuggingFaceH4/zephyr-7b-beta
positive_prompts: ["You are a helpful text summarization assistant."]
- source_model: mistralai/Mistral-7B-Instruct-v0.2
positive_prompts: ["You are assistant for question answering from text."]