Llama3merge8-15B-MoE / mergekit_moe_config.yml
allknowingroger's picture
Upload folder using huggingface_hub
b4506cd verified
base_model: sethuiyer/Medichat-Llama3-8B
experts:
- source_model: sethuiyer/Medichat-Llama3-8B
positive_prompts: ["medical"]
- source_model: psyche/llama3-8b-instruct-mrc-v0.3
positive_prompts: ["what"]