Lamma3merge3-15B-MoE / mergekit_moe_config.yml
allknowingroger's picture
Upload folder using huggingface_hub
3bfec9f verified
raw
history blame contribute delete
No virus
237 Bytes
base_model: Malikeh1375/llama-3-base-instruct-slerp
experts:
- source_model: Malikeh1375/llama-3-base-instruct-slerp
positive_prompts: ["why"]
- source_model: orpo-explorers/hf-llama3-8b-orpo-v0.0
positive_prompts: ["what"]