Lamma3merge2-15B-MoE / mergekit_moe_config.yml
allknowingroger's picture
Upload folder using huggingface_hub
3c32d45 verified
raw
history blame contribute delete
No virus
255 Bytes
base_model: mohsenfayyaz/Meta-Llama-3-8B-Instruct_esnli_5000_1ep
experts:
- source_model: mohsenfayyaz/Meta-Llama-3-8B-Instruct_esnli_5000_1ep
positive_prompts: ["why"]
- source_model: birgermoell/Llama-3-dare_ties
positive_prompts: ["mhat"]