moe-mergekit-v0-llama8binstructv3 / mergekit_moe_config.yml
vrathi101's picture
Upload folder using huggingface_hub
5f48ae7 verified
base_model: meta-llama/Meta-Llama-3-8B-Instruct
dtype: float16
gate_mode: cheap_embed
experts:
- source_model: dimitrib2001/Llama-Autotrain-Merged
positive_prompts: ["You are a helpful assistant for question answering."]
- source_model: vrathi101/dalton-caldwell-bot-v0-merged-llama8binstructv3
positive_prompts: ["You are helpful assistant."]