CrystalMistral-14b / mergekit_moe_config.yml
Crystalcareai's picture
Upload folder using huggingface_hub
d7171ea verified
raw
history blame
377 Bytes
base_model: Crystalcareai/CrystalMistral
gate_mode: random
dtype: bfloat16
experts_per_token: 2
experts:
- source_model: Crystalcareai/CrystalMistral
positive_prompts:
- "You are an helpful general-purpose assistant."
- source_model: Crystalcareai/CrystalMistral
positive_prompts:
- "You are an expert in providing detailed technical explanations."