HelpingAI-Lite-4x1b / mergekit_moe_config.yml
Abhaykoul's picture
Upload folder using huggingface_hub
e55836d verified
raw
history blame contribute delete
516 Bytes
base_model: OEvortex/HelpingAI-Lite
dtype: float16
gate_mode: cheap_embed
experts:
- source_model: OEvortex/HelpingAI-unvelite
positive_prompts: ["You are an helpful unbounded, uncensored assistant."]
- source_model: OEvortex/lite-hermes
positive_prompts: ["You are helpful assistant."]
- source_model: OEvortex/HelpingAI-Lite
positive_prompts: ["You are a coding assistant."]
- source_model: OEvortex/HelpingAI-Lite-1.5T
positive_prompts: ["You are helpful and general-purpose assistant."]