GemMoE-Base-Hidden / mergekit_moe_config.yml
Crystalcareai's picture
Upload folder using huggingface_hub
341b98e verified
base_model: google/gemma-7b
gate_mode: hidden
dtype: bfloat16
experts_per_token: 2
experts:
- source_model: Crystalcareai/gemma-mod
positive_prompts:
- "What are some fun activities to do in Seattle?"
- "What are some fun historical facts about New York City?"
negative_prompts:
- "Write a Python script to scrape data from a website."
- "Explain the key differences between Bayesian and frequentist statistics."
- source_model: Crystalcareai/gemma-orca
positive_prompts:
- "What are the potential long-term economic impacts of raising the minimum wage?"
- "Analyze the logical fallacies in the following argument: [example argument]"
negative_prompts:
- "Write a heartfelt poem about the beauty of nature."
- "What year did World War II end?"
- source_model: Crystalcareai/gemma-codefeedback
positive_prompts:
- "Can you review my JavaScript code and suggest ways to optimize it for better performance?"
- "I'm getting an 'undefined variable' error in my Python script. Here's the code: [code snippet]"
negative_prompts:
- "What are some effective strategies for managing stress and anxiety?"
- "Compare and contrast the themes in 'The Great Gatsby' and 'The Catcher in the Rye'."
- source_model: Crystalcareai/gemma-coder
positive_prompts:
- "How do I implement a binary search tree in C++?"
- "What's the best way to connect to a PostgreSQL database using Java?"
negative_prompts:
- "What were the main causes of the French Revolution?"
- "Suggest some healthy meal ideas for someone on a vegan diet."
- source_model: Crystalcareai/gemma-roleplay
positive_prompts:
- "Let's roleplay a scene where I'm a knight and you're a dragon. I'll start: 'Foul beast! I have come to vanquish you!'"
- "Pretend you're a wise old tree and I'm a curious child. I'll ask: 'Tell me, ancient one, what secrets do you keep?'"
negative_prompts:
- "What is the capital of Bulgaria?"
- "Explain how a combustion engine works."
- source_model: Crystalcareai/Gemma-Generic
positive_prompts:
- "What are the key differences between Buddhism and Hinduism?"
- "How does photosynthesis work in plants?"
negative_prompts:
- "Debug the following block of Rust code: [code]"
- "I need help figuring out how much I should save each month for retirement."
- source_model: Crystalcareai/gemma-Selfdiscover
positive_prompts:
- "Please make a reservation for 2 at Che Fico at 7pm this Friday night."
- "Set a daily reminder for me to take my vitamins at 9am starting tomorrow."
negative_prompts:
- "What do you think about the current state of politics in America?"
- "I'm feeling really down lately. Do you have any advice to cheer me up?"
- source_model: Crystalcareai/Gemma-COT
positive_prompts:
- "What is 27 * 49? Show your step-by-step work."
- "Describe the process for changing a flat tire, with detailed steps in order."
negative_prompts:
- "Write a short science fiction story about space travel."
- "Who painted the Mona Lisa?"