Drexet/drexet-moe

Drexet-mini1-MoE

A Mixture-of-Experts style model combining 10 specialized adapters with automatic routing.

Experts Included:

• code: Python/coding (Qwen-Coder-7B)
• qa: Question answering (Qwen-7B)
• math: Mathematics (Mistral-7B)
• science: Science/research (Gemma-7B)
• creative: Creative writing (Llama-8B)
• general: General knowledge (Qwen-3B)

Usage:

from drexet_router import DrexetRouter

router = DrexetRouter("/path/to/Drexet-mini1-MoE")

# Automatically routes to best expert
response, expert = router.generate("Write a Python function to sort a list")
print(f"Expert used: {expert}")
print(response)

How it works:

1. Router analyzes your query
2. Selects the most appropriate expert
3. Loads that expert's adapter
4. Generates response

Architecture:

• 6 different base models
• 10 specialized LoRA adapters
• Keyword-based routing (upgradeable to neural router)