Redesign Mixture-of-Experts Routers with Manifold Power Iteration
Paper • 2606.12397 • Published • 84
GregWu
GregYoung
AI & ML interests
None yet
Recent Activity
upvoted a paper 4 days ago
Redesign Mixture-of-Experts Routers with Manifold Power Iteration upvoted a paper 7 days ago
Your UnEmbedding Matrix is Secretly a Feature Lens for Text Embeddings upvoted a paper 6 months ago
Coupling Experts and Routers in Mixture-of-Experts via an Auxiliary LossOrganizations
None yet