mixture-of-attention (pypi): Mixture of Attention
Keywords: artificial intelligence|deep learning|transformers|attention mechanism|mixture-of-experts|routed attention|artificial-intelligence|attention-mechanisms|deep-learning|routed-attention