GitHub repository: Agora-Lab-AI/OmegaViT
Primary language: Python
Created: 2024-12-19T06:33:15Z
Description: OmegaViT (ΩViT) is a cutting-edge vision transformer architecture that combines multi-query attention, rotary embeddings, state space modeling, and mixture of experts to achieve superior performance across various computer vision tasks.