GitHub repository: lucidrains/native-sparse-attention-pytorch
Primary language: Python
Created: 2025-02-19T03:37:53Z
Description: Implementation of the sparse attention pattern proposed by the Deepseek team in their "Native Sparse Attention" paper