GitHub repository: DDDVE/MyFlashAttention
Primary language: Cuda
Created: 2024-12-18T11:46:58Z
Description: implement flash attention 1 and 2, and compare them with scaled_dot_product_attention