Cannot set sequence length higher than 2048 & doesn't support the optimized triton implementation of FlashAttention
#2 opened 11 months ago
by
t83714
Would it work well with sequence length > 2048?
2
#1 opened 12 months ago
by
SamuelAzran