SASS instruction histogram for kernel flash_attn_multihead (kernels/attention/flash_attention/flash_attn.sm_86.cubin)
Total instructions: 1224
HMMA: 0
IMMA: 0
LDSM: 0
LDS: 128
STS: 14
LDGSTS: 0
LDG: 16
STG: 2
FFMA: 138
FADD: 227
FMUL: 135
FSEL: 0
MUFU: 38
SHFL: 160
IADD3: 47
IMAD: 20
ISETP: 18
LOP3: 21
BRA: 15
EXIT: 1
BAR: 0
BARRIER: 0
WARPSYNC: 0
NOP: 17
S2R: 6
Other: 221
Useful instructions: 40.8%