Flash Attention support?

#3
by ndhuynh02 - opened

I am trying to finetune this mode, but it is being really slow. Therefore, I really hope that this model will support flash-attention-2 soon

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment