Use Flash Attention for CLIP image encoder

#52

by YenChunChen - opened 10 days ago

←

Microsoft org 10 days ago

•

As title, FA2 for training speedup.

@haipingwu please review

YenChunChen changed pull request status to open 10 days ago

Microsoft org 9 days ago

hi @leoxiaobin , please merge this PR

leoxiaobin changed pull request status to merged 9 days ago

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment