ETA for Flash Attention 2.0 Support in ChatGLMForConditionalGeneration

#46

by frank098 - opened Jun 17

Jun 17

I am currently using the glm-4-9b-chat model and would like to know if there is an estimated timeline for when Flash Attention 2.0 support might be added.

zRzRzRzRzRzRzR

Knowledge Engineering Group (KEG) & Data Mining at Tsinghua University org Jun 25

support it now

zRzRzRzRzRzRzR changed discussion status to closed Jul 10

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment