does not support flash attention 2

by atrezonator - opened 6 days ago

•

gigar embed model does not support flash attention 2 on flash_attn-2.8.3+cu132torch2.13-cp314-cp314-linux_x86_64 and print(transformers.version) 5.14.1

atrezonator changed discussion status to closed 6 days ago

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment