Unable to load the model.. Can you explain..
#7
by
jdc4429
- opened
ImportError: For use_flash_rmsnorm: pip install git+https://github.com/HazyResearch/flash-attention.git#subdirectory=csrc/layer_norm
@jdc4429 : Just install Flash Attention 2 by following instructions here: https://github.com/Dao-AILab/flash-attention
You can also follow the instructions here: https://github.com/togethercomputer/stripedhyena
Zymrael
changed discussion status to
closed