RWKV
/

v6-Finch-7B-HF

Text Generation

Model card Files Files and versions Community

weili-0234 commited on Sep 25

Commit

4a4c25d

•

1 Parent(s): b852487

Upload modeling_rwkv6.py

fix import error with flash linear attention

Files changed (1) hide show

modeling_rwkv6.py +1 -1

modeling_rwkv6.py CHANGED Viewed

@@ -38,7 +38,7 @@ from transformers.utils import (
 from .configuration_rwkv6 import Rwkv6Config
 try:
-    from fla.ops.rwkv6.recurrent_fuse import fused_recurrent_rwkv6
 except ImportError:
     print("Required module is not installed. Please install it using the following commands:")
     print("pip install -U git+https://github.com/sustcsonglin/flash-linear-attention")

 from .configuration_rwkv6 import Rwkv6Config
 try:
+    from fla.ops.rwkv6 import fused_recurrent_rwkv6
 except ImportError:
     print("Required module is not installed. Please install it using the following commands:")
     print("pip install -U git+https://github.com/sustcsonglin/flash-linear-attention")