Spaces:

OpenMOSS-Team
/

MOSS-TTSD

Running on Zero

rulerman commited on 2 days ago

Commit

8008b40

1 Parent(s): dbd498f

update2

Files changed (1) hide show

generation_utils.py CHANGED Viewed

@@ -82,7 +82,7 @@ def load_model(
     spt_config_path,
     spt_checkpoint_path,
     torch_dtype=torch.bfloat16,
-    attn_implementation="flash_attention_2",
 ):
     from transformers import AutoTokenizer

     spt_config_path,
     spt_checkpoint_path,
     torch_dtype=torch.bfloat16,
+    attn_implementation="sdpa",
 ):
     from transformers import AutoTokenizer