Spaces:

Tonic
/

stablecode2

Running

Tonic commited on Jan 17

Commit

c0af598

•

1 Parent(s): c43dbcd

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -14,7 +14,7 @@ model = AutoModelForCausalLM.from_pretrained(
     "stabilityai/stable-code-3b",
     trust_remote_code=True,
     torch_dtype="auto",
-    attn_implementation="flash_attention_2",
 ).to("cuda" if torch.cuda.is_available() else "cpu")
 @spaces.GPU

     "stabilityai/stable-code-3b",
     trust_remote_code=True,
     torch_dtype="auto",
+#   attn_implementation="flash_attention_2",
 ).to("cuda" if torch.cuda.is_available() else "cpu")
 @spaces.GPU