Spaces:

rodrigomasini
/

rephrase

Paused

rodrigomasini commited on Nov 7, 2023

Commit

b99cc1c

•

1 Parent(s): 5d847d4

Update app_v1.py

Files changed (1) hide show

app_v1.py CHANGED Viewed

@@ -48,7 +48,8 @@ model = AutoGPTQForCausalLM.from_quantized(
     use_safetensors=True,
     strict=use_strict,
     model_basename=model_basename,
-    device="auto",
     use_triton=use_triton,
     quantize_config=quantize_config
 )

     use_safetensors=True,
     strict=use_strict,
     model_basename=model_basename,
+    device="cuda:0",
+    trust_remote_code=True,
     use_triton=use_triton,
     quantize_config=quantize_config
 )