Spaces:

rodrigomasini
/

rephrase

Paused

rodrigomasini commited on Nov 3, 2023

Commit

e15f802

•

1 Parent(s): 7525f72

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -40,7 +40,7 @@ model = AutoGPTQForCausalLM.from_quantized(local_folder,
         use_safetensors=True,
         strict=use_strict,
         model_basename=model_basename,
-        device_map="auto",
         use_triton=use_triton,
         quantize_config=quantize_config)

         use_safetensors=True,
         strict=use_strict,
         model_basename=model_basename,
+        device="cuda:0",
         use_triton=use_triton,
         quantize_config=quantize_config)