Spaces:

silk-road
/

ChatHaruhi-Qwen118k-Extended

Runtime error

silk-road commited on Dec 18, 2023

Commit

5b843db

1 Parent(s): 24209d2

Update ChatHaruhi/Qwen118k2GPT.py

Files changed (1) hide show

ChatHaruhi/Qwen118k2GPT.py CHANGED Viewed

@@ -16,7 +16,6 @@ def initialize_Qwen2LORA(model):
     if model_qwen is None:
         model_qwen = AutoModelForCausalLM.from_pretrained(
             model,
-            torch_dtype=torch.float16,
             device_map="auto",
             trust_remote_code=True
         )

     if model_qwen is None:
         model_qwen = AutoModelForCausalLM.from_pretrained(
             model,
             device_map="auto",
             trust_remote_code=True
         )