Thaweewat
/

thai-buffala-lora-7b-v0-1

Text Generation

instruction-finetuning

Model card Files Files and versions Community

Thaweewat commited on Mar 23, 2023

Commit

24eec99

•

1 Parent(s): 7226913

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -64,7 +64,7 @@ def generate_prompt(instruction, input=None):
 ### Response:"""
 if not LOAD_8BIT:
-    model.half()  # seems to fix bugs for some users.
 model.eval()
 if torch.__version__ >= "2" and sys.platform != "win32":

 ### Response:"""
 if not LOAD_8BIT:
+    model.half()
 model.eval()
 if torch.__version__ >= "2" and sys.platform != "win32":