cenfis
/

AlpaGo

Q-bert commited on Jun 16, 2023

Commit

840866a

•

1 Parent(s): 3a40793

Update README.md

Files changed (1) hide show

README.md CHANGED Viewed

@@ -39,7 +39,7 @@ bnb_config = BitsAndBytesConfig(
     bnb_4bit_quant_type="nf4",
     bnb_4bit_compute_dtype=torch.bfloat16
 )
-model = AutoModelForCausalLM.from_pretrained(model_id, quantization_config=bnb_config, device_map={"":0})
 model = PeftModel.from_pretrained(model, "myzens/AlpaGo")
 #You can change Here.

     bnb_4bit_quant_type="nf4",
     bnb_4bit_compute_dtype=torch.bfloat16
 )
+model = AutoModelForCausalLM.from_pretrained(model_id, quantization_config=bnb_config, device_map="auto")
 model = PeftModel.from_pretrained(model, "myzens/AlpaGo")
 #You can change Here.