TheBloke
/

Platypus-30B-SuperHOT-8K-fp16

Text Generation

text-generation-inference

Model card Files Files and versions Community

TheBloke commited on Jul 9, 2023

Commit

e8ac508

•

1 Parent(s): 714e961

Fix model description

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -58,7 +58,7 @@ config = AutoConfig.from_pretrained(model_name_or_path, trust_remote_code=True)
 # Change this to the sequence length you want
 config.max_position_embeddings = 8192
-model = AutoModelForCausalLM.from_quantized(model_name_or_path,
         config=config,
         trust_remote_code=True,
         device_map='auto')

 # Change this to the sequence length you want
 config.max_position_embeddings = 8192
+model = AutoModelForCausalLM.from_pretrained(model_name_or_path,
         config=config,
         trust_remote_code=True,
         device_map='auto')