OPEA
/

Qwen2.5-7B-Instruct-int4-sym-inc

Model card Files Files and versions Community

cicdatopea commited on 22 days ago

Commit

a3f7e6f

•

1 Parent(s): 5e07ee3

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -23,8 +23,8 @@ model = AutoModelForCausalLM.from_pretrained(
     quantized_model_dir,
     torch_dtype='auto',
     device_map="auto",
-    ##revision="0b70f95" ##AutoGPTQ format
-    ##revision="5a6d912" ##Quantized lm-head version
 )

     quantized_model_dir,
     torch_dtype='auto',
     device_map="auto",
+    ##revision="2b3d2ef" ##AutoGPTQ format
+    ##revision="0736448" ##Quantized lm-head version
 )