Hugging Face's logo

Intel
/
Mistral-7B-Instruct-v0.2-int4-inc

English
Model card Files Community
yintongl commited on
Commit
d78bd35
•
1 Parent(s): 6e7f14a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -0
README.md CHANGED
@@ -28,6 +28,7 @@ python3 main.py \
28
  --device 0 \
29
  --group_size 128 \
30
  --bits 4 \
 
31
  --iters 1000 \
32
  --deployment_device 'gpu' \
33
  --output_dir "./tmp_autoround" \
 
28
  --device 0 \
29
  --group_size 128 \
30
  --bits 4 \
31
+ --nsamples 512 \
32
  --iters 1000 \
33
  --deployment_device 'gpu' \
34
  --output_dir "./tmp_autoround" \