Intel
/

Qwen2-7B-int4-inc

Text Generation

text-generation-inference

4-bit precision

intel/auto-round

Model card Files Files and versions Community

wenhuach commited on Oct 21, 2024

Commit

83054fc

·

verified ·

1 Parent(s): f04824b

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -8,7 +8,7 @@ datasets:
 ## Model Details
-This model is an int4 auto-round model with group_size 128  of [Qwen/Qwen2-7B](https://huggingface.co/Qwen/Qwen2-7B) generated by [intel/auto-round](https://github.com/intel/auto-round)
 ## How To Use

 ## Model Details
+This model is an int4 auto-round model with group_size 128 of [Qwen/Qwen2-7B](https://huggingface.co/Qwen/Qwen2-7B) generated by [intel/auto-round](https://github.com/intel/auto-round). If you need AutoGPTQ format, please load the model with revision `07a117c`
 ## How To Use