Update README.md

add itrex inference eg

README.md

@@ -6,6 +6,25 @@ license: apache-2.0
 This model is an int4 model with group_size 64 of  [tiiuae/falcon-7b](https://huggingface.co/tiiuae/falcon-7b) generated by [intel/auto-round](https://github.com/intel/auto-round), because there is an issue when evaluating with group_size 128.
 
 ## How To Use
+### INT4 Inference with ITREX on CPU
+Install the latest [intel-extension-for-transformers](
+https://github.com/intel/intel-extension-for-transformers)
+```python
+from intel_extension_for_transformers.transformers import AutoModelForCausalLM
+from transformers import AutoTokenizer
+quantized_model_dir = "Intel/falcon-7b-int4-inc"
+model = AutoModelForCausalLM.from_pretrained(quantized_model_dir,
+                                             device_map="auto",
+                                             trust_remote_code=False,
+                                             use_neural_speed=False,
+                                             )
+tokenizer = AutoTokenizer.from_pretrained(quantized_model_dir, use_fast=True)
+print(tokenizer.decode(model.generate(**tokenizer("There is a girl who likes adventure,", return_tensors="pt").to(model.device),max_new_tokens=50)[0]))
+"""
+There is a girl who likes adventure, and she is a girl who likes to be a hero. She is a girl who likes to be a hero. She is a girl who likes to be a hero. She is a girl who likes to be a hero. She is a girl who
+"""
+```
+
 
 ### INT4 Inference with AutoGPTQ